-- Logs begin at Tue 2022-10-18 15:15:31 UTC, end at Tue 2022-10-18 18:03:17 UTC. -- Oct 18 15:44:58.844237 n-d-858383-14 systemd[1]: Starting Devstack devstack@keystone.service... Oct 18 15:44:58.851934 n-d-858383-14 devstack@keystone.service[81762]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 15:44:58 2022] *** Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: nodename: n-d-858383-14 Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: machine: x86_64 Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: clock source: unix Oct 18 15:44:58.853971 n-d-858383-14 devstack@keystone.service[81762]: pcre jit disabled Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: detected number of CPU cores: 4 Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: current working directory: / Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: detected binary path: /usr/bin/uwsgi-core Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: your processes number limit is 47680 Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: your memory page size is 4096 bytes Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: detected max file descriptor number: 2048 Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: lock engine: pthread robust mutexes Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: thunder lock: enabled Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 18 15:44:58.854429 n-d-858383-14 devstack@keystone.service[81762]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 15:44:58.894494 n-d-858383-14 devstack@keystone.service[81762]: Python main interpreter initialized at 0x564ec075d9c0 Oct 18 15:44:58.894494 n-d-858383-14 devstack@keystone.service[81762]: python threads support enabled Oct 18 15:44:58.894494 n-d-858383-14 devstack@keystone.service[81762]: your server socket listen backlog is limited to 100 connections Oct 18 15:44:58.894494 n-d-858383-14 devstack@keystone.service[81762]: your mercy for graceful operations on workers is 90 seconds Oct 18 15:44:58.894880 n-d-858383-14 devstack@keystone.service[81762]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 15:44:58.894969 n-d-858383-14 devstack@keystone.service[81762]: *** Operational MODE: preforking *** Oct 18 15:44:58.895212 n-d-858383-14 devstack@keystone.service[81762]: *** uWSGI is running in multiple interpreter mode *** Oct 18 15:44:58.895212 n-d-858383-14 devstack@keystone.service[81762]: spawned uWSGI master process (pid: 81762) Oct 18 15:44:58.895417 n-d-858383-14 systemd[1]: Started Devstack devstack@keystone.service. Oct 18 15:44:58.897321 n-d-858383-14 devstack@keystone.service[81762]: spawned uWSGI worker 1 (pid: 81775, cores: 1) Oct 18 15:44:58.897321 n-d-858383-14 devstack@keystone.service[81762]: spawned uWSGI worker 2 (pid: 81776, cores: 1) Oct 18 15:44:58.897321 n-d-858383-14 devstack@keystone.service[81762]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 15:45:03.171641 n-d-858383-14 devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:45:03.171641 n-d-858383-14 devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Oct 18 15:45:03.172443 n-d-858383-14 devstack@keystone.service[81776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:45:03.172443 n-d-858383-14 devstack@keystone.service[81776]: from cryptography.utils import int_from_bytes Oct 18 15:45:03.173094 n-d-858383-14 devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:45:03.173094 n-d-858383-14 devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Oct 18 15:45:03.173521 n-d-858383-14 devstack@keystone.service[81775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 15:45:03.173521 n-d-858383-14 devstack@keystone.service[81775]: from cryptography.utils import int_from_bytes Oct 18 15:45:03.222393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:45:03.222548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:45:03.222694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] command line args: [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:45:03.222957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:45:03.223132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ================================================================================ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:45:03.223381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.223629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] config_dir = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.223819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.223998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] config_source = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.224172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] debug = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.224368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.224704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 15:45:03.224798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.224898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 15:45:03.224972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.225138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] command line args: [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 15:45:03.225251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.225400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.225504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 15:45:03.225606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ================================================================================ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 15:45:03.225706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.225807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_config_append = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.225907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] config_dir = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_dir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] config_source = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] debug = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.226893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.227896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_config_append = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_dir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.228953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.229958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] publish_errors = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.230887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] standard_threads = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.231919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] use_journal = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] use_json = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.78/identity {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] use_stderr = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] use_syslog = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] publish_errors = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.232976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.233333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.233659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.233894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.233971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.234130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] standard_threads = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.234214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.234363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.234442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.234871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.234957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.235048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.235680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] use_journal = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.236213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] use_json = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.236366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] use_stderr = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.236513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] use_syslog = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.236664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 15:45:03.236818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.236954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.237957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.238922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.239902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.240954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.241998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.242932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.243995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.244914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.245918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.246986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.247980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.248912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.249849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.250792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.251840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.251840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.251993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.252971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.253940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.254904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.255985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.256983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.257910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.258840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.external = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.259923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.password = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] auth.token = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.260938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.261906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.external = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.262991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.password = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] auth.token = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.263960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.264914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.265924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.266003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.266164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.266252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.266428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.266683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.267989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.268955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.269919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.270880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.271963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.272985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.273977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.274922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.275846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.276909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.277880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.278963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.279935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.280922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.281842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.282973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.283981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.284916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.285900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.286974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.287985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.288931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.289893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.290985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.291923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.292931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] role.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] role.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.293908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.294851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] role.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.295955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] role.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.296919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.297075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.297223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.297325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.297494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.298937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.299997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.300962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.301928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.302866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.303988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.304967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.305988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.306875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.307856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.308938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.309940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:45:03.310658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.310920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.311185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.311491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.311769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.312036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.312301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.312559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.312829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.313164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.313530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.313872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.314163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.314438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.314689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.315000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 15:45:03.315197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 15:45:03.339429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.339658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.339879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.341546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.341783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.342010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.348973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.350881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.377758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.377984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.378579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.378813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.430806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.431864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.480049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.480228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.481594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.481829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.635362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.635584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.635805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.636910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.637156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.659732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.659954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.660979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.661173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.661413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.661651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.671947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.673232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.684671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.684902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.685980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.686056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.686281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.686498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.686714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 15:45:03.703076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.703283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 15:45:03.703619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.703835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 15:45:03.703962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.704139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.704320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 15:45:03.704462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.704657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.704749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.704858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 15:45:03.704950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.705159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.705423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.705683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.705940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.714472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.714747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.715013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.715291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.715809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.716087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.716360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.716655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.722320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.724034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.725224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.725508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.725788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.726066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.726345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.726602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.726868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.726957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.727141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.727408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.727526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.727677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.727816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.727939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.728099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.728383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.728643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.728911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.729212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.729488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.729771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.730094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.751564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.753049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.753334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.754291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.755767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.756049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.757988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.758273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.758554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.760736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.761056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.761365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.764846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.765154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.768495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.768781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.771355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.771653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.771939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.772222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.772499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.772775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.773073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.773340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.774463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.774760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.775046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.775329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.775604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.775880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.776153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.776422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.788717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.789013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.792153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.792440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.792780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.795957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.796252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.796340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.800383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.800676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.801027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.804080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.805125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.807258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.807553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.807833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.808110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.808253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.808383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.808656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.811444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.811745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.812030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.812316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.812596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.812875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.824317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.824605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.824870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.825157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.829431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.829760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.830121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.830390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.832515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.834078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.835588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.835860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.837156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.838545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.838680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.838834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.839114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.839397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.839779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.840299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.840597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.843335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.843631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.843922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.844328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.844925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.850969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.851255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.851532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.851807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.852189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.852462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.852744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.857101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.857386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.857673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.857975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.858378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.858686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.859007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.868972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.871882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.874763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.876215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.876404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.878031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.878312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.878710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.879233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.882253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.883700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.885030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.885176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.885469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.885863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.886471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.889357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.889747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.890031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.890306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.893066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.894608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.897647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.898068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.898379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.898631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.898727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.898916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.899192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.906128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.906412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.906692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.906845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.907144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.907268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.907385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.907458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.907668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.907946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.908299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.908565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.908848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.909144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.909412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.909684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.910005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.914325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 15:45:03.914613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.914899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.915180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.915470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.915742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.916015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.916295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.916582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.916852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.917159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.917440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.917730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.917991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 15:45:03.944875 n-d-858383-14 devstack@keystone.service[81776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ec075d9c0 pid: 81776 (default app) Oct 18 15:45:03.948213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74acb0-9c26-4817-a558-0ab9acaa3088 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:03.948495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74acb0-9c26-4817-a558-0ab9acaa3088 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:03.948761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74acb0-9c26-4817-a558-0ab9acaa3088 None None] PATH_INFO: `/v3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:03.952912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 791 bytes} [Tue Oct 18 15:45:03 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:03.954762 n-d-858383-14 devstack@keystone.service[81775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ec075d9c0 pid: 81775 (default app) Oct 18 15:45:10.726541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:10.727056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:10.727056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:10.728373 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:10.736872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:10.737437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:10.737437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:10.807543 n-d-858383-14 devstack@keystone.service[81775]: INFO dbcounter [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] Registered counter for database keystone Oct 18 15:45:10.826627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG oslo_db.sqlalchemy.engines [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:45:10.832807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writer thread running {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:45:11.010827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81775) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 15:45:11.011129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG passlib.handlers.bcrypt [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81775) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 15:45:11.068958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:11.070876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:11.199367 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1/3] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 18 15:45:11.680016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:11.751262 n-d-858383-14 devstack@keystone.service[81776]: INFO dbcounter [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] Registered counter for database keystone Oct 18 15:45:11.772716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG oslo_db.sqlalchemy.engines [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 15:45:11.778930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writer thread running {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 15:45:11.900552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63552daa-b91a-4ea5-8d35-21eedcd33dbd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:11.904984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:11.905620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:11.905902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:11.906170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:11.915223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:11.967957 n-d-858383-14 devstack@keystone.service[81776]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 15:45:11.968294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0145a07-012c-4de5-b9f4-92e4f59c0912 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:11.978626 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 18 15:45:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:11.984898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:12.001530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406d2f-44b0-42c7-a1e5-a7db71150a72 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:12.006049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:12.007300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:12.007582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:12.007855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] PATH_INFO: `/v3/projects/6c8d96b0623744b2b02923664ec6fcd8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:12.009335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c8d96b0623744b2b02923664ec6fcd8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:12.062919 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 15:45:12.063274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07809702-99de-4b57-82bf-ededd776a335 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:12.067822 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2/5] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:45:11 2022] GET /identity/v3/projects/6c8d96b0623744b2b02923664ec6fcd8 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:14.173687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60253-a10f-4280-9861-a3fcf7974915 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:14.174191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60253-a10f-4280-9861-a3fcf7974915 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:14.174272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60253-a10f-4280-9861-a3fcf7974915 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:14.178290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4/6] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:14.183714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:14.184111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:14.184195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:14.206206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:14.207719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:14.215517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:45:14.486493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60253-a10f-4280-9861-a3fcf7974915 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:14.498514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60253-a10f-4280-9861-a3fcf7974915 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:14.503331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:14.503925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:14.504203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:14.504476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:14.511988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:14.513811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e518eb-d700-42de-b6d6-59882b32cea9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:14.522474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Oct 18 15:45:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 15:45:14.527811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:14.536910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8da6-f7f8-42b7-bc5f-773cea2c1271 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:14.541218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:14.541829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:14.542103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:14.542369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] PATH_INFO: `/v3/users/0ecf0b2053e545058e1b1127d92dea3a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:14.543650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] RBAC: Authorizing `identity:get_user(user_id=0ecf0b2053e545058e1b1127d92dea3a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:14.545817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b196-29ba-4729-80e4-e7e5e817bb9d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:14.547983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4/9] 10.222.0.78 () {56 vars in 1198 bytes} [Tue Oct 18 15:45:14 2022] GET /identity/v3/users/0ecf0b2053e545058e1b1127d92dea3a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:16.709419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c244-e9cc-4705-86bc-569fc4f052ec None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:16.710036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c244-e9cc-4705-86bc-569fc4f052ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:16.710036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86c244-e9cc-4705-86bc-569fc4f052ec None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:16.711308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:16.717073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:16.717592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:16.717592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:16.736285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:16.737529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:16.801749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bfd53-5ee7-4ae9-9df8-54c16f5a77af None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:16.802028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bfd53-5ee7-4ae9-9df8-54c16f5a77af None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:16.802309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bfd53-5ee7-4ae9-9df8-54c16f5a77af None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:16.803620 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 7/11] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:16.808665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:16.808948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:16.809252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:16.820514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 5/12] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:16.851820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81776) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 15:45:16.852205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG passlib.handlers.bcrypt [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81776) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 15:45:16.901746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:16.903311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:17.004086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 8/13] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:17.090055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.114865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.193544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59d219-16ca-4393-9838-fe9ff127c795 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.227143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.227763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.228036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.228302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.239804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:17.248582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:17.249710 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.251130 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 6/14] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:17.255679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.275532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.357007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771d453-eb97-4d78-98a4-2bba3f7891a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.357822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.360167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.378678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a4a6-739b-4be2-aeef-aba0f2ddc803 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.396895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.397798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.398079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.398350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.399191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:17.399487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.400911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.412124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.412721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.412909 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 9/15] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:17.413046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.413282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.413960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.415404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.418566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.426774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:45:17.426774 n-d-858383-14 devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:45:17.426774 n-d-858383-14 devstack@keystone.service[81775]: [parameters: {'id': '73ce904224674e20ba5a7e746adeee89', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 15:45:17.426774 n-d-858383-14 devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:45:17.444536 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 15:45:17.445370 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 15:45:17.446329 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 15:45:17.447186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:45:17.448070 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:45:17.448828 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': '73ce904224674e20ba5a7e746adeee89', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 15:45:17.449673 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:17.450402 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 7/16] 10.222.0.78 () {60 vars in 1137 bytes} [Tue Oct 18 15:45:17 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:17.451660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.523004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167ef96-8606-4761-8dc4-8bdceb3dff47 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.551834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb3a6b-15b3-42a9-b981-d1dc9172d72e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.556634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.557509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.557788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.558060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] PATH_INFO: `/v3/users/0ecf0b2053e545058e1b1127d92dea3a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.559575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] RBAC: Authorizing `identity:get_user(user_id=0ecf0b2053e545058e1b1127d92dea3a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.561060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.563290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 10/17] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/users/0ecf0b2053e545058e1b1127d92dea3a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:17.568939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.589164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.589796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.590070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.590332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.601638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.602947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.603104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.610932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:45:17.620323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:17.621213 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:45:17.622016 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:45:17.622016 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:45:17.622016 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:17.623601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 8/18] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:17.630001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.670362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2b87-f1f7-4060-8226-aac490c9edd1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.705932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.706586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.706891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.707159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.708299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.709779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.711323 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 11/19] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:17.716834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:17.736023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cc128-f22f-4fc4-9fa9-1f4eac496e06 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.770031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.770700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.771063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.771505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.772226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:17.772644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.774299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c67f4-79be-49d4-af31-c449ef8b4ce1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.792294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 9/20] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:17.819164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bd09-27dc-45af-a836-5c64708cf4b0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:17.820887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:17.857303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:17.857976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:17.858254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:17.858532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] PATH_INFO: `/v3/domains/default/users/0ecf0b2053e545058e1b1127d92dea3a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:17.861616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0ecf0b2053e545058e1b1127d92dea3a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:17.863081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08af494-2511-4912-9a1a-d2bef314240a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:17.983355 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 12/21] 10.222.0.78 () {58 vars in 1361 bytes} [Tue Oct 18 15:45:17 2022] PUT /identity/v3/domains/default/users/0ecf0b2053e545058e1b1127d92dea3a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:45:20.499418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4893-2ae0-4cb9-be7b-a50f5fc94f99 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.500104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4893-2ae0-4cb9-be7b-a50f5fc94f99 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.500264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f4893-2ae0-4cb9-be7b-a50f5fc94f99 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.501609 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 10/22] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:20.507707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018dad1-3986-4ed6-b1a5-4d5b45dff1dd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.508143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018dad1-3986-4ed6-b1a5-4d5b45dff1dd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.508231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018dad1-3986-4ed6-b1a5-4d5b45dff1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.534366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2018dad1-3986-4ed6-b1a5-4d5b45dff1dd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:20.535969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2018dad1-3986-4ed6-b1a5-4d5b45dff1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:20.625654 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 13/23] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:20.650789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd2a-80ed-41c5-95bf-cea2c546e81a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.651083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd2a-80ed-41c5-95bf-cea2c546e81a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.651323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd2a-80ed-41c5-95bf-cea2c546e81a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.652631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 11/24] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:20.658431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910f196-acab-4d3c-a7b7-a8e1b4470052 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.658719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910f196-acab-4d3c-a7b7-a8e1b4470052 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.658998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910f196-acab-4d3c-a7b7-a8e1b4470052 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.663283 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 14/25] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:20.668858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38f48-6870-42c0-810e-ba4edc94de33 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.669183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38f48-6870-42c0-810e-ba4edc94de33 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.669461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38f48-6870-42c0-810e-ba4edc94de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.671465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc072b-6872-4db1-bcd6-7e5d68eca3b0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.671783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc072b-6872-4db1-bcd6-7e5d68eca3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.672138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc072b-6872-4db1-bcd6-7e5d68eca3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.698239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-abfc072b-6872-4db1-bcd6-7e5d68eca3b0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:20.699463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abfc072b-6872-4db1-bcd6-7e5d68eca3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:20.706145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-56c38f48-6870-42c0-810e-ba4edc94de33 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:20.707351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56c38f48-6870-42c0-810e-ba4edc94de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:20.824934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 15/26] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:20.853100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:20.876221 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 12/27] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:20.901579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc219-355e-43cb-8817-4979487e6625 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.901880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc219-355e-43cb-8817-4979487e6625 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.902128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc219-355e-43cb-8817-4979487e6625 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.903496 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 16/28] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:20.909430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e9ee-08ac-4089-a297-968431781902 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:20.909710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e9ee-08ac-4089-a297-968431781902 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:20.909981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e9ee-08ac-4089-a297-968431781902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:20.942014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7458e9ee-08ac-4089-a297-968431781902 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:20.943200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7458e9ee-08ac-4089-a297-968431781902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:21.034336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 13/29] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:21.061659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc219-355e-43cb-8817-4979487e6625 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.102274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:21.139563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e9ee-08ac-4089-a297-968431781902 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.216885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc219-355e-43cb-8817-4979487e6625 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.273376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.274027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.274358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.274641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.307712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:21.309514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:21.326204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e9ee-08ac-4089-a297-968431781902 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:45:21.344118 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:21.345364 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:45:21.346158 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:45:21.346158 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:45:21.346158 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:21.346158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 17/30] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:21.346158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.364390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:21.393128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.393770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.394046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.394317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.405594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:21.411670 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:21.414011 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 14/31] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:21.415855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.497560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:21.532269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ee38d-b73a-4047-a980-3d775ed86671 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.558071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88dbcc-29e2-4f77-a3d7-084e9b665420 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.568428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.569330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.569786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.570230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.571100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:21.572662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:21.593066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 18/32] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 18 15:45:21 2022] POST /identity/v3/roles => generated 219 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:21.594922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.600333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.601503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.602036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.602557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.603494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:21.604126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:21.606012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:21.621455 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 15/33] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:21.622612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.693396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:21.772792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac8fc2-544f-406c-8144-588756459c55 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.808484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b454d-8839-4a39-8bbc-79fcf2109b7d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:21.813983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.814862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.815338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.815800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.816947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:21.818715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:21.851100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:21.851815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:21.852100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:21.852371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:21.853175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:21.853479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:21.854905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:21.856614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:21.867508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 19/34] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:21.868800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.982738 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 16/35] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 18 15:45:21 2022] POST /identity/v3/roles => generated 225 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:21.983663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:21.997922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f580-1f08-49c4-88b6-2aea6a3ea00d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:22.054477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:22.055466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.056277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.057122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.058057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:22.060672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfab84-02ec-4c07-8e22-8ccd828a59f0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:22.112693 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 20/36] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:45:21 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:22.137065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:22.141874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221bc7-b26e-4fb4-b542-140b74f6a565 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:22.171980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30809-3ff4-4f63-abeb-30e4f3d5e790 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.172914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30809-3ff4-4f63-abeb-30e4f3d5e790 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.173374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb30809-3ff4-4f63-abeb-30e4f3d5e790 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.175449 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 21/37] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:22.182399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.183018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.183493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.220390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:22.221527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.222958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:22.223650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.224168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] PATH_INFO: `/v3/users/0ecf0b2053e545058e1b1127d92dea3a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.225821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:22.227635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] RBAC: Authorizing `identity:get_user(user_id=0ecf0b2053e545058e1b1127d92dea3a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:22.230986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:22.236589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 17/38] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:21 2022] GET /identity/v3/users/0ecf0b2053e545058e1b1127d92dea3a => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:22.242585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:22.332203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:22.372368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 22/39] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:22.500155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb05d93-6ab3-4b54-b643-c442b52ba816 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:22.539393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:22.540037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.540321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.540609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.542299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:22.544537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1dc4-5027-41ec-90b9-8107b77e942e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:22.546168 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 18/40] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:22.552676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:22.594485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461380a1-b9ab-45ee-90c2-57e6edc6ddc0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.594995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461380a1-b9ab-45ee-90c2-57e6edc6ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.595069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461380a1-b9ab-45ee-90c2-57e6edc6ddc0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.596334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 19/41] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:22.601513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.601784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.602334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.624055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:22.626951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:22.658189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:22.669479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def14242-ad81-4654-8909-45d8d7cce534 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:22.705897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:22.708067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:22.713489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:22.714126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.714408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.714684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.715431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.domain.id=default, user.id=0ecf0b2053e545058e1b1127d92dea3a) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:22.715740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:22.717727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:22.728381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 23/43] 10.222.0.78 () {56 vars in 1322 bytes} [Tue Oct 18 15:45:22 2022] GET /identity/v3/role_assignments?user.id=0ecf0b2053e545058e1b1127d92dea3a&scope.domain.id=default&role.id=eb5fc6b45679476182540fe032952925 => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:22.820547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d75b9-fecd-431b-ae96-e8859d8638eb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:22.857248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:22.857874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:22.858151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:22.858419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:22.859453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:22.860953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:22.877624 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 21/44] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 18 15:45:22 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:22.995124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:23.049117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:23.110090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdccd51-3bce-4d52-9641-f1852cf76c06 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:23.143886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:23.144526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:23.144803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:23.145109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:23.146221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:23.147651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ea42-0010-455e-ad63-3dff44623a2c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:23.149247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 24/45] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:23.154875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:23.179672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:23.254193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9dae1-1302-4564-94a2-24fac495bd47 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:23.285838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:23.287389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:23.287749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:23.288022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:23.288677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:23.290145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe10899-2e79-4e6a-b966-4e74c93a8be2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:23.318796 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 22/46] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:45:23 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:25.498832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888068d6-ed9e-4481-bda3-afb95fa54670 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:25.499418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888068d6-ed9e-4481-bda3-afb95fa54670 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:25.499586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888068d6-ed9e-4481-bda3-afb95fa54670 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:25.501045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 25/47] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:25.506346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:25.506743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:25.506901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:25.525482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:25.526662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:25.592219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 23/48] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:25.873087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888068d6-ed9e-4481-bda3-afb95fa54670 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:25.975199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888068d6-ed9e-4481-bda3-afb95fa54670 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:25.986120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:26.009877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:26.010502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:26.010780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:26.011051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:26.012152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:26.013628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b0ca-0b60-4b53-b9bd-0b15e3077c34 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:26.016300 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 26/49] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:26.021890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:26.029903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:26.119944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8309-6088-4fa1-87ff-8cdab8a8801e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:26.153136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:26.153678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:26.153955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:26.154225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:26.154863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:26.158108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62bf7b-4a1b-462c-9ffd-fd33da29b42b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:26.183712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 24/50] 10.222.0.78 () {60 vars in 1140 bytes} [Tue Oct 18 15:45:26 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:28.304636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f7511-4a70-4560-9560-dd2794bcb5b7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:28.305157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f7511-4a70-4560-9560-dd2794bcb5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:28.305157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f7511-4a70-4560-9560-dd2794bcb5b7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:28.306485 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 27/51] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:28.312402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:28.312835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:28.313155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:28.332744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:28.333977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:28.385883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:28.400246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 25/52] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:28.674790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f7511-4a70-4560-9560-dd2794bcb5b7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:28.774907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f7511-4a70-4560-9560-dd2794bcb5b7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:28.807903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:28.808526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:28.808808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:28.809110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:28.810221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:28.812277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f632b9e-d51b-476a-b95a-693732f6e23b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:28.813860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 28/53] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:28.819359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:28.913616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb48ad4-7146-406e-9498-b3d9fbdd96c0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:28.950314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:28.950921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:28.951197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:28.951466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:28.952170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:28.953705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d636af1-81f1-4538-b4c4-0ac41b3cc544 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:28.979801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 26/54] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:28 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:45:32.222606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89868-620c-4f1b-adde-3642594fc754 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.223439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89868-620c-4f1b-adde-3642594fc754 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.223868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89868-620c-4f1b-adde-3642594fc754 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.225407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 29/55] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:32.230862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168fc8-f065-49bd-b34c-bb7efb86a8cc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.231600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168fc8-f065-49bd-b34c-bb7efb86a8cc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.232036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168fc8-f065-49bd-b34c-bb7efb86a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.256392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d168fc8-f065-49bd-b34c-bb7efb86a8cc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:32.257881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d168fc8-f065-49bd-b34c-bb7efb86a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:32.308882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:32.351792 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 27/56] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:32.511118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c72c-e10b-42dc-be7f-5e48ddf3dbc3 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.511611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c72c-e10b-42dc-be7f-5e48ddf3dbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.512032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090c72c-e10b-42dc-be7f-5e48ddf3dbc3 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.513567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 30/57] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:32.519555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da93f-96b3-49c3-8f5a-05e3a932eb0a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.520137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da93f-96b3-49c3-8f5a-05e3a932eb0a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.520639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952da93f-96b3-49c3-8f5a-05e3a932eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.550250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-952da93f-96b3-49c3-8f5a-05e3a932eb0a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:32.551867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-952da93f-96b3-49c3-8f5a-05e3a932eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:32.650898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 28/58] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:32.675255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55bb1-fa95-4aa8-a057-a2800e8b7b66 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.675902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55bb1-fa95-4aa8-a057-a2800e8b7b66 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.676376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b55bb1-fa95-4aa8-a057-a2800e8b7b66 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.678377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 31/59] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:32.684395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd546d-d0bc-4dc8-a033-ef6ef5ec360d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.685053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd546d-d0bc-4dc8-a033-ef6ef5ec360d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.685993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd546d-d0bc-4dc8-a033-ef6ef5ec360d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.686955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55bb1-fa95-4aa8-a057-a2800e8b7b66 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:32.716750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4edd546d-d0bc-4dc8-a033-ef6ef5ec360d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:32.720022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4edd546d-d0bc-4dc8-a033-ef6ef5ec360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:32.789985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:32.820261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 29/60] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:32.821958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbf32-3dbc-4eb9-819a-bfb099f1122e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.822430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbf32-3dbc-4eb9-819a-bfb099f1122e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.822909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcbf32-3dbc-4eb9-819a-bfb099f1122e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.825306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 30/61] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:32.831484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1569e-b539-421c-aa1b-cde918a7da4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.832086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1569e-b539-421c-aa1b-cde918a7da4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.832559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1569e-b539-421c-aa1b-cde918a7da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.852610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ee1569e-b539-421c-aa1b-cde918a7da4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:32.854160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ee1569e-b539-421c-aa1b-cde918a7da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:32.868756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b55bb1-fa95-4aa8-a057-a2800e8b7b66 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:32.892732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:32.907212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:32.907850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.908309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.908771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.963767 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 31/62] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:32.969957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d504b-b1b1-4e30-b23b-e2748a82a1a9 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.970700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d504b-b1b1-4e30-b23b-e2748a82a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.971193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d504b-b1b1-4e30-b23b-e2748a82a1a9 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:32.973223 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 32/63] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:32.980453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:32.981100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:32.981559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.016783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:33.018025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:33.029007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:33.035388 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:33.036224 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:33.036973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 32/64] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:33.037659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.107150 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 33/65] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:33.109507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.159855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fdf67-1376-427f-9055-2e329e3b12b9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.178816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.228062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.229104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.229391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.229663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.239036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.245403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:33.246732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8da9b7-0004-4ed2-942b-46d5cb13a171 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:33.251837 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:33.252936 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 33/66] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:33.253899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.286531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.287144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.287421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.287692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.288352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:33.288700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.290157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.303303 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 34/67] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.305028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.369730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5fd5d-7199-4c88-b623-75ac45d89158 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.406751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fd557-12ad-44c2-8e85-21ae02a291d9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.408006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.408706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.408979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.409284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.419943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:33.425579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:33.426582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:33.427350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 34/68] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:33.429921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.445937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.446544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.446823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.447094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.447755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:33.448055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.449487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.457100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.457333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.458613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.477873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.532914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d7c8c-f0e0-47f1-af78-3175e486babb None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.558064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72cdc1-5f83-4689-b6c6-e06a19d1e74d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.567906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.568556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.568836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.569152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.579252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:33.584106 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:33.585154 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:33.585905 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 35/70] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:33.586534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.595154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.595794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.596077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.596347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.610665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.612232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.613886 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 36/71] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.614646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.675623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.688526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.692546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f811a-aa97-4efc-905e-5cf4de5bb93d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.711632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757ef22-54bb-4cd3-9415-93d913a512ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.725989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.726612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.726889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.727179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.728280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.729748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.731298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 36/72] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.735052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.749412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.750020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.750300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.750573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.751237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:33.751545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.752922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.760866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 37/73] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.761673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.836676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0673f2-088e-4da7-b943-3b3840f49e17 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.859773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa052b-6bbf-400f-9b7d-0f2c8db498a6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:33.871225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.871880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.872157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.872456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] PATH_INFO: `/v3/users/0ecf0b2053e545058e1b1127d92dea3a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.873677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] RBAC: Authorizing `identity:get_user(user_id=0ecf0b2053e545058e1b1127d92dea3a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.875212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.877066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 37/74] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/users/0ecf0b2053e545058e1b1127d92dea3a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.877666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.896223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:33.896829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:33.897140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:33.897415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:33.898079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:33.898383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:33.899765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:33.901829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.904792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:33.910297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 38/75] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:33.911145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:33.979361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dff73-6655-45d6-b948-0e109b1c4a4b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.010942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dacdf-a994-47e5-8d08-1a6ed39420c4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.013409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.014051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.014895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.015354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.016643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.018120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.019755 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 38/76] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:33 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.020512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.045216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.045941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.046232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.046510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.047172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.048624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.069292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 39/77] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:33 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:34.069292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.130189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.142453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a255d-a10c-400e-87e5-1db1281d3093 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.145573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.185064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.185632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.186023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.187013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.188484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.190101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.196348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 39/78] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:34 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.196348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.196614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef8b49-b58b-4a7f-91f3-4f31905bfadd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.232889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.233912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.234192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.234457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.235599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.237189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.243442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 40/79] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:34 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.243442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.316066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20483357-1e8b-4848-a5e5-a83e46ba4db9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.360651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.361368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.361626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.361901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.363220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.365405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.366499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146465f1-e4aa-4148-9974-9be6b7a6392e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.367217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 40/80] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:34 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.368712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.396262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.410306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.413624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.414330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.414611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.414889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.417823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, user_id=dfa06ab28b1e449295f0f02e4ba9c768, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.419290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.438691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 41/81] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:34 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:34.439658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.552828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921adc12-cd89-4358-a338-29f4ec971816 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.597667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.598751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.599235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.599698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.601072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.603043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.605405 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 41/82] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:34 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.606656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.652692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2aec0c-0897-47af-9cfa-ecf5c607b941 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.697826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.698425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.698707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.698984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/0ecf0b2053e545058e1b1127d92dea3a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.700949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, user_id=0ecf0b2053e545058e1b1127d92dea3a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.702993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.716669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.720410 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 42/83] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:34 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/0ecf0b2053e545058e1b1127d92dea3a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:34.721339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.724606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e2393-d59e-4bee-a716-bf8ad115932d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.764964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.765666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.765944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.766277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] PATH_INFO: `/v3/projects/ca0c4a5d548347af8d169bf356bbce36` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.767541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0c4a5d548347af8d169bf356bbce36)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.769015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.771020 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 42/84] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:34 2022] GET /identity/v3/projects/ca0c4a5d548347af8d169bf356bbce36 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:34.787028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:34.791549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:34.887024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301688-9838-41c4-a9a3-6f9c194b3c2a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.919865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ae30-5d1c-4b76-afe4-1503285f7956 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:34.962162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.963076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.963504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.963924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] PATH_INFO: `/v3/projects/ca0c4a5d548347af8d169bf356bbce36/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.966117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0c4a5d548347af8d169bf356bbce36, user_id=dfa06ab28b1e449295f0f02e4ba9c768, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.968369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea04268-7715-4f1b-87e3-94162241f57e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:34.985152 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 43/85] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:34 2022] PUT /identity/v3/projects/ca0c4a5d548347af8d169bf356bbce36/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:45:34.989120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:34.990101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:34.990683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:34.991137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:34.993938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, user_id=dfa06ab28b1e449295f0f02e4ba9c768, role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:34.995843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8df97-8ec0-46b1-ad37-942d4ec9f720 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:35.016473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 43/86] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:34 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/dfa06ab28b1e449295f0f02e4ba9c768/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:37.213996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d5de-6bfa-43f0-a697-04213d2021e7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.214473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d5de-6bfa-43f0-a697-04213d2021e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.214473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d5de-6bfa-43f0-a697-04213d2021e7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.215978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 44/87] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:37.221700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e76b-6e35-4f8e-8ea7-ae893dff4d55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.222091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e76b-6e35-4f8e-8ea7-ae893dff4d55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.222266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e76b-6e35-4f8e-8ea7-ae893dff4d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.246441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-84e8e76b-6e35-4f8e-8ea7-ae893dff4d55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:37.247650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84e8e76b-6e35-4f8e-8ea7-ae893dff4d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:37.339741 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 44/88] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:37.560349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949c25-0590-4c93-a7e6-e83caec1b64e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.560677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949c25-0590-4c93-a7e6-e83caec1b64e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.560863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42949c25-0590-4c93-a7e6-e83caec1b64e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.562302 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 45/89] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:37.579280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e32cfc-e411-4110-8440-a7e43abb73fc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.579590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e32cfc-e411-4110-8440-a7e43abb73fc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.579901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e32cfc-e411-4110-8440-a7e43abb73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.606454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b5e32cfc-e411-4110-8440-a7e43abb73fc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:37.607727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5e32cfc-e411-4110-8440-a7e43abb73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:37.642275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:37.685598 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 45/90] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:37.712846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967443-d0d4-4b05-81c8-c72a20bf9b57 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.713159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967443-d0d4-4b05-81c8-c72a20bf9b57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.713425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967443-d0d4-4b05-81c8-c72a20bf9b57 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.715086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 46/91] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:37.722520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6232d-0d64-496f-8b9d-5ac393570536 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:37.722807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6232d-0d64-496f-8b9d-5ac393570536 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:37.723089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6232d-0d64-496f-8b9d-5ac393570536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:37.745962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6ce6232d-0d64-496f-8b9d-5ac393570536 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:37.747180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ce6232d-0d64-496f-8b9d-5ac393570536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:37.832227 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 46/92] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:37.846904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967443-d0d4-4b05-81c8-c72a20bf9b57 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:37.881997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.002667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967443-d0d4-4b05-81c8-c72a20bf9b57 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.056387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.057440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.057913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.058376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.073982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e23df-ca03-48b2-be87-4416945d1546 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.074302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e23df-ca03-48b2-be87-4416945d1546 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.074593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e23df-ca03-48b2-be87-4416945d1546 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.076552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 47/93] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:38.080585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:38.082325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.082559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.082843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:38.086582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:38.087414 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:38.088152 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:38.090664 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 47/94] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:38.100254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.135910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:38.137255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:38.248690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.277845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45327b-76f2-457b-8ee1-f7a91ab44d07 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.319385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.320326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.320812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.321305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.322179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:38.322667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:38.324208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:38.338811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 48/95] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:38.339945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.413024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 48/96] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:38.413024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.438344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.473652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e058d-489d-4134-9291-c94ca4c24438 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.523605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.524246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.524526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.524801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.536156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab438-b207-44e9-839a-3eda6181d04e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.536297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:38.542773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:38.543613 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:38.544367 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 49/97] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:38.545011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.556275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.584224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.585048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.585339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.585615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.586943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:38.588558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a03f9f-9195-45e9-a336-299e8b69c86e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:38.590418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 49/98] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:38.597476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b94-f1e0-4f98-a90f-dce10288c8b6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.597877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b94-f1e0-4f98-a90f-dce10288c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.598177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b94-f1e0-4f98-a90f-dce10288c8b6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.599752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 50/99] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:38.600497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928b94-f1e0-4f98-a90f-dce10288c8b6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.668433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766731b-e755-4979-9f39-6b3931ac019d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.704116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.704756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.705062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.705340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] PATH_INFO: `/v3/users/d9a169a056b1486aa750c401d80a7aef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.712239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.722204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] RBAC: Authorizing `identity:get_user(user_id=d9a169a056b1486aa750c401d80a7aef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:38.723245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928b94-f1e0-4f98-a90f-dce10288c8b6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.723656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:38.729055 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 50/100] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/users/d9a169a056b1486aa750c401d80a7aef => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:38.729055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.762850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.763457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.763733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.764076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.765415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:38.765722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:38.767131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153edfc-30de-4c48-bef2-651ada1c096d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:38.775236 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 51/101] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:38.778328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e1a1-b074-488c-8b46-a07b2651b673 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.778622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e1a1-b074-488c-8b46-a07b2651b673 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.778897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e1a1-b074-488c-8b46-a07b2651b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.790573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:38.796621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2677e1a1-b074-488c-8b46-a07b2651b673 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:38.797866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2677e1a1-b074-488c-8b46-a07b2651b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:38.830261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f816e3-2e28-4d5a-b9fd-9cf716c0dcd5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:38.864323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:38.864866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.865180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.865457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.865924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 52/102] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:38.866106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:38.867250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f670-6abd-4693-b17e-fdd97c2877e3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:38.867553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f670-6abd-4693-b17e-fdd97c2877e3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:38.867648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:38.867866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f670-6abd-4693-b17e-fdd97c2877e3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:38.873052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 53/103] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:38.873052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f670-6abd-4693-b17e-fdd97c2877e3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.917516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 51/104] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:45:38 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:38.918697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:38.990381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.010736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f670-6abd-4693-b17e-fdd97c2877e3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.050992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.051637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.051925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.052202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.065397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:39.070899 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:39.071821 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 54/105] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:39.073234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.083338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b017eb-0357-456d-a1d9-91228edf7e5d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.100338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.127106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.127676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.127954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.128444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.129395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.130899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a25857-eb6d-4eee-a338-7492481b406e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.132617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 52/106] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:38 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:39.139524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.139524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.139524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.160250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:39.161497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:39.199787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b5cc9-b72d-4e48-98d0-fbdb86c4f79d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.235126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 53/107] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:39.235980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.247084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.248509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.249330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.249767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.251329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.253811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.256547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 55/108] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:39.257613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.278289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.356984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e0557-1445-49c9-ab0f-85a892aebef1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.376269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.387568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d18d6-a3b4-4ecb-96f7-1289df6d3143 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.406747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.407624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.408047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.408460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.409579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:39.409899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.411323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.425899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 54/109] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:39.426713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.435052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.437421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.437907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.438377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/d9a169a056b1486aa750c401d80a7aef/roles/b016a05c6405473eaf47532175d51a1c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.442995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, user_id=d9a169a056b1486aa750c401d80a7aef, role_id=b016a05c6405473eaf47532175d51a1c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.444763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.460461 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 56/110] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:39 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/users/d9a169a056b1486aa750c401d80a7aef/roles/b016a05c6405473eaf47532175d51a1c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:39.461850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.537097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12fc45-c6a6-4283-9dd7-d9ceb5fd0e81 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.550029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.592247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504505e6-57b5-4274-ae56-76825bcabc14 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.596760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.597568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.597917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.598263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.614889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:39.622309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:39.623759 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:39.624879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 55/111] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:39.625729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.643139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.643733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.644274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.644556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.667465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.742965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.745270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.756075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd350fce-ba1b-4244-9f94-9ec717efe12b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.797310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.797956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.798292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.798571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.799771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:39.801264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:39.803246 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 56/112] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:39.804089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.826096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.870238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 57/113] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:39.871875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:39.924741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072e64-91b4-40bc-9b6e-356c3b01d728 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.927524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:39.979350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:39.980539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:39.980825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:39.981150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:39.994134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9a67c-4416-4a91-a7f9-f98d041cacca None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:39.996136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:40.002299 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:40.003172 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:40.003924 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 57/114] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:40.004552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.040899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.041881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.042350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.042983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.043863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:40.044356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.046805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.055462 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 58/115] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:45:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.056519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.096940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.142884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a605b38-89cd-474b-91bf-a5f9036ffd10 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.185624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.186684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.186974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.187218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.192820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747f9c-f982-41c8-a987-31fefb8f024f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.224896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.230947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.232435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.232435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.232435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.233868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.235351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.237142 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 59/116] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.237960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.273804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.275771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.350094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a91d4b-dca7-4873-ab7c-93d670699041 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.351657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.389403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.389871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.390155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.390430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.391221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:40.391451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.392838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.394325 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 58/117] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:40.395694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.401754 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 60/118] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.402568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.468700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.512004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef90f-e836-4a39-929b-74d270cabbad None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.517088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6a4d-a0d0-4a47-9b52-dfd95f24b359 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.554807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.555897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.556537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.557274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.557594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.558284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.558571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.558847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] PATH_INFO: `/v3/users/dfa06ab28b1e449295f0f02e4ba9c768` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.559027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] RBAC: Adding query filter params (role.id=45f2445471ee4a6986112b01f7d3fa96, scope.project.id=7803ed96fee94c18a066627d51f5dfe3, user.id=dfa06ab28b1e449295f0f02e4ba9c768) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:40.559616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.559992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa06ab28b1e449295f0f02e4ba9c768)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.561525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.562025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.567544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 59/119] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/users/dfa06ab28b1e449295f0f02e4ba9c768 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.567544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.573502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 61/120] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/role_assignments?user.id=dfa06ab28b1e449295f0f02e4ba9c768&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.574310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.649025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.785971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078869-a60d-4dd7-8311-da9dd98d0670 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.797115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d862b-198e-499a-9026-435b38a581e5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.821444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.826560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.827722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.828154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.828749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] PATH_INFO: `/v3/projects/ca0c4a5d548347af8d169bf356bbce36` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.832360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] RBAC: Authorizing `identity:get_project(project_id=ca0c4a5d548347af8d169bf356bbce36)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.834169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.836365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 60/121] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/projects/ca0c4a5d548347af8d169bf356bbce36 => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.837582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.837762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:40.838386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:40.838672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:40.839799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] PATH_INFO: `/v3/users/0ecf0b2053e545058e1b1127d92dea3a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:40.844193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] RBAC: Authorizing `identity:get_user(user_id=0ecf0b2053e545058e1b1127d92dea3a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:40.846663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:40.848340 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 62/122] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/users/0ecf0b2053e545058e1b1127d92dea3a => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:40.849213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:40.975986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91963a6d-5349-47a6-9e04-f28f79e3ddac None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:40.978569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:40.985862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cacae-dc2d-4f8d-b375-225f5bf4acb2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.020934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.021973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.022428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.022737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.023122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.023567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.023917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.024260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.027152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] RBAC: Adding query filter params (role.id=45f2445471ee4a6986112b01f7d3fa96, scope.project.id=ca0c4a5d548347af8d169bf356bbce36, user.id=dfa06ab28b1e449295f0f02e4ba9c768) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:41.027553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.030344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.036551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 63/123] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/role_assignments?user.id=dfa06ab28b1e449295f0f02e4ba9c768&scope.project.id=ca0c4a5d548347af8d169bf356bbce36&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:41.037238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.124787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.129210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.130926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.163562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dacaae-6891-4b72-8725-351a0d3a3707 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.235699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.236333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.236613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.236881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.303163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.329404 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 61/124] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:41.335408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.354665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.356167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da44114-3447-4f27-ba68-5fe892b4f96a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.459137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.462978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cdd5f-7885-4170-bfbb-04de7ab6bd05 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.478926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 64/125] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:41.480386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfedf-6e01-43cd-8dae-2af30c9086e1 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.480746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfedf-6e01-43cd-8dae-2af30c9086e1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.481128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dfedf-6e01-43cd-8dae-2af30c9086e1 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.483106 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 65/126] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:41.488141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dfedf-6e01-43cd-8dae-2af30c9086e1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.507024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.507666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.507941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.508212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.509379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.510810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498f6b-181f-4704-b1c4-3821a3a07b28 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.512435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 62/127] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:41.515501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.515853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.516197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.538172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:41.539900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:41.554104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.609275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dfedf-6e01-43cd-8dae-2af30c9086e1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.611116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 63/128] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:41.611828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.676734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.677813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.678094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.678369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.679572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.681827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.684237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 66/129] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:41.691637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.724499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.731371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab3cfc-eeb2-4a3e-91db-b41fd7770e82 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.770205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.770905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.771241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.771572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.772368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] RBAC: Adding query filter params (role.id=e836d7d42e2b405ea81e90a304bcb4ff, scope.project.id=7803ed96fee94c18a066627d51f5dfe3, user.id=dfa06ab28b1e449295f0f02e4ba9c768) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:41.772738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.774276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b3cb-00df-42b8-a83f-6d095c81c335 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.785399 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 64/130] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/role_assignments?user.id=dfa06ab28b1e449295f0f02e4ba9c768&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=e836d7d42e2b405ea81e90a304bcb4ff => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:41.810013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af1c4a-1c9f-42f1-b74e-5aa3c9e811cb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:41.838344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d7a6-8624-4167-81bd-34f57f7706ce None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.838777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d7a6-8624-4167-81bd-34f57f7706ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.839153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482d7a6-8624-4167-81bd-34f57f7706ce None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.840846 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 65/131] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:41.846323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:41.847473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.847858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.848229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.853673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:41.854355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:41.854716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:41.855221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:41.856234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=7803ed96fee94c18a066627d51f5dfe3, user.id=0ecf0b2053e545058e1b1127d92dea3a) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:41.856547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:41.858255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:41.865604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 67/132] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/role_assignments?user.id=0ecf0b2053e545058e1b1127d92dea3a&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:41.872183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:41.874070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:41.905614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:41.977909 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 66/133] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:42.034318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c9f45-4a06-4615-aed5-2bc55884c136 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.073384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.073943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.074219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.074489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.075594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:42.077600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:42.079189 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 68/134] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:42.084639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:42.182973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:42.193566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6226c1-eec7-4f96-a5e2-bcb738efdfa0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.227508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.228107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.228388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.228651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.229342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:42.230746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:42.258821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 67/135] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:42 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:42.260451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:42.325701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:42.371263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba532-6385-414e-b4f0-75777a687dbe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.406300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.406946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.407223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.407493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.418260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:42.424205 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:42.425122 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:42.425870 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 69/136] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:42.431381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:42.534406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde17f16-9af0-4230-9c5b-cb83681a5063 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.571234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.571855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.572134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.572405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.573113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:42.573420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:42.574793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:42.583333 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 68/137] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:42.589203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:42.705950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bdb60-e459-410a-a66a-a3d9f1fa9857 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.728960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:42.747928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.749233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.749517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.749796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] PATH_INFO: `/v3/users/d9a169a056b1486aa750c401d80a7aef` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.750942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] RBAC: Authorizing `identity:get_user(user_id=d9a169a056b1486aa750c401d80a7aef)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:42.752397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:42.753994 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 70/138] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:42 2022] GET /identity/v3/users/d9a169a056b1486aa750c401d80a7aef => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:42.759539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:42.772028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:42.873350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fff80-5502-497a-b741-e7302b383343 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:42.908825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:42.909519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:42.909796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:42.910065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:42.980258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:42.981785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:42.992208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:43.084132 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 69/139] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:43.094076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:43.204519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee49529-bf24-4cdd-bfd9-ca30fa8bc089 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:43.239672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:43.240307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:43.240584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:43.240853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:43.241997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:43.243455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b07ad5-d6b3-462b-9322-56a2b7fb47d4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:43.245116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 71/140] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:43 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:43.252131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:43.356485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8dc9c-1da1-4376-ac0f-d67a9d1f0fc7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:43.370937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:43.398377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:43.399053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:43.399336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:43.399606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:43.400359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] RBAC: Adding query filter params (role.id=b016a05c6405473eaf47532175d51a1c, scope.project.id=7803ed96fee94c18a066627d51f5dfe3, user.id=d9a169a056b1486aa750c401d80a7aef) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:43.400664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:43.402192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604428d-bb6f-4035-a1cd-31d23fd0d133 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:43.409727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 70/141] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:43 2022] GET /identity/v3/role_assignments?user.id=d9a169a056b1486aa750c401d80a7aef&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=b016a05c6405473eaf47532175d51a1c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:44.582679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca8a0-b173-4a14-a48a-f167ae6f8d36 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.583195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca8a0-b173-4a14-a48a-f167ae6f8d36 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.583195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fca8a0-b173-4a14-a48a-f167ae6f8d36 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.584615 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 72/142] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:44.590373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314385ac-fe61-498a-b00e-4773ae45fc88 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.590839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314385ac-fe61-498a-b00e-4773ae45fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.591024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314385ac-fe61-498a-b00e-4773ae45fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.610454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-314385ac-fe61-498a-b00e-4773ae45fc88 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:44.611667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-314385ac-fe61-498a-b00e-4773ae45fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:44.669728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb89a-6ba5-456e-b2a8-faa4c5e61d29 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.670069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb89a-6ba5-456e-b2a8-faa4c5e61d29 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.670513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19beb89a-6ba5-456e-b2a8-faa4c5e61d29 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.671828 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 73/143] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:44.676919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17592-47b2-41b0-9a5e-d9ad5430b249 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.677223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17592-47b2-41b0-9a5e-d9ad5430b249 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.677494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17592-47b2-41b0-9a5e-d9ad5430b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.680241 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 71/144] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:44.696540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-81b17592-47b2-41b0-9a5e-d9ad5430b249 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:44.697746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-81b17592-47b2-41b0-9a5e-d9ad5430b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:44.751404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:44.772003 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 74/145] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:44.859345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e684d-d35b-48ce-a828-876139f572f7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.859646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e684d-d35b-48ce-a828-876139f572f7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.859904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e684d-d35b-48ce-a828-876139f572f7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.861431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 72/146] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:44.866410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:44.866700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:44.866974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:44.885665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:44.886849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:44.948758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e684d-d35b-48ce-a828-876139f572f7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:44.965176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 75/147] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:45.041305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.055331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e684d-d35b-48ce-a828-876139f572f7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.056848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.094192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.094879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.095161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.095430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.105635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:45.111838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:45.112679 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:45.113626 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 73/148] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:45.118522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.148615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c2a85-bf36-457a-a5fe-c34ff7f65bdf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.165628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.186053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.186760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.187035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.187305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.198016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:45.203120 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:45.203976 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:45.204770 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 76/149] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:45.209892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.235139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817b1bb-9bde-4b8b-9f27-b1314654fb18 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.269104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.269706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.269980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.270244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.270935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:45.271235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.272599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.280854 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 74/150] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.281668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.309159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6605b6-a875-4d6d-90c3-9ea7da73faac None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.310387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.343349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.343989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.344266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.344531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.345225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:45.345508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.346917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.354514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 77/151] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:45.355278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.387039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38299f63-683c-4a55-b3e1-f5a8b525391f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.394115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.420268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.420962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.421266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.421536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.422643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.424093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.425858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 75/152] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.426455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.454864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531fc38-338e-4949-9621-a09bbdccd7bf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.489948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.490570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.490878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.491153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] PATH_INFO: `/v3/users/7c97cd053b324b388dcd166471f70280` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.504602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] RBAC: Authorizing `identity:get_user(user_id=7c97cd053b324b388dcd166471f70280)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.506179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.507792 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 78/153] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/users/7c97cd053b324b388dcd166471f70280 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.509582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.518954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.527827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4559a-51c3-40ba-a2cc-418d43bf6bbe None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.559833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.561079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.561361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.561632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] PATH_INFO: `/v3/users/7c97cd053b324b388dcd166471f70280` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.562742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] RBAC: Authorizing `identity:get_user(user_id=7c97cd053b324b388dcd166471f70280)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.564171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.565745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 76/154] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/users/7c97cd053b324b388dcd166471f70280 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.570254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.609867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.617762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbd81-b3f6-40d8-a593-48c154c012af None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.651908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.652451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.652745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.653027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.653718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.655931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.674218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfb097-d3e9-4d50-8932-8964d29c4f2a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.689060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 79/155] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:45 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:45.689060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.714670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.715421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.715803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.716137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.717662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.719200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.721294 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 77/156] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.727133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.765394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.790695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8002d-2347-427a-9eae-fe85162f083e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.831643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.832383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.832661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.832927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.834126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.835610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.837502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 80/157] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:45 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:45.843238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:45.852336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a61a6-2baf-4bd0-a9e8-23fc2b1def14 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:45.868818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:45.895198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:45.896219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:45.896219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:45.896407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/7c97cd053b324b388dcd166471f70280/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:45.898338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, user_id=7c97cd053b324b388dcd166471f70280, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:45.899800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6f1c5-0060-4943-ad02-e4275a35519b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:45.913424 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 78/158] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:45 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/7c97cd053b324b388dcd166471f70280/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:45:45.968297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a949e-84f2-4cb4-aaed-b13baa28cabd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:46.008936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:46.010043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:46.010316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:46.010586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/7c97cd053b324b388dcd166471f70280/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:46.012868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, user_id=7c97cd053b324b388dcd166471f70280, role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:46.015439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576b64-dc23-445e-b91b-800e9dcd766a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:46.032660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 81/159] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:45 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/7c97cd053b324b388dcd166471f70280/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:48.037632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed5e1-6677-42a9-8e3c-36c8b258fb3c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.038158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed5e1-6677-42a9-8e3c-36c8b258fb3c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.038158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed5e1-6677-42a9-8e3c-36c8b258fb3c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.039510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 79/160] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:48.045397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293f6d2-9693-4af6-8843-954f28f7ade9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.045865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293f6d2-9693-4af6-8843-954f28f7ade9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.046113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293f6d2-9693-4af6-8843-954f28f7ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.051570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f83ee-1a71-4b14-944e-d3fe68f80b3d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.052099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f83ee-1a71-4b14-944e-d3fe68f80b3d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.052821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f83ee-1a71-4b14-944e-d3fe68f80b3d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.055326 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 80/161] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:48.061448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53cf-cd7d-4134-80f5-e589ff9bee64 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.062358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53cf-cd7d-4134-80f5-e589ff9bee64 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.062837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c53cf-cd7d-4134-80f5-e589ff9bee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.066094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c293f6d2-9693-4af6-8843-954f28f7ade9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:48.067293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c293f6d2-9693-4af6-8843-954f28f7ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:48.082303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fb2c53cf-cd7d-4134-80f5-e589ff9bee64 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:48.084476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb2c53cf-cd7d-4134-80f5-e589ff9bee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:48.141749 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 82/162] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:48.143055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3290e-2e6a-416a-903c-34c915e2c23d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.143338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3290e-2e6a-416a-903c-34c915e2c23d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.143610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3290e-2e6a-416a-903c-34c915e2c23d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.145031 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 83/163] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:48.153302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.153302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.153302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.170541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:48.171747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:48.177989 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 81/164] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:48.178303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.241935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932b92-6904-4a32-9383-622a088281ed None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.242124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932b92-6904-4a32-9383-622a088281ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.242462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15932b92-6904-4a32-9383-622a088281ed None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.243806 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 82/165] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:48.248190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 84/166] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:48.249049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.249385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.249659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.268262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:48.269455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:48.284707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.340026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 83/167] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:48.422719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.469722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.530705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302277f8-8d1d-4b52-989c-db002a756107 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.567948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.568571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.568849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.569147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.573063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912a7a5-723d-4e7f-b6bb-d4cf88a3e7eb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.578638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.583765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:48.588963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:48.589979 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:48.590804 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 85/168] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:48.591557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.615184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.615830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.616139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.616403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.617593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:48.619037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:48.620648 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 84/169] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:48.621465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.640583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.699326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d820320-1bc5-4dcc-9cfc-98c3c325881d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.721235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef834e-304e-4fcf-818c-fa32f995002d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.734774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8100b1-beae-4525-991d-915113016948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.735402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8100b1-beae-4525-991d-915113016948 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.735684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8100b1-beae-4525-991d-915113016948 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.735952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8100b1-beae-4525-991d-915113016948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.746233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8100b1-beae-4525-991d-915113016948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3f8100b1-beae-4525-991d-915113016948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:48.751633 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:48.752706 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 86/170] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:48.757992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8100b1-beae-4525-991d-915113016948 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.760798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.761439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.761719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.761991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.762658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:48.762959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:48.764519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:48.777087 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 85/171] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:48.777087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.813709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.853528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:48.853698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8100b1-beae-4525-991d-915113016948 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.875345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315b202-0c30-4d2d-a5bc-4080e8a73fda None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:48.888213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.889408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.889686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.889955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.899745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:48.904829 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:48.905757 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:48.906551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 87/172] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:48.907213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:48.912724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:48.913393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:48.913671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:48.913993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:48.914681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:48.916546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:48.942085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 86/173] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:48 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:48.942913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.017788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b894f-2c3d-4a08-b8c6-3fab230e393b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.039502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.055928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.056637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.056826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.057148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.057884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:49.058188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.059638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.061302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729d5bc-0a79-469a-afcd-e2fddba44545 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.069062 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 88/174] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.069854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.104466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.105919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.106444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.106889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] PATH_INFO: `/v3/users/63b1b122e56041129112d135e7b1dd40` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.109998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.127317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] RBAC: Authorizing `identity:get_user(user_id=63b1b122e56041129112d135e7b1dd40)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.128774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.130793 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 87/175] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:48 2022] GET /identity/v3/users/63b1b122e56041129112d135e7b1dd40 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.131230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.192343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0470b94-5b1a-4e14-9520-1585c0dd5f17 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.235970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.236598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.236865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.237462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.238144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:49.238445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.239824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.249843 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 89/176] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.250731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.260546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684e94-7d17-474a-b9f9-8a698f82e47e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.306875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.313462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.314103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.314381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.314993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] PATH_INFO: `/v3/users/7c97cd053b324b388dcd166471f70280` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.316473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] RBAC: Authorizing `identity:get_user(user_id=7c97cd053b324b388dcd166471f70280)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.320883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.322624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 88/177] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/users/7c97cd053b324b388dcd166471f70280 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.323223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.387590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.389760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922fd4-5cba-4ca3-a139-d880e56a0528 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.429291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.429894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.430172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.430497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.431809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.433361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.435351 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 90/178] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.436461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.443483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb6e4c-aaaa-47bf-8ffa-24208b341612 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.490670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.491627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.492072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.492525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] PATH_INFO: `/v3/users/7c97cd053b324b388dcd166471f70280` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.494344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] RBAC: Authorizing `identity:get_user(user_id=7c97cd053b324b388dcd166471f70280)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.496246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.498408 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 89/179] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/users/7c97cd053b324b388dcd166471f70280 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:49.500048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.546677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830869b-98b4-4100-8e43-ec8ea52b5f0a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.561806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.590186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.590793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.591147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.591648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.634368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d902-0b9f-409a-80d5-30cee2024049 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.667437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.678429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.680023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.681054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.682287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.682733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.684005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/63b1b122e56041129112d135e7b1dd40/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.686841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, user_id=63b1b122e56041129112d135e7b1dd40, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.688446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.706689 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 90/180] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:49 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/63b1b122e56041129112d135e7b1dd40/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:49.707852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.798985 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 91/181] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:49.808011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:49.826713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bc3d8-2f5c-4d30-8641-0aeea5873793 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.833673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.895257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.895905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.896254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:49.896630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:49.941499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a51a-fd56-4891-8175-0fc5e7b06791 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:49.961350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:49.978313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:49.979654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:49.997335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:49.999130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:49.999606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:50.000664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:50.002456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:50.004958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:50.006905 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 92/182] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:50.013376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:50.106171 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 91/183] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:50.112076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:50.122251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:50.156909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22544f1e-2fc1-4d27-b400-7438aed9cc18 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:50.216489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:50.234290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41985be5-a77b-48eb-ba25-7b01d212e044 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:50.250668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:50.251334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:50.251682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:50.252023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:50.252823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0, user.id=7c97cd053b324b388dcd166471f70280) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:50.253245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:50.254876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:50.270925 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 93/184] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:50 2022] GET /identity/v3/role_assignments?user.id=7c97cd053b324b388dcd166471f70280&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:50.273894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:50.274746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:50.275191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:50.275614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:50.277067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:50.278734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7f759-cb90-4ddd-9794-37bb2e4d5f38 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:50.281216 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 92/185] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:50 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:50.290455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:50.441221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d960e-4b96-4c4a-8f0b-f6c24510124a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:50.478325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:50.478937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:50.479220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:50.479490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:50.480218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] RBAC: Adding query filter params (role.id=e836d7d42e2b405ea81e90a304bcb4ff, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0, user.id=7c97cd053b324b388dcd166471f70280) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:50.480524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:50.482636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaed0a-883e-4a92-af45-09eaa33042fe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:50.489728 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 94/186] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:50 2022] GET /identity/v3/role_assignments?user.id=7c97cd053b324b388dcd166471f70280&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=e836d7d42e2b405ea81e90a304bcb4ff => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:51.472963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138122-e883-4559-a774-e76762fae4d4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.473526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138122-e883-4559-a774-e76762fae4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.473526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d138122-e883-4559-a774-e76762fae4d4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.475034 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 93/187] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:51.478936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde0ce-ff15-4bea-a55c-8f8805708d2a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.479350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde0ce-ff15-4bea-a55c-8f8805708d2a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.479545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcde0ce-ff15-4bea-a55c-8f8805708d2a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.479731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.480013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.480286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.480926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 95/188] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:51.486514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.486799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.487069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.499135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:51.500330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:51.506988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:51.508537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:51.511321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:51.573297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 94/189] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:51.582284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 96/190] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:51.840333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:51.845024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:51.940800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:51.952386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec6733-c1ee-4403-893e-0087204dc451 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:51.957383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572c797-8054-4da2-8a92-45d2406de077 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:51.988502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:51.989278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.989549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.989813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.994525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:51.995152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:51.995422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:51.995868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:51.996967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:51.997111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:51.998707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.000307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 95/191] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:52.002210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:52.006170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:52.007818 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:52.008887 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:52.009886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:52.011236 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 97/192] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:52.017629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.119507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b90d2-eb9e-43d0-be76-a0818fec474a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.124948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701751f-fa95-42e0-bd35-ba8925fc5e3a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.155553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.156160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.156434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.156705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.157489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.159087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c602bb-a4f4-4b1e-aa99-9a99b5649f9e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.160018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.160630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.160924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.161228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.161910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:52.162214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.163639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.173069 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 98/193] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:52.179531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.184126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 96/194] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:52 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:52.185405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8cfab-86cf-4301-bd6b-e0fe8f9f5e8a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.185682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8cfab-86cf-4301-bd6b-e0fe8f9f5e8a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.186050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8cfab-86cf-4301-bd6b-e0fe8f9f5e8a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.187416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 97/195] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:52.192826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.193140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.193410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.214401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:52.215634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:52.219907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:52.251812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:52.298562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb263c-2214-4561-920c-95719ff318fe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.303125 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 98/196] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:52.339724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.340778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.341994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.342484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] PATH_INFO: `/v3/users/445b6a153c594222a15117867498e4aa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.358812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] RBAC: Authorizing `identity:get_user(user_id=445b6a153c594222a15117867498e4aa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.360301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.362238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 99/197] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/users/445b6a153c594222a15117867498e4aa => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:52.367655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.478933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae41fd-3478-4161-8b91-5f2565b626dc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.517427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.518360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.518813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.519292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.520431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.521950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.523798 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 99/198] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:52.530011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.573085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.586327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:52.644351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb480954-ee90-4f6e-b300-78885780a958 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.662965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:52.680888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.681918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.682373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.682785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/445b6a153c594222a15117867498e4aa/roles/b016a05c6405473eaf47532175d51a1c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.684851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, user_id=445b6a153c594222a15117867498e4aa, role_id=b016a05c6405473eaf47532175d51a1c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.686666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.693863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f936700-9d54-402b-ba53-d40cbb5298c8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.703758 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 100/199] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:45:52 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/users/445b6a153c594222a15117867498e4aa/roles/b016a05c6405473eaf47532175d51a1c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:45:52.744382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.745405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.745933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.746425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.759763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:52.766690 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:52.767693 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:52.768522 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:52.771095 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 100/200] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:52.779847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:52.894854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa004-5a86-4d03-ac97-8ce22b58a49f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:52.932483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:52.933180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:52.933457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:52.933724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:52.934394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:52.934741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:52.936283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:52.945539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 101/201] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:52.952189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:53.023445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:53.063331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517ca4-991b-448e-9b53-5a96d6915460 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:53.098612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:53.099253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:53.099524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:53.099791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] PATH_INFO: `/v3/users/63b1b122e56041129112d135e7b1dd40` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:53.100948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] RBAC: Authorizing `identity:get_user(user_id=63b1b122e56041129112d135e7b1dd40)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:53.102410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:53.104007 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 101/202] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:52 2022] GET /identity/v3/users/63b1b122e56041129112d135e7b1dd40 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:53.110309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:53.157185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:53.224662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620628-b861-4c9a-9c3b-833d04116a03 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:53.260665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:53.261313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:53.261593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:53.261863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:53.339885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:53.341608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:53.389402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:53.449460 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 102/203] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:53.455954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:53.563620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58652c-91cb-42f2-a137-52c4b4b7725f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:53.599975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:53.600609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:53.600892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:53.601186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:53.602320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:53.603773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785101e6-63a5-4ad3-b9a1-e8b22e85f139 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:53.605726 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 102/204] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:53 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:53.612835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:53.719940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a921-f843-4e7d-a143-a8a4f10d6e4c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:53.757649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:53.758257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:53.758530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:53.758795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:53.759553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] RBAC: Adding query filter params (role.id=45f2445471ee4a6986112b01f7d3fa96, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0, user.id=63b1b122e56041129112d135e7b1dd40) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:53.759855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:53.763188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805974f8-5349-4050-800f-2d2e3ce8ee92 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:53.768148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 103/205] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:53 2022] GET /identity/v3/role_assignments?user.id=63b1b122e56041129112d135e7b1dd40&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:54.602234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc1345-31b7-46e1-b779-7e78a99f75b5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:54.602752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc1345-31b7-46e1-b779-7e78a99f75b5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:54.602752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc1345-31b7-46e1-b779-7e78a99f75b5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:54.604216 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 103/206] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:54.611282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:54.611564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:54.611855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:54.620137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:54.632189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:54.633422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:54.663768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca416ce-67e2-4862-91ba-db3c2d42fb3f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:54.664132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca416ce-67e2-4862-91ba-db3c2d42fb3f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:54.664307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca416ce-67e2-4862-91ba-db3c2d42fb3f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:54.665684 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 104/207] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:54.670584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:54.670861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:54.671132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:54.679374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:54.691982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:54.693181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:54.706936 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 104/208] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:54.764301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 105/209] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:54.980326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.038057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.085855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc7d3-cb2d-42e9-a8bc-abc5f0111192 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.121383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.122291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.122574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.122841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.124632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.133770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f078f14e-865e-4c67-b257-38e46a58af55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:55.138599 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:55.139509 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:55.140974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 105/210] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:55.141665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f5a2-63b8-49e1-832b-efb335a7388c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.141738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdd75-c56a-4d8b-b2a6-1a91e9c48420 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.141810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f5a2-63b8-49e1-832b-efb335a7388c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.141874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765f5a2-63b8-49e1-832b-efb335a7388c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.143607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 106/211] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:55.146677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f5a2-63b8-49e1-832b-efb335a7388c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.178692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.179319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.179594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.179860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.181054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.182504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575e19-2ece-43b0-863c-cc143e2b181e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.184068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 106/212] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:55.185806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.186082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.186346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.192899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.205034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:55.206251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:55.248381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765f5a2-63b8-49e1-832b-efb335a7388c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.272213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 107/213] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:55.273146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.281709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.282302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.282570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.282835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.283492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:55.283788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.285181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.293453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 107/214] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:55.300360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.358933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.391310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8da22-6fff-4a87-b2b2-b479aa0f846f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.404732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbe1f2-8af7-4e9d-9d03-5d93d4af9661 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.424110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.429682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.430283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.430559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.430827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.431471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.433016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.439888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.440509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.440778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.441066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] PATH_INFO: `/v3/users/4e1918dba2c049e9980e946595b53567` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.464447 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 108/215] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:45:55 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:55.464619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] RBAC: Authorizing `identity:get_user(user_id=4e1918dba2c049e9980e946595b53567)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.464619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.464619 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 108/216] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/users/4e1918dba2c049e9980e946595b53567 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:45:55.465886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.560824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.584883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6737e-80fe-4caa-af35-09189e01970d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.626119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.626847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.626994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.627261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.627992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] RBAC: Adding query filter params (role.id=45f2445471ee4a6986112b01f7d3fa96, user.id=4e1918dba2c049e9980e946595b53567, scope.system=all) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:55.628296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.629781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.635168 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 109/217] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/role_assignments?user.id=4e1918dba2c049e9980e946595b53567&scope.system=all&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:55.689142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63a97c-eb62-4017-ac4a-3eb427709267 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.707151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.731565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.733269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.733269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.733570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.746109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:55.751813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:55.752733 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:55.753813 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:55.756280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 109/218] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:55.762457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:55.828264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:55.881035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c68b0-a7b6-4263-a7a0-e0465c964734 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:55.918001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:55.918618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:55.918892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:55.919682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:55.920484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:55.920801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:55.922233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:55.933602 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 110/219] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:55.940177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:56.048821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183ab57-d031-4b69-a1b7-acbeeebeb776 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:56.085600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:56.086610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:56.087104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:56.087583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] PATH_INFO: `/v3/users/445b6a153c594222a15117867498e4aa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:56.088929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] RBAC: Authorizing `identity:get_user(user_id=445b6a153c594222a15117867498e4aa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:56.090593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:56.092986 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 110/220] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:55 2022] GET /identity/v3/users/445b6a153c594222a15117867498e4aa => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:56.105026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:56.209018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8aadd-dffb-4a1e-bfc4-c62d92ab79f8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:56.223267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:56.244750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:56.245396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:56.245675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:56.245944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:56.316274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:56.317687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:56.422072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 111/221] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:45:56.427718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:56.473867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:56.537160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4135b-09d0-4398-98d3-a364439a93b0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:56.574990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:56.576201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:56.576681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:56.577179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:56.578509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:56.580872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f3a4-af1f-4bd1-b6df-42f40be3236f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:56.583321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 111/222] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:45:56 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:56.589247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:56.605352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:56.694578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd11c-a00e-424b-8329-5bd3fa761560 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:56.728668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:56.729303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:56.729584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:56.729859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:56.730592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] RBAC: Adding query filter params (role.id=b016a05c6405473eaf47532175d51a1c, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0, user.id=445b6a153c594222a15117867498e4aa) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:56.730900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:56.732622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e1a8f-1862-4406-bd79-cee8de2d2a80 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:56.738920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 112/223] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:45:56 2022] GET /identity/v3/role_assignments?user.id=445b6a153c594222a15117867498e4aa&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=b016a05c6405473eaf47532175d51a1c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:57.806911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e445cb-70dd-4698-81d4-daf2ebd7f997 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.807460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e445cb-70dd-4698-81d4-daf2ebd7f997 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.807460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e445cb-70dd-4698-81d4-daf2ebd7f997 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.808749 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 112/224] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:57.814382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f796c9-9fb5-4428-9839-d5b2776f58ac None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.814769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f796c9-9fb5-4428-9839-d5b2776f58ac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.814930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f796c9-9fb5-4428-9839-d5b2776f58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.833986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79f796c9-9fb5-4428-9839-d5b2776f58ac None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:57.835196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79f796c9-9fb5-4428-9839-d5b2776f58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:57.874409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbed55-018c-493b-8046-77c0c51a8c53 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.874691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbed55-018c-493b-8046-77c0c51a8c53 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.874965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbed55-018c-493b-8046-77c0c51a8c53 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.876306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 113/225] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:45:57.882124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f51d-342d-4023-941b-406fa043c8df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.882406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f51d-342d-4023-941b-406fa043c8df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.883108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623f51d-342d-4023-941b-406fa043c8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.905353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4623f51d-342d-4023-941b-406fa043c8df None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:57.906542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4623f51d-342d-4023-941b-406fa043c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:57.917298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 113/226] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:45:57.956398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bad06-82b9-46c6-8e55-65941def1c90 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.956676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bad06-82b9-46c6-8e55-65941def1c90 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.957175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bad06-82b9-46c6-8e55-65941def1c90 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.958521 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 114/227] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:45:57.963414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:57.963701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:57.963968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:57.983225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:45:57.983990 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 114/228] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:57.984405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:45:57.986617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.055437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 115/229] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:45:58.180478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623f51d-342d-4023-941b-406fa043c8df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.223821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.248536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.286059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623f51d-342d-4023-941b-406fa043c8df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.319173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.319792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.320064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.320323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.330440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:58.335194 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:58.336270 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:45:58.337315 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 115/230] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:45:58.337979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.352787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec4ba0-a67e-4472-a1d8-ab9dfed38f0c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.386636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.387256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.387525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.387947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.394433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.398846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:45:58.404582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:45:58.405531 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:45:58.406310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 116/231] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:45:58.406973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.436140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.439102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a210-017e-4ced-9bd6-03a904729c24 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.473533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.474168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.474451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.474722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.475865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.477377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.478946 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 116/232] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:58.479716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.508669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06459a3-b99b-4719-9f9a-3645c667ad72 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.544620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.545244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.545521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.545788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.546443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:58.546746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.548127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.556241 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 117/233] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:58.557668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.580311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7999d2-2124-4fb3-a4ea-3e2cf97248ac None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.614609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.615220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.615500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.615773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.616463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:58.617043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.617154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.618412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.626989 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 117/234] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:58.627781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.659313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.664423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e3ec-ead7-4774-9f71-d20c4ac93f18 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.696815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.697386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.697660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.697929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.698551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.699969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.716381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 118/235] 10.222.0.78 () {60 vars in 1134 bytes} [Tue Oct 18 15:45:58 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:45:58.717195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.731106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfdfdf7-a02e-444b-8c38-043206b368ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.773002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.773784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.774085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.774379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] PATH_INFO: `/v3/users/192a9d64bd5143c6b58fa030f19f8e70` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.793562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] RBAC: Authorizing `identity:get_user(user_id=192a9d64bd5143c6b58fa030f19f8e70)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.796235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.798693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 118/236] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/users/192a9d64bd5143c6b58fa030f19f8e70 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:58.804822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.852443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f1ec4-a641-4a12-8df3-d498834dbfe8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.877098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.897591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.898225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.898501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.898771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] PATH_INFO: `/v3/users/4e1918dba2c049e9980e946595b53567` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.899903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] RBAC: Authorizing `identity:get_user(user_id=4e1918dba2c049e9980e946595b53567)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.901372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.902945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 119/237] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/users/4e1918dba2c049e9980e946595b53567 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:58.905088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:45:58.911019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:45:58.922219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3566f-a4c4-480c-ac18-c42c3baf7e13 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:58.965690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:58.967289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:58.967749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:58.968722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:58.969979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] RBAC: Adding query filter params (role.id=b016a05c6405473eaf47532175d51a1c, user.id=192a9d64bd5143c6b58fa030f19f8e70, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:45:58.970436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:58.972703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7419-fb64-4f86-8711-c983c6a0e712 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:58.980727 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 119/238] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 18 15:45:58 2022] GET /identity/v3/role_assignments?user.id=192a9d64bd5143c6b58fa030f19f8e70&scope.system=all&role.id=b016a05c6405473eaf47532175d51a1c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:45:59.032459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9059e3f-2c19-4f04-b388-125cb801586c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:45:59.069272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:45:59.069947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:45:59.070231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:45:59.070495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] PATH_INFO: `/v3/system/users/4e1918dba2c049e9980e946595b53567/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:45:59.071998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e1918dba2c049e9980e946595b53567, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:45:59.073428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4051dd6-7de7-4da5-a6df-33601a279833 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:45:59.087627 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 120/239] 10.222.0.78 () {58 vars in 1334 bytes} [Tue Oct 18 15:45:58 2022] PUT /identity/v3/system/users/4e1918dba2c049e9980e946595b53567/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:00.943315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cdde-92d1-4518-b136-54b2a2d8d82e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:00.943784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cdde-92d1-4518-b136-54b2a2d8d82e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:00.943857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880cdde-92d1-4518-b136-54b2a2d8d82e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:00.945349 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 120/240] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:00.951116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37097bb-d671-4ab7-aadb-f99cd87ce78c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:00.951668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37097bb-d671-4ab7-aadb-f99cd87ce78c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:00.951857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37097bb-d671-4ab7-aadb-f99cd87ce78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:00.970164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a37097bb-d671-4ab7-aadb-f99cd87ce78c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:00.971377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a37097bb-d671-4ab7-aadb-f99cd87ce78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:01.021909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:01.048122 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 121/241] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:01.137885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5bef5-3376-465f-a488-b2539bf50227 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.138253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5bef5-3376-465f-a488-b2539bf50227 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.138493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5bef5-3376-465f-a488-b2539bf50227 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.140068 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 121/242] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:01.145595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.145879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.146142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.164742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:01.165943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:01.227164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7f3-92fd-4f95-95dd-90cc027b6525 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.227402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7f3-92fd-4f95-95dd-90cc027b6525 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.227619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ba7f3-92fd-4f95-95dd-90cc027b6525 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.229107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 122/243] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:01.234631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.234915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.235187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.241371 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 122/244] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:01.252648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:01.253848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:01.322312 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 123/245] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:46:01.326509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.433084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac099f2-fe74-4dfe-a7d4-f24b5d5aa994 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:01.447323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:01.470534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:01.471154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.471426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.471687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.472769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:01.474255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:01.476011 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 123/246] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:01.481907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.505468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.569883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:01.588899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1531c2-71f8-4815-9971-aa58f1b9d5a5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:01.615706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154c46-4cfd-49ca-93ef-7dd6e23a65c1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:01.629511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:01.630118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.630392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.630667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.631305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:01.632730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:01.649685 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 124/247] 10.222.0.78 () {60 vars in 1134 bytes} [Tue Oct 18 15:46:01 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:01.650796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.662619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:01.663377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.663649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.663957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.681343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:01.686902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:01.688140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:01.689195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 124/248] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:01.694193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.742705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:01.769965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc78ec-89ec-4412-8561-f5b9ba57d308 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:01.805366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:01.805977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.806254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.806523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.812861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e09ce-e289-4cf5-97c3-a1688c8dd46a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:01.817775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:01.823198 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:01.824079 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:01.824904 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 125/249] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:01.832268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.835924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:01.861415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:01.862033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:01.862338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:01.862581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:01.863249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:01.863550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:01.864936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:01.877215 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 125/250] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:01.882943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:01.967567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12def3d5-0c0f-47ba-9582-96c487c877bb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:02.017470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:02.018405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:02.018836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:02.019109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:02.019792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:02.020090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:02.022285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:02.027021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc35a-48a6-46dd-b90b-b9ce5e21505a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:02.029972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:02.036533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 126/251] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:02.045399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:02.075500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:02.076677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:02.077271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:02.077764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] PATH_INFO: `/v3/users/192a9d64bd5143c6b58fa030f19f8e70` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:02.079160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] RBAC: Authorizing `identity:get_user(user_id=192a9d64bd5143c6b58fa030f19f8e70)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:02.081065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:02.083773 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 126/252] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:46:01 2022] GET /identity/v3/users/192a9d64bd5143c6b58fa030f19f8e70 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:02.089468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:02.117497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:02.172149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc004-ea71-4bcd-9dc8-e44bc781f274 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:02.212507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:02.213185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:02.213465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:02.213738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] PATH_INFO: `/v3/users/4e1918dba2c049e9980e946595b53567` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:02.215092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] RBAC: Authorizing `identity:get_user(user_id=4e1918dba2c049e9980e946595b53567)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:02.217406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:02.219493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 127/253] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:46:02 2022] GET /identity/v3/users/4e1918dba2c049e9980e946595b53567 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:02.225118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:02.228081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cee1-d6aa-4b7d-9430-bb185cb12775 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:02.270940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:02.271522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:02.271797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:02.272066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] PATH_INFO: `/v3/system/users/192a9d64bd5143c6b58fa030f19f8e70/roles/b016a05c6405473eaf47532175d51a1c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:02.273542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=192a9d64bd5143c6b58fa030f19f8e70, role_id=b016a05c6405473eaf47532175d51a1c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:02.274928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8730c4f-fd2c-4272-8cde-ab7afafa4d7e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:02.285809 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 127/254] 10.222.0.78 () {58 vars in 1334 bytes} [Tue Oct 18 15:46:02 2022] PUT /identity/v3/system/users/192a9d64bd5143c6b58fa030f19f8e70/roles/b016a05c6405473eaf47532175d51a1c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:46:02.361063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aedf1d-a6e7-4573-82dc-26a2ff399a9b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:02.396516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:02.403805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:02.404809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:02.405332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:02.405839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:02.406787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] RBAC: Adding query filter params (role.id=45f2445471ee4a6986112b01f7d3fa96, user.id=4e1918dba2c049e9980e946595b53567, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:02.407300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:02.409011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29466d9-d479-45f8-bbc9-f2e52b3ef2fa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:02.424080 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 128/255] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 18 15:46:02 2022] GET /identity/v3/role_assignments?user.id=4e1918dba2c049e9980e946595b53567&scope.system=all&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:04.363077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704590c-8d9d-4557-8c7d-b49c6bfb5b56 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.363589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704590c-8d9d-4557-8c7d-b49c6bfb5b56 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.363589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704590c-8d9d-4557-8c7d-b49c6bfb5b56 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.365232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 128/256] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:04.370787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ae9c1-d155-48a6-b0ca-f27fbff6dd58 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.371646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ae9c1-d155-48a6-b0ca-f27fbff6dd58 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.372746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ae9c1-d155-48a6-b0ca-f27fbff6dd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.398187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-567ae9c1-d155-48a6-b0ca-f27fbff6dd58 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:04.399712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-567ae9c1-d155-48a6-b0ca-f27fbff6dd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:04.413645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29338f0-0ab4-4f52-9ca5-d335cc49c98b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.413955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29338f0-0ab4-4f52-9ca5-d335cc49c98b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.414191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29338f0-0ab4-4f52-9ca5-d335cc49c98b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.416845 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 129/257] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:04.421575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614142-6616-4240-a74f-9c171408932c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.421858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614142-6616-4240-a74f-9c171408932c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.422134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb614142-6616-4240-a74f-9c171408932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.443916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cb614142-6616-4240-a74f-9c171408932c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:04.445151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb614142-6616-4240-a74f-9c171408932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:04.483438 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 129/258] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:46:04.485776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:04.515173 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 130/259] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:46:04.858216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9f3e-4742-4e88-b3e3-5ad7f663e7f0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.858589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9f3e-4742-4e88-b3e3-5ad7f663e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.858789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9f3e-4742-4e88-b3e3-5ad7f663e7f0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.860451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 130/260] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:04.865535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:04.865820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:04.866094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:04.889242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:04.890473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:04.959795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9f3e-4742-4e88-b3e3-5ad7f663e7f0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:04.979772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9f3e-4742-4e88-b3e3-5ad7f663e7f0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:04.999435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.000078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.000346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.000776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.002407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 131/261] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:05.027179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:05.033515 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:05.034600 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:05.035575 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:05.037533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 131/262] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:05.043549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.062040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c384dcd-f53d-433d-b0a4-55a2ccb6a711 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.066894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.067510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.067785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.068054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.068731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:05.069053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.070958 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:05.070958 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:46:05.070958 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:46:05.071987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.085168 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 132/263] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.086896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.102344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16203b70-82a1-4b11-becd-47502622a0da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.110008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.113236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.114094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.114556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.114995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.121614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.125773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ebd3-44f6-4b86-81f7-d4c52166daa9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.127820 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:05.127820 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 15:46:05.127820 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 15:46:05.129265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.131315 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 132/264] 10.222.0.78 () {56 vars in 1201 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.132457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.133313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.133777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.134048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.138797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.158629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:05.165552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1661-0d3d-4130-a22e-eff0063bce0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:05.167319 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:05.168201 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:05.169662 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:05.173728 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 133/265] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:05.179033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.180003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.180476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.180962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.185874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.187133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.193213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.196165 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 133/266] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.202438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.203971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74032e81-cfc2-47e1-b61f-180e8b6f1dc3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.216928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.217935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.218243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cc08b-7184-4ab0-9039-f45736177a9f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.218694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.219285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.220247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:05.220747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.222662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.225597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.226240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.226524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.226798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.228946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, group_id=0bb7fee7f2a24ac7b764730d0935b64f, role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.234195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 134/267] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:05.240903 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:05.240903 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 15:46:05.240903 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 15:46:05.240903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.242457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.261066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 134/268] 10.222.0.78 () {58 vars in 1463 bytes} [Tue Oct 18 15:46:05 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:05.264956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bb0dd-b351-45d8-afe9-82e387fbea2a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.331738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.332856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.333497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.334035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.335739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.337106 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:05.337106 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:46:05.337106 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:46:05.338818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.341640 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 135/269] 10.222.0.78 () {56 vars in 1201 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.348157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.360672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae18f85-685d-4e37-a79d-f75609d21a2b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.365733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.366708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.367217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.367704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.369152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.371599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.374640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 135/270] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.380941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.393264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd49f-9d00-41c3-b330-176bc14d1f5c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.398469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.399485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.399961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.400537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.402900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7803ed96fee94c18a066627d51f5dfe3, group_id=0bb7fee7f2a24ac7b764730d0935b64f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.404279 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:05.404279 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:46:05.404279 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:46:05.406882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.424298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 136/271] 10.222.0.78 () {58 vars in 1463 bytes} [Tue Oct 18 15:46:05 2022] PUT /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:05.585673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.696588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:05.706179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce3ed6-e828-4493-a83c-efb2fea76d0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.747414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.748128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.748423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.748696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.764462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-912c8f0e-27c7-4f05-b564-d9c3bd21008e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:05.770078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:05.770944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 15:46:05.771748 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:05.772375 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 136/272] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:05.779260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:05.796557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:05.866887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0053-62b6-42e3-b747-75cf17e295f6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.867208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0053-62b6-42e3-b747-75cf17e295f6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.867433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0053-62b6-42e3-b747-75cf17e295f6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.868983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 137/273] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:05.878854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.879142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.879393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.906322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5346e-16de-4a4c-a2b1-b968c02bb916 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:05.936585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:05.936585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:05.944856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:05.945544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:05.945823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:05.946093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:05.946828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:05.947071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:05.948535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:05.959898 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 137/274] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:05.967786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.098725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 138/275] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:46:06.105340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:06.132477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3214-9602-47f4-9e5a-4bde62b60f40 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.207322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.207983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.208266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.208536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] PATH_INFO: `/v3/users/192a9d64bd5143c6b58fa030f19f8e70` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.209826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] RBAC: Authorizing `identity:get_user(user_id=192a9d64bd5143c6b58fa030f19f8e70)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.211280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd05d-feba-4bb8-999e-46f64cc1f681 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.213054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 138/276] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:46:05 2022] GET /identity/v3/users/192a9d64bd5143c6b58fa030f19f8e70 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:06.219086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.349913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe12d45-6f27-4e27-b7de-41e80569c6d4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.351521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:06.397064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.397681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.397926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.398181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.398904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] RBAC: Adding query filter params (role.id=b016a05c6405473eaf47532175d51a1c, user.id=192a9d64bd5143c6b58fa030f19f8e70, scope.system=all) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:06.399200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.400626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.409839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae94-30ed-479f-aa43-a6ecef95d3d1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.409839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae94-30ed-479f-aa43-a6ecef95d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.409839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fae94-30ed-479f-aa43-a6ecef95d3d1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.414440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 139/277] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:06.418035 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 139/278] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/role_assignments?user.id=192a9d64bd5143c6b58fa030f19f8e70&scope.system=all&role.id=b016a05c6405473eaf47532175d51a1c => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:06.423250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.423538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.423888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.458253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:06.459498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:06.472248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 140/279] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:46:06.535023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.550053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc375c72-ebad-4681-9e8d-7abb2e2e63e4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.555628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.556545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.557065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.557529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.572714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:06.578688 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:06.579608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:06.580418 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:06.586599 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 140/280] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:06.593304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.609296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6011d9-006e-480c-a137-2c00d47ab271 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.618591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.619264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.619543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.619814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.620550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:06.620855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.623125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.637776 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 141/281] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:06.643387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.658848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e39fe-a343-4bc4-9e33-81a37b67944b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.668200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.669499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.669975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.670438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.677880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.680176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.682713 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 141/282] 10.222.0.78 () {56 vars in 1201 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:06.689477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.702640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df81e7-a8ee-41a5-87c3-bdb709dead67 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.711551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.712175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.712454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.712724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.714887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.717354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.719592 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 142/283] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:06.725162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.740237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5fcf2-293e-4c40-a187-794bf8b0d21d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.745579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:06.746603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:06.747236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:06.747703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:06.750778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, group_id=0bb7fee7f2a24ac7b764730d0935b64f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:06.753767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:06.785807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 142/284] 10.222.0.78 () {58 vars in 1463 bytes} [Tue Oct 18 15:46:06 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:06.906110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:06.917180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec8887-4216-43ae-9c5a-1ba60f4fba70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:06.999938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.001026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.001521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.001985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.019608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:07.025871 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:07.026845 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:07.027653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:07.034727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 143/285] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:07.040961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.053225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931ce74-9969-4b9a-857b-5f8aae450705 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.058088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.058947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.059487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.059958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.060834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:07.061389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.062643 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:46:07.062643 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 15:46:07.062643 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 15:46:07.063855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.073425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 143/286] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:07.079309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.093409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9161-97ec-4189-93c4-ccf0bd482cd9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.098966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.099599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.099868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.100137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.101259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.103153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.105054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 144/287] 10.222.0.78 () {56 vars in 1201 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:07.110923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.127356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d651b8b-120c-4fe8-b54a-938237e4571d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.132410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.133423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.133926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.134391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.137518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.139915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ccad-833c-49cb-a3f5-2be19f28c59e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.142087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 144/288] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:07.148129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.159780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ac06c-efdc-4e90-b89b-aa3e8db2793b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.166967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.167991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.168556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.169047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.172250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cca9cb84d41f48552d18541fe74f0, group_id=0bb7fee7f2a24ac7b764730d0935b64f, role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.175197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3606d69-beed-437f-a0a9-7ddce73871be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.192419 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 145/289] 10.222.0.78 () {58 vars in 1463 bytes} [Tue Oct 18 15:46:07 2022] PUT /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0/groups/0bb7fee7f2a24ac7b764730d0935b64f/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:07.263667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8ae8e-560c-4bf6-91dd-a16f38d64c20 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.264332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8ae8e-560c-4bf6-91dd-a16f38d64c20 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.264733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8ae8e-560c-4bf6-91dd-a16f38d64c20 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.266252 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 145/290] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:07.272258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.272824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.273372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.295457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:07.297159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:07.353416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:07.376875 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 146/291] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 15:46:07.718973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8ae8e-560c-4bf6-91dd-a16f38d64c20 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.733468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8ae8e-560c-4bf6-91dd-a16f38d64c20 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.741527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.742550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.743021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.743492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.758293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:07.764005 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:07.764879 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:07.765719 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:07.773021 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 146/292] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:07.773858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.786123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39300ee9-2f91-4829-9322-4b55a8c0dc9f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.796056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.796667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.796934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.797220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.797887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:07.798182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.799783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.812902 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 147/293] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:07.818667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.831480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c71c-ee93-475d-b1ac-6c3a6c7774e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.836250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.837129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.837600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.838062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] PATH_INFO: `/v3/groups/556a9337740340fc8560a125973da804` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.851413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] RBAC: Authorizing `identity:get_group(group_id=556a9337740340fc8560a125973da804)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.853758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.855711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 147/294] 10.222.0.78 () {56 vars in 1201 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/groups/556a9337740340fc8560a125973da804 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:07.861794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.880162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe29cd-5b61-4a85-96cb-387a70c69b8e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.888050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.888739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.889028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.889295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] PATH_INFO: `/v3/projects/6c8d96b0623744b2b02923664ec6fcd8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.893677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] RBAC: Authorizing `identity:get_project(project_id=6c8d96b0623744b2b02923664ec6fcd8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.895470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4be9b-b74d-4f3a-817a-4146bdc9eae8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.897188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 148/295] 10.222.0.78 () {56 vars in 1207 bytes} [Tue Oct 18 15:46:07 2022] GET /identity/v3/projects/6c8d96b0623744b2b02923664ec6fcd8 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:07.903797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:07.915881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46788b0-1f23-4cb4-a274-2e25e9a77dfa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:07.921130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:07.922133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:07.922627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:07.923128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] PATH_INFO: `/v3/projects/6c8d96b0623744b2b02923664ec6fcd8/groups/556a9337740340fc8560a125973da804/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:07.925303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8d96b0623744b2b02923664ec6fcd8, group_id=556a9337740340fc8560a125973da804, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:07.940185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55357fbc-5203-4abc-a2e7-88c29e3a9d6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:07.960194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 148/296] 10.222.0.78 () {58 vars in 1463 bytes} [Tue Oct 18 15:46:07 2022] PUT /identity/v3/projects/6c8d96b0623744b2b02923664ec6fcd8/groups/556a9337740340fc8560a125973da804/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:08.498014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc372-c83c-4761-aa10-a1e980fe7998 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:08.498713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc372-c83c-4761-aa10-a1e980fe7998 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:08.499198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfc372-c83c-4761-aa10-a1e980fe7998 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:08.501091 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 149/297] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:08.506822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8904a7-b850-413f-ae45-fa1ebbd0c7bd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:08.507344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8904a7-b850-413f-ae45-fa1ebbd0c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:08.507815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8904a7-b850-413f-ae45-fa1ebbd0c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:08.534086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac8904a7-b850-413f-ae45-fa1ebbd0c7bd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:08.535630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac8904a7-b850-413f-ae45-fa1ebbd0c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:08.635166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 149/298] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:08.907135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dfdc-0cc8-4155-a20a-5bb2aea7266d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:08.908163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dfdc-0cc8-4155-a20a-5bb2aea7266d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:08.908647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771dfdc-0cc8-4155-a20a-5bb2aea7266d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:08.910516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 150/299] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:08.915490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:08.915906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:08.916076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:08.942065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:08.943262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:08.959328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:09.036757 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 150/300] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:46:09.103962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771dfdc-0cc8-4155-a20a-5bb2aea7266d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:09.238791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771dfdc-0cc8-4155-a20a-5bb2aea7266d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:09.285158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:09.286166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.286640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.287106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.300124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:09.305334 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:09.306202 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:09.306999 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:09.309483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 151/301] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:09.315407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:09.417318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:09.475216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672e9ef-d1f4-41f3-a81e-7dd28b869338 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:09.497431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:09.556717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:09.557373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.557647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.557913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.558590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:09.558890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:09.560983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:09.572858 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 151/302] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:46:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:09.580441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:09.599201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:09.619990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183f266-8646-41ab-9f30-6769fcbec643 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:09.676007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:09.676632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.679789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.680321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.697428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e12792a8-9f66-4701-a3bc-ca1066a2a984 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:09.702981 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:09.703922 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:09.704781 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:09.707206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 152/303] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:09.708585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917fdd-61ba-4513-b574-6ad533f57275 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.709113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917fdd-61ba-4513-b574-6ad533f57275 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.709595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61917fdd-61ba-4513-b574-6ad533f57275 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.712543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 153/304] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:09.718770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61917fdd-61ba-4513-b574-6ad533f57275 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:09.737110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d29f-859c-40c1-82c2-f9ac090b9cf9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:09.783530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:09.784490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.785070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.785485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.857180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:09.867758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61917fdd-61ba-4513-b574-6ad533f57275 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:09.897164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:09.899768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:09.913760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:09.914785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.915154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.915514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.915802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:09.916372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:09.916944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:09.919253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743226cb-070d-4984-bbca-e1636085fa0f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:09.931332 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 154/305] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:09.934349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:09.934349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:09.934349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:09.954640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:09.956970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:10.042801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 155/306] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:10.047935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 152/307] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:10.049926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.053095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.173304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275465-7d7e-4b73-9757-c0b389449741 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.186709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.219518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.220895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.221371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.221781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.223083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:10.224662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:10.226765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 153/308] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:10.238127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.302510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.319762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b2449-005d-468c-be8e-bb63576deda5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.359831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01864d0-3257-4b16-8587-cfc72f28580f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.377578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.378906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.379843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.380325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.400711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.401438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.401697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.401925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.404150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:10.406305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:10.407601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 154/309] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:10.408307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.469146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.482462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:10.484184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:10.538675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142d644-f039-4fe8-b190-fec81d702091 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.580372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.580918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.581217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.581486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.598947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b08f5795-7ef1-468c-b9ed-97843e778fac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:10.604697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:10.606317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:10.607140 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 155/310] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:10.608245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee08943-40a1-4ba6-9913-a89d83c4f961 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.608782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee08943-40a1-4ba6-9913-a89d83c4f961 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.608782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee08943-40a1-4ba6-9913-a89d83c4f961 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.610129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 156/311] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:10.614361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee08943-40a1-4ba6-9913-a89d83c4f961 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.617532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.628746 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 156/312] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:10.629998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.749688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee08943-40a1-4ba6-9913-a89d83c4f961 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.752789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.765194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0e4b4-6094-417f-b2c4-95e2814a4e0d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:10.792967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.794253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.794737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.795128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.795923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] RBAC: Adding query filter params (group.id=0bb7fee7f2a24ac7b764730d0935b64f, role.id=45f2445471ee4a6986112b01f7d3fa96, scope.project.id=7803ed96fee94c18a066627d51f5dfe3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:10.796234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:10.797780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ade67-79dd-4381-ab04-982b66d61dbe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:10.804691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 157/313] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/role_assignments?group.id=0bb7fee7f2a24ac7b764730d0935b64f&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:10.805999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a879-27ac-4e2e-9cec-a19dc78d3b60 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.806286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a879-27ac-4e2e-9cec-a19dc78d3b60 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.806745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31a879-27ac-4e2e-9cec-a19dc78d3b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.811147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:10.811789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.812064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.812333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.816170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:10.816739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:10.818216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:10.828228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-df31a879-27ac-4e2e-9cec-a19dc78d3b60 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:10.829418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 157/314] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:10.829527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df31a879-27ac-4e2e-9cec-a19dc78d3b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:10.830633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.905099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:10.928612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 158/315] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:10.930786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda97-a552-46e6-a64b-fe607b5fbd8e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:10.931267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda97-a552-46e6-a64b-fe607b5fbd8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:10.931724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dda97-a552-46e6-a64b-fe607b5fbd8e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:10.935333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 159/316] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:10.936447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dda97-a552-46e6-a64b-fe607b5fbd8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:10.983419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d30123-48a6-44d4-ba27-b5205ac6c9ad None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.026421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.027345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.028252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.028527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] PATH_INFO: `/v3/projects/7803ed96fee94c18a066627d51f5dfe3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.031250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] RBAC: Authorizing `identity:get_project(project_id=7803ed96fee94c18a066627d51f5dfe3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.033095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e58ee-b3de-4119-99bb-293cf40c19c0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.034693 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 158/317] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/projects/7803ed96fee94c18a066627d51f5dfe3 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.036005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.036281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.036581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.065909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:11.067143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:11.081847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.091156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dda97-a552-46e6-a64b-fe607b5fbd8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.145635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.146546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.146819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.147079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.158567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 159/318] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:11.159540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.221370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.245717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.247271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.288483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df855494-cf0f-4ed3-8517-b65e000da98f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.326912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.327539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.327815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.328069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.329203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.330617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.332245 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 160/319] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.332926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.363932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.368882 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 160/320] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:11.370128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.457838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c88a7-67f9-48e1-9c9f-ce3eb608c013 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.480176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.491039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f1e14-4aba-4521-ab05-384645d9a3e3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.499262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.499893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.500835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.500835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.512469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:11.518230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:11.519123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:11.519912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 161/321] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:11.520703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.539250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.539443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.539676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.539900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.540614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] RBAC: Adding query filter params (group.id=0bb7fee7f2a24ac7b764730d0935b64f, role.id=e836d7d42e2b405ea81e90a304bcb4ff, scope.project.id=7803ed96fee94c18a066627d51f5dfe3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:11.540913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.544058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.550527 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 161/322] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/role_assignments?group.id=0bb7fee7f2a24ac7b764730d0935b64f&scope.project.id=7803ed96fee94c18a066627d51f5dfe3&role.id=e836d7d42e2b405ea81e90a304bcb4ff => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.551337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.631462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.656569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336767c-62c8-4027-a259-73a8b6d43a07 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.690217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334beb-7d2a-435d-930b-8eb7eb49e7ea None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.704565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.705324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.705607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.705882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.707143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.708631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.710931 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 162/323] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.716170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.740634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.741310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.741592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.741862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.758835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:11.764963 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:11.765915 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:11.766869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 162/324] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:11.768000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.775554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.843167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ed977-5472-4c03-8675-de3d7a281bc1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.885741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.886276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.886548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.886815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.887706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:11.887965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.888355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568dd5-a267-44fa-b405-421f9218e63e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:11.889413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.899786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 163/325] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.901231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:11.915960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:11.934891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:11.935551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:11.935855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:11.936127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:11.937318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:11.938779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:11.940561 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 163/326] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:11.941847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.023423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacc5ca-9874-4f86-98fc-f2be58e63f9e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.037884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.066628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.067239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.067516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.067800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.068451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:12.068538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cedbe-9095-412c-81df-8acf43d2d3d7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.068751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.070182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.079083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 164/327] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:12.079880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.103733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.104329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.104601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.104872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.161390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.172077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.173548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.179170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3e983-e2ee-4f69-9b47-ef901c43f4c2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.211658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.212251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.212519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.212782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.213522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] RBAC: Adding query filter params (group.id=0bb7fee7f2a24ac7b764730d0935b64f, role.id=45f2445471ee4a6986112b01f7d3fa96, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:12.213840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.215921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.221483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 165/328] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/role_assignments?group.id=0bb7fee7f2a24ac7b764730d0935b64f&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=45f2445471ee4a6986112b01f7d3fa96 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:12.222242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.261360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.293266 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 164/329] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:12.299104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.338852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc35e-16c4-4ab6-8f51-53eff4d1fd68 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.378140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.379323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.379633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.379910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.409103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.423862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7033aa-b2b2-4b29-a6d1-2b500f28b681 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.458810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.460241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.462682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.464152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.464432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.464699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] PATH_INFO: `/v3/projects/8c9cca9cb84d41f48552d18541fe74f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.467947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] RBAC: Authorizing `identity:get_project(project_id=8c9cca9cb84d41f48552d18541fe74f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.467947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.471749 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 165/330] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/projects/8c9cca9cb84d41f48552d18541fe74f0 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:12.476852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.499096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.589485 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 166/331] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:12.596034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.600154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acecc-45eb-4c5f-a58e-2e7fd2c3a022 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.635790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.636408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.636691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.637128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] PATH_INFO: `/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.638349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] RBAC: Authorizing `identity:get_group(group_id=0bb7fee7f2a24ac7b764730d0935b64f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.639823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.641680 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 166/332] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/groups/0bb7fee7f2a24ac7b764730d0935b64f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:12.647224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.675391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.696445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e659b4-20c0-4236-9ab5-d4be88527b34 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.732477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.733401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.733674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.733940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] PATH_INFO: `/v3/projects/6c8d96b0623744b2b02923664ec6fcd8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.735045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] RBAC: Authorizing `identity:get_project(project_id=6c8d96b0623744b2b02923664ec6fcd8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.736482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.738335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 167/333] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/projects/6c8d96b0623744b2b02923664ec6fcd8 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:12.743553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.747092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:12.748793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510498-3f4f-4fb4-9a8d-e5c63899d82d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.785131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.785721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.786003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.786269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.786981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] RBAC: Adding query filter params (group.id=0bb7fee7f2a24ac7b764730d0935b64f, role.id=e836d7d42e2b405ea81e90a304bcb4ff, scope.project.id=8c9cca9cb84d41f48552d18541fe74f0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:12.787282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.788702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.794722 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 167/334] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/role_assignments?group.id=0bb7fee7f2a24ac7b764730d0935b64f&scope.project.id=8c9cca9cb84d41f48552d18541fe74f0&role.id=e836d7d42e2b405ea81e90a304bcb4ff => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:12.845976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f5557-dd23-4d79-b929-179d22e7ace3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:12.882143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:12.882782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:12.883059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:12.883330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] PATH_INFO: `/v3/groups/556a9337740340fc8560a125973da804` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:12.884486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] RBAC: Authorizing `identity:get_group(group_id=556a9337740340fc8560a125973da804)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:12.885997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0008a4e-8cc8-41e3-b2a9-b3291f6f0235 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:12.888205 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 168/335] 10.222.0.78 () {56 vars in 1180 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/groups/556a9337740340fc8560a125973da804 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:12.894473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:12.989513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:13.002114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc26c6-f9c4-4c2e-bac3-58af86016e34 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:13.036832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:13.037467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:13.037748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:13.038025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:13.038742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] RBAC: Adding query filter params (group.id=556a9337740340fc8560a125973da804, role.id=eb5fc6b45679476182540fe032952925, scope.project.id=6c8d96b0623744b2b02923664ec6fcd8) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:13.039046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:13.040533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a3508-5fcd-44d3-9fd4-a38ae3808102 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:13.046826 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 168/336] 10.222.0.78 () {56 vars in 1376 bytes} [Tue Oct 18 15:46:12 2022] GET /identity/v3/role_assignments?group.id=556a9337740340fc8560a125973da804&scope.project.id=6c8d96b0623744b2b02923664ec6fcd8&role.id=eb5fc6b45679476182540fe032952925 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:15.583035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f89db-18a0-4458-9824-c283113322fb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:15.583891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f89db-18a0-4458-9824-c283113322fb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:15.584312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f89db-18a0-4458-9824-c283113322fb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:15.586223 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 169/337] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:15.592037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276f02-282b-4d0d-ac63-56d289076bba None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:15.592895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276f02-282b-4d0d-ac63-56d289076bba None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:15.593334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276f02-282b-4d0d-ac63-56d289076bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:15.623722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-92276f02-282b-4d0d-ac63-56d289076bba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:15.625224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92276f02-282b-4d0d-ac63-56d289076bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:15.711427 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 169/338] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:15.722949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911a80-ba95-40ca-a6bf-a915a6f66968 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:15.723551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911a80-ba95-40ca-a6bf-a915a6f66968 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:15.724121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7911a80-ba95-40ca-a6bf-a915a6f66968 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:15.725989 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 170/339] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:15.732163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:15.732442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:15.732975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:15.752043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:15.753271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:15.822988 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 170/340] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:16.156406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7911a80-ba95-40ca-a6bf-a915a6f66968 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.250521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.285501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7911a80-ba95-40ca-a6bf-a915a6f66968 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:16.303266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.323669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.367014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:16.367660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.367973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.368244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.385357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:16.387314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4b807fdd-935c-4854-b2ec-df4016e02afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:16.405387 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:16.406535 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:16.407588 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:16.407588 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:16.407588 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:16.413645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 171/341] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:16.416205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08abc-e1a0-4fec-888e-2e1b71d7590d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.416440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08abc-e1a0-4fec-888e-2e1b71d7590d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.416707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08abc-e1a0-4fec-888e-2e1b71d7590d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.418190 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 172/342] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:16.423187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d08abc-e1a0-4fec-888e-2e1b71d7590d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.443326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0440f-4d41-4a67-a0ee-2a578b9cc12a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:16.477375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:16.478304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.478571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.478843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.489988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:16.491420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-282d1f6b-c703-4e56-acef-4b0a1932ae57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:16.506341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:16.507223 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:16.508113 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:16.508113 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:16.508113 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:16.508113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 171/343] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:16.508588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.508864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.509154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.527840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:16.529137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:16.545544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d08abc-e1a0-4fec-888e-2e1b71d7590d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:16.571539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.583208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:16.583824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.584061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.584326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.584962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:16.585286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:16.586642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412706-faa5-4b0d-9ca5-3333b71d4e6d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:16.596229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.609927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 173/344] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:16.610113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 172/345] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:16.610201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e800827-49ea-43b1-af0f-e41b8c2cfe7a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.610201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e800827-49ea-43b1-af0f-e41b8c2cfe7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.610201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e800827-49ea-43b1-af0f-e41b8c2cfe7a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.613420 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 174/346] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:16.613921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.614144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e800827-49ea-43b1-af0f-e41b8c2cfe7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.724275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428547e3-2587-4dba-b700-c60a72d60a75 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:16.737203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e800827-49ea-43b1-af0f-e41b8c2cfe7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:16.760044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:16.760609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.760882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.761182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.762363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:16.762649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:16.764092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ceba5-70c2-49f3-87cc-b922ddc7c8c8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:16.780964 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 173/347] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:16.780964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.780964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.780964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.784930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:16.786492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:16.787882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:16.788378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:16.789329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:16.791007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:16.799393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:16.800563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:16.825268 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 175/348] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:16 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:16.828272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.903174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.917308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:16.925149 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 174/349] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:16.926182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:16.989515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d0347-2080-44e9-a1ae-d656d72d8a4c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.038100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.038744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.039131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.039921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.040668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.042557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.075846 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 176/350] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:16 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:17.113032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccea6aa-630c-462a-8577-db5f1ae0beff None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.154883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.155587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.155871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.156145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.167638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.169306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:17.186761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:17.187862 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:17.188763 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:17.188763 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:17.188763 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:17.188763 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 175/351] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:17.194877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:17.285145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:17.309417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:17.319342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5d5fe-b48b-4a6d-bd27-199523b00e40 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.347767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:17.368624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.369278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.369557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.369829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.370490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:17.370792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.372444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ac8f-45ae-498f-a9a8-55b0307c6c08 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.385753 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 177/352] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:17.388095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf3cd-b734-4e45-847b-fabf2650d414 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.388601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf3cd-b734-4e45-847b-fabf2650d414 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.389105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdf3cd-b734-4e45-847b-fabf2650d414 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.390820 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 178/353] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:17.392922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf3cd-b734-4e45-847b-fabf2650d414 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:17.428135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c200-dd33-4191-9458-30152f33bbe7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.473448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.474478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.474967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.475462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.490201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.492132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-38062439-b9da-4be2-a9e8-19c881f0ab04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:17.513496 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:17.514481 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:17.515298 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:17.515298 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:17.515298 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:17.515298 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 176/354] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:17.516268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.516542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.516806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.521417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdf3cd-b734-4e45-847b-fabf2650d414 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.539092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:17.540616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:17.565260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.566368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.566866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.567423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.568792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.570533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.598812 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 179/355] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:17 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:17.600573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:17.619731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:17.635256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 177/356] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:17.721988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb3ed-6314-4a23-b1f9-c9f4018286d5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.763214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.764192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.764705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.765187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.766068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:17.766620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.768233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.783308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 180/357] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:17.789152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:17.815664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:17.911518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5cc2a-4bf9-41ee-9bfd-e2eb794cd8ae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:17.949446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:17.950150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:17.950426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:17.950697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:17.951339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:17.952764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:17.977170 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 178/358] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:17 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:46:18.000598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:18.087880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:18.123901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1659bc-6934-4822-8bc0-e970fbcaab24 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:18.162792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:18.163413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:18.163692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:18.163963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:18.164639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:18.166032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:18.175693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 15:46:18.175693 n-d-858383-14 devstack@keystone.service[81776]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 15:46:18.175693 n-d-858383-14 devstack@keystone.service[81776]: [parameters: {'id': '9dea56a7a1954c54b00fc580c0e20c7e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 15:46:18.175693 n-d-858383-14 devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Oct 18 15:46:18.192861 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return ref.to_dict() Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:46:18.193804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 15:46:18.194712 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:46:18.195533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:46:18.196361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:46:18.198667 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'id': '9dea56a7a1954c54b00fc580c0e20c7e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:18.204434 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 15:46:18.207454 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:18.212002 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 181/359] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 18 15:46:17 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:18.212166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:18.290837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:18.320236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ac94-a5fc-42fa-b0a0-a81aca319553 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:18.360736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:18.361484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:18.361810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:18.362086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:18.374060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-184a4007-a630-4fe7-82af-77e86f408b87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:18.379516 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:18.380407 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:18.381327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 179/360] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:18.387599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:18.496887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b7978-0c36-467e-9a67-8f13930e6a8e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:18.536472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:18.537148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:18.537427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:18.537699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:18.538390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:18.538692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:18.540121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40f503-953e-42b3-b72c-d7d22b999a6c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:18.542571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:18.554977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 182/361] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:19.522411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa4bd-ec37-412b-9002-cd9fe79b84aa None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:19.522411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa4bd-ec37-412b-9002-cd9fe79b84aa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:19.522411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa4bd-ec37-412b-9002-cd9fe79b84aa None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:19.523592 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 180/362] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:19.528739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906001a9-3ecd-4fab-9a29-5f06422a34f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:19.529247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906001a9-3ecd-4fab-9a29-5f06422a34f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:19.529395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906001a9-3ecd-4fab-9a29-5f06422a34f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:19.558445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-906001a9-3ecd-4fab-9a29-5f06422a34f9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:19.559674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-906001a9-3ecd-4fab-9a29-5f06422a34f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:19.657322 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 183/363] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:19.859025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b166fe-6850-4818-b013-b3556bf9e092 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:19.859409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b166fe-6850-4818-b013-b3556bf9e092 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:19.859585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b166fe-6850-4818-b013-b3556bf9e092 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:19.861156 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 181/364] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:19.866150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:19.866430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:19.866701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:19.893946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:19.895124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:19.991549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 184/365] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:20.130505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b166fe-6850-4818-b013-b3556bf9e092 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.264557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b166fe-6850-4818-b013-b3556bf9e092 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:20.307003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:20.307634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.307909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.308250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.313935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:20.323183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:20.329036 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:20.329895 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:20.330663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 182/366] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:20.335990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.351477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.453741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:20.530040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2c08-c689-492d-b375-6c8b767a230b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:20.540787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed188-e4b0-45c3-b9a6-f5e0710ce5b9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:20.573575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:20.575455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.576883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.577647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.578775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:20.579648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:20.581811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65591c-c68b-4fcc-98ec-08c899f2ae0c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:20.584453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:20.585522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.585803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.586073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.593363 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 185/367] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:20.595575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa616-cafa-479c-bdfc-fd3296eb0d57 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.596058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa616-cafa-479c-bdfc-fd3296eb0d57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.596533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfa616-cafa-479c-bdfc-fd3296eb0d57 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.598006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:20.602547 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 186/368] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-890e6714-9cd3-4f2f-b710-cf86058d4106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:20.602967 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:20.603867 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:20.604656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 183/369] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:20.605668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.606343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.606343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.607262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa616-cafa-479c-bdfc-fd3296eb0d57 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.629824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:20.631536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:20.696817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:20.728072 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 184/370] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:20.728072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.764267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfa616-cafa-479c-bdfc-fd3296eb0d57 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:20.809011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:20.836630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:20.837296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.837570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.837839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.853127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:20.854638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-eba21d4e-7c40-4971-a3eb-3ecc0cd2909f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:20.885758 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:20.886775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:20.887765 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:20.887765 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:20.887765 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:20.889142 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 187/371] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:20.890562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f15b-ba13-48b7-b645-2aa335224302 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.891030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f15b-ba13-48b7-b645-2aa335224302 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.891487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827f15b-ba13-48b7-b645-2aa335224302 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.893166 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 188/372] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:20.894030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827f15b-ba13-48b7-b645-2aa335224302 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:20.914146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4d29-ff9c-4c7c-a2f6-98e833044328 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:20.954081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:20.954687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.954960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.955223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.955988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:20.956286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:20.957674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144c810-1ae7-4cb4-a142-6a5f811cc60e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:20.971708 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 185/373] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:20.973131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:20.973529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:20.973783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:20.994046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:20.995084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:21.028982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827f15b-ba13-48b7-b645-2aa335224302 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.047502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.071148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.071753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.072027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.072252 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 186/374] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:21.072350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.073099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.074526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:21.074909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.076431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.092273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 189/375] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:21.093794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.137035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.182414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a97a-ea2b-43ac-b732-e377a96bdbf5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.221686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5543-3c80-4f9f-9083-118541fd051d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.234401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.235172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.235486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.235851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.250591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.252293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.265970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.266622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.266896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.267162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:21.272154 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.273176 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:21.274048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:21.274048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:21.274048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:21.276352 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 187/376] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.277664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.279902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:21.286803 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.287746 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:21.288543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 190/377] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.289240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.319115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.393607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdd671-acc4-41a5-9c6e-89173056d69a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.403753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.413467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012939d-2f80-4743-9a0a-055627c374ca None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.428247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.428868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.429209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.429483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.437250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.438690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.446600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.447198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.447472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.447735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.448371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:21.448667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.450729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:21.452181 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.453227 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:21.454145 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 188/378] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.454696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.466074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 191/379] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:21.466907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.549021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.560626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac354a4-d823-44ba-877e-dd478d4bb3c3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.567292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c4779-e2a2-4e68-947c-aaa2bdd3ad9c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.594680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.595313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.595625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.595898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.596593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:21.596910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.598359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742dd199-4ed1-47c4-ae74-032d9d859a06 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.601586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.602208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.602481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.602747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.606581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 189/380] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:21.608054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237e1e-d498-4991-8ae2-70696284b8c3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.608346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237e1e-d498-4991-8ae2-70696284b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.608627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76237e1e-d498-4991-8ae2-70696284b8c3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.609920 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 190/381] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:21.610640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76237e1e-d498-4991-8ae2-70696284b8c3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.619465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:21.624957 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.626072 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 192/382] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.629916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.644446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.713734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76237e1e-d498-4991-8ae2-70696284b8c3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.729193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e28e-a841-4f96-a9a1-e6bbe5b442b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.747567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.748188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.748498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.748795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.749674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:21.750957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.752490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59b92a-e33e-4df2-b261-267482e628da None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.764143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.764768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.765070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.765340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.772200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.773675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:21.787229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.788210 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 193/383] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.789494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.790126 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 191/384] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:21.791284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.791649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.791833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.809765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:21.810917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:21.814525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.866253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:21.878860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 192/385] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:21.879757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:21.897325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eba481-c9f1-4014-9c73-b77d7b84837f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:21.934400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:21.935033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:21.935311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:21.935582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:21.950192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:21.951844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:21.966184 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:21.967239 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:21.968315 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:21.968315 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:21.968315 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:21.968315 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 194/386] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:21.968315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.007139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a2f7a-6d7a-4f05-a76e-0c31b7a56374 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.043954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.044553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.044820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.045112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.045769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.046062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.047431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.056465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 193/387] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.057079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.060370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.081822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ece60-1a63-4a99-9a6c-23963f03b2a6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.106930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.118924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.119659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.120041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.120427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.121820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.122126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.123645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.161544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 195/388] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 18 15:46:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.162370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.169916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea491d4-5a56-46ce-a2e6-71cf19b3ad75 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.202115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.202729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.203003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.203275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.213506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.215733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:22.229517 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:22.231104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:22.232203 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:22.232203 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.232203 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:22.232203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 194/389] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:22.232203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.264091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ccc8f-ea9e-46f4-87ef-bcd59facec9f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.285004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.297880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.298485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.298757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.299022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.299657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.299957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.301341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.312412 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 196/390] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.313160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.330655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a05d-4033-4477-bd2f-b5f36fa2a072 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.355610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.365185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.365806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.366081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.366351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.376617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.378119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:22.392677 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:22.393749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:22.394621 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:22.394621 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.394621 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:22.394621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 195/391] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:22.394621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.416327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530eab6-d982-4e89-b976-aeec00555f16 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.450633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.451261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.451537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.451805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.462778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.464976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:22.478972 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:22.479866 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:22.480764 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:22.480764 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.480764 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:22.480764 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 197/392] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:22.480982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.497235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10b6ee-3374-4408-877e-7d33750670f8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.504520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.531753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.532369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.532643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.532907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.543420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.544918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:22.559167 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:22.560523 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:22.561607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:22.561607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:22.561607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:22.561607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 196/393] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:22.561607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.576822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.583668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9903c-da03-466b-ac58-14cd1c50f52e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.618303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.618912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.619190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.619462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.620126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.620427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.622446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.633543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 198/394] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.634341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.662660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e7591-cf1a-4de9-b3e3-18003bd46418 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.696889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.697536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.697811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.698086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.704942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.706412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:22.717946 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:22.718823 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 197/395] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:22.719730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.736310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9e08f-c565-4f2c-bb2b-3adafec570b4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.739572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.771333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.771937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.772213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.772484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.773232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.773533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.774891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.785896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 199/396] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.786682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.806254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.820729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197b32d-8ca1-457a-92d0-fbfb20ba7e5b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.853872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.854466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.854742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.855632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.856340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.856639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.858299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.869640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 198/397] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.870512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.891537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a753f-9691-4e3b-ac83-de932235ef47 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:22.925829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:22.926438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:22.926714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:22.926988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:22.927626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:22.927927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:22.929760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:22.941448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 200/398] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:22.942343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:22.951539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:22.974533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f71c01-95f9-49e0-b130-aa04b487045a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.007622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.008238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.008515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.008784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.015502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.015643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.017518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:23.030285 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:23.031125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:23.031964 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 199/399] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:23.032427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.043869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08684-5cbe-4113-8897-9569fb9e2ca7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.078053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.078657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.078932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.079207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.079936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:23.080237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.081685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.102628 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 201/400] 10.222.0.78 () {56 vars in 1139 bytes} [Tue Oct 18 15:46:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:23.102628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.137989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33454-b39d-4e5b-b6e7-8cd9751a029e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.170869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.171569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.171905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.172233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.179439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.180954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.182669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:23.192770 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:23.193705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:23.194559 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 200/401] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:23.195142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.203599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf2d98-2509-4ffe-9ee9-c6f188bec38c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.232812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.238436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.239037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.239312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.239579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.240217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.241660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.263524 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 202/402] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:23 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:23.264330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.309120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046006ed-08fb-40ab-9197-4abc62478f27 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.347074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.347710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.347987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.348259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.356650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.358436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:23.370938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:23.371950 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:23.372769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 201/403] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:23.373707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.394069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060d953-630e-4b31-9ac2-48403c6b3bf8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.431358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.431977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.432252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.432851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.433364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:23.434455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.435904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.444060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.457462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 203/404] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:23.458126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.497065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a8caa-5c5a-4692-b77e-97d06e50881e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.511374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.534767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.535669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.535947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.536216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.547872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.549720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:23.570972 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:23.572405 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:23.573308 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:23.573308 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:23.573308 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:23.573308 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 202/405] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:23.573308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.586678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0227f-4773-42e8-9840-0832ca67a51c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.624963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.625604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.625882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.626151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.626885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:23.627186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.628641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.648199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 204/406] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:23.648741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.693991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82797c80-6c40-48f8-95d8-7cc375ed0daf None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.704777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.734678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.735282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.735556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.735828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.736504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:23.736802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.738264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.764863 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 203/407] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:23.764863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.785648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307111-127f-4fa6-97a2-f5429304181b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.795669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:23.832441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.833490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.834068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.834225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.849925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=437b718c34ab4dba9fe29716caaf2841, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.851769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.872232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 205/408] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:23 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:23.872232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:23.908765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787e52b-0009-437e-985b-289ba8c65e92 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:23.968352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:23.969266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:23.969640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:23.970007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:23.970785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:23.971737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:23.973376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:23.990043 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 204/409] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:23.990856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.007491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bad12-6198-4c52-951f-3373bb46739f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.033711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.069810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.070908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.071489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.071964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.085885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.087836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:24.107162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:24.108620 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:24.109900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:24.109900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:24.109900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:24.111403 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 206/410] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:24.112727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.129400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.160359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a25e3-e639-47b7-9df6-d4d2585259aa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.213467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.214541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.215052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.215499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/dd3b359a6c724c67853394a3a8481995/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.239544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=dd3b359a6c724c67853394a3a8481995, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.241632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.259901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82613ab-c4a2-4d73-b05d-884a1c10648f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.261535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 205/411] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:23 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/dd3b359a6c724c67853394a3a8481995/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:24.262535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.333417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.334354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.334731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.335114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.354429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.356288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:24.378175 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:24.379317 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:24.380377 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:24.381859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 207/412] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:24.384209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.389530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.412767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8231-3c82-43d8-aa23-5a9d50b563c7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.462793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.463861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.464160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.465113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.465670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:24.465975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.467386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.485876 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 206/413] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:24.495598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.569798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.612027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791898e6-c84f-4e5d-8ffa-c05ada960e75 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.624947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599143e-9147-4d81-9bcb-a84cbb54c099 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.652416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.653112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.653396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.654014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.654727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:24.655034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.656646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.671387 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 208/414] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:24.677200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.688934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.689623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.689904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.690171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.703949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.705461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.709127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:24.720501 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:24.721442 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:24.722282 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 207/415] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:24.730711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:24.877155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69788496-5bc0-4117-a4c9-72c29355f39b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.919928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218929a-9ea8-4c12-b4c0-5450d895db3d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:24.931732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:24.944344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.944602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.944844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.945142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/d8cba31795664092a61c6176852b8481/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.973687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=d8cba31795664092a61c6176852b8481, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.975110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:24.991719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:24.992334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:24.992611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:24.992883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:24.993606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:24.993910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:24.995347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86914b7-7519-4ec0-83d3-454ea17821d4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:25.001658 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 209/416] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:24 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/d8cba31795664092a61c6176852b8481/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 15:46:25.019918 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 208/417] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:25.025752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:25.171171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80f1a-f3ed-464b-ad9e-46b7f171123e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:25.219397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:25.219981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:25.220256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:25.220529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/5cdf82dd7b714a26a2c4f396ca0b20be/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:25.241262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=5cdf82dd7b714a26a2c4f396ca0b20be, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:25.242734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f78572-a7bb-492a-aedb-1273c9ab4d2a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:25.258073 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 210/418] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:25 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/5cdf82dd7b714a26a2c4f396ca0b20be/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:25.780778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b5e52-52f3-4b35-bb51-b06c8d1daba3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:25.781318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b5e52-52f3-4b35-bb51-b06c8d1daba3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:25.781318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b5e52-52f3-4b35-bb51-b06c8d1daba3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:25.782948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 209/419] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:25.788221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:25.788632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:25.788799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:25.815186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:25.816429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:25.843990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:25.907430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 211/420] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:26.237437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b5e52-52f3-4b35-bb51-b06c8d1daba3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:26.313179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:26.362605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b5e52-52f3-4b35-bb51-b06c8d1daba3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:26.397987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:26.398627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:26.398903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:26.399171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:26.409890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fe3c155b-4a8f-4cbe-82a2-b7c2cb50dede None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:26.415135 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:26.416029 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:26.416807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 210/421] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:26.426107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:26.441519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc3c5-ab1b-48ad-beca-de19b0fa018b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:26.441804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc3c5-ab1b-48ad-beca-de19b0fa018b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:26.442062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafc3c5-ab1b-48ad-beca-de19b0fa018b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:26.443425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 211/422] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:26.448380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:26.449219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:26.449608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:26.468287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:26.469501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:26.582474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 212/423] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:46:26.630073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aeb97-d195-4437-bf40-3f38ba49fa21 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:26.684025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:26.684634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:26.684909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:26.685201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:26.685871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:26.686177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:26.687531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:26.700472 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 212/424] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:26.705642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:26.773350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:26.831418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec67455-ce4b-4fdc-8909-01cddb159717 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:26.873094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:26.873739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:26.874014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:26.874283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:26.884968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:26.886594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:26.893786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:26.908104 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:26.909100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:26.909936 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:26.909936 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:26.909936 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:26.909936 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 213/425] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:26.914819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:26.946229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.049487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6eb5a-5b63-4571-a522-d6f2869dda53 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.083837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.084466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.084741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.085018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.095865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:27.101310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:27.102190 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:27.102979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 213/426] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:27.110409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.137337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa128f4-f3bd-4d87-a3f9-d5f9bf9853cc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.138987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.175974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.176578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.176856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.177154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.177809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:27.178109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.179728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49921bd-19bc-4e61-b9ed-2dcdf3073de0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.197793 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 214/427] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:27.198179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.200221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ee4c-d032-4652-b19a-1adf9be2886a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.200898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ee4c-d032-4652-b19a-1adf9be2886a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.201524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94ee4c-d032-4652-b19a-1adf9be2886a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.204225 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 215/428] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:27.209058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ee4c-d032-4652-b19a-1adf9be2886a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.215267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba846df-1c02-44e0-95e5-aae7dbab6965 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.250918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.251758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.252180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.252642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.253496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:27.253941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.255584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f4799-3bb7-4b6b-a7c5-519507f4d7e0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.266546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 214/429] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:27.267554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.267836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.268110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.292339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:27.294188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:27.329588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94ee4c-d032-4652-b19a-1adf9be2886a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.368425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.369258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.369542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.369871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.378518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.379972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.381673 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 215/430] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:27.382585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:27.405615 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:27.406542 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:27.408078 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 216/431] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:27.418488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.460839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.462492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.500130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a43f53-2272-41d2-87e5-3f6a9ca0570b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.538894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.539775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.540196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.540629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.552934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.554655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:27.573269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:27.574579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:27.575501 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:27.575501 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:27.575501 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:27.581387 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 216/432] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:27.582991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.622101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1c837-df42-445d-b242-e000841c5fe3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.694892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af578-794c-4f87-b182-ed877237bc28 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.701107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.701715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.701985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.702250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.702968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:27.703266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.704689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.725389 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 217/433] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:27.734064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.736092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.755116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.756090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.756590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.757086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.757927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:27.758424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.759996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.789738 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 217/434] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:27.793277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.895438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:27.906984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c635da-6731-46db-8b7c-7a5d59804530 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.951530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbe917-b1de-47b5-8dc2-0c63619ec46b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:27.954666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.955361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.955707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.956054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.967548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.968717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:27.983995 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:27.984932 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:27.986024 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:27.986024 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:27.986024 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:27.986024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 218/435] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:27.986243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:27.988328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:27.988951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:27.989570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:27.989676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:27.997195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:27.998620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bb702d4c-5c82-4c05-9af3-bfaf53663ce9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:28.010228 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:28.011711 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:28.012721 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 218/436] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:28.013320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63d5a-1c19-49ee-953f-293ee90add1b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.013320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63d5a-1c19-49ee-953f-293ee90add1b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.013869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b63d5a-1c19-49ee-953f-293ee90add1b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.014771 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 219/437] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:28.015750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327aba8-bad9-4565-804a-d8fd1d5aaed7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.016031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327aba8-bad9-4565-804a-d8fd1d5aaed7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.016307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327aba8-bad9-4565-804a-d8fd1d5aaed7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.017889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 220/438] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:28.018510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327aba8-bad9-4565-804a-d8fd1d5aaed7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.067221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.090499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085c09-ab29-4d64-8c99-d5cd9bdf2de7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.119470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.123493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327aba8-bad9-4565-804a-d8fd1d5aaed7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.125241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.125868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.126147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.126417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.136730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:28.142000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:28.142875 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:28.143647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 219/439] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:28.144375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.163124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.163726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.164005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.164277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.164944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:28.165308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.166730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda06d75-1236-476b-b517-5a51d57f6bf8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.179166 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 221/440] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:28.180216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bfda5-eb70-4445-a9ca-e650d680968a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.180508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bfda5-eb70-4445-a9ca-e650d680968a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.180791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bfda5-eb70-4445-a9ca-e650d680968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.197860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-989bfda5-eb70-4445-a9ca-e650d680968a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:28.199081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-989bfda5-eb70-4445-a9ca-e650d680968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:28.242066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a41d21-defe-4f72-9fca-7219ad64d930 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.264847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 222/441] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:28.266392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976652b-795e-4928-93a3-26943e2517fb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.266676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976652b-795e-4928-93a3-26943e2517fb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.266945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976652b-795e-4928-93a3-26943e2517fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.277518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.278124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.278394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.278668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.279437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:28.279740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.281204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.289467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c976652b-795e-4928-93a3-26943e2517fb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:28.290659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c976652b-795e-4928-93a3-26943e2517fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:28.300718 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 220/442] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:28.305932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.320275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.356680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.373083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 223/443] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:28.373083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976652b-795e-4928-93a3-26943e2517fb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.437564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00e1e-e7ff-4311-9495-98cad05e4b95 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.475867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.476095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976652b-795e-4928-93a3-26943e2517fb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.476467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.476743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.477026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.477689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:28.477987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.479357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.492403 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 221/444] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:28.493231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.516923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.517585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.518028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.518304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.527379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.528968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:28.541330 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:28.542881 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:28.543893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 224/445] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:28.544358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.571197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.601774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27c17-a9dd-4e49-8a80-01abad724954 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.620456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.650103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.650703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.650977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.651242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.652379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fed20-a05a-4413-b4b0-4ca29e9e6cf1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.691062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.691690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.691968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.692268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.702620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.704048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:28.718006 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:28.719046 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:28.720057 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:28.720057 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:28.720057 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:28.720057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 225/446] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:28.720057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.721463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.724017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.795947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.819012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c50e4e-dc53-4aed-887b-7d11418556f6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.824717 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 222/447] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:28.825576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.840074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:28.852846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.853495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.853774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.854041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.864815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:28.870049 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:28.871167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 226/448] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:28.872133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:28.929090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd73645-7251-45fb-a3ef-4e214d421e82 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.966690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:28.967289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:28.967564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:28.967831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:28.968509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:28.968810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:28.970280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:28.972748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56a9e-7513-47ed-adff-10d838e056b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:28.984010 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 223/449] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:28.985213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.007009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.007630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.007908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.008178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.010744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.019063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:29.024283 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:29.025441 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:29.026331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 227/450] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:29.027856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.057209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.086733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6519e-9d80-405d-b8e1-d3edfda59d8f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.121262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.121880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.122152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.122442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.123066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:29.123360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.124735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.127414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f9c9e-7a96-4108-9139-2605e25dc798 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.136452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 224/451] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:29.137264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.161421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.162031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.162310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.162573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.173426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.174862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:29.188697 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:29.189797 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:29.190632 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:29.190632 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.190632 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:29.190632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 228/452] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:29.190632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.238142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd7186-c240-4cc1-a2a0-c3ef2c56905c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.241836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.266946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.272241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.272833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.273140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.273410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.274063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:29.274360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.275710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.283798 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 225/453] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:29.284489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.298781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040b30-6a22-453f-9844-2f97c6c4af03 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.332596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.333212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.333485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.333745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/8f98d1b53918419bad2040f49ad08092/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.347741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=8f98d1b53918419bad2040f49ad08092, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.349193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.362144 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 229/454] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:29 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/8f98d1b53918419bad2040f49ad08092/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:29.362942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.398001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f518-67c9-49df-a9ce-33b126aa8dc7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.440192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.440804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.441117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.441389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.442067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:29.442370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.443802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.453508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 226/455] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:29.454373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.481178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.486470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be165-aeb1-4eed-a5d9-d9647917e290 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.525855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.529960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.530600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.530872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.531141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.539785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.541232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:29.557707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:29.559011 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 230/456] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:29.560285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.579010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb04f-494e-4a77-bf4d-bdfb1fe7297b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.616687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.617560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.617858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.618165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.619032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:29.619441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.621388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.634518 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 227/457] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:29.635332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.670361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50624b70-81d3-4d0d-b580-baf17d83be83 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.705212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.705844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.706140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.706404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.719711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.721202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:29.737472 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:29.738417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:29.739266 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:29.739266 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.739266 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:29.739266 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 231/458] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:29.739475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.750635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc8ebe-01d4-4240-927f-267fb0d19d0c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.757290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.769654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:29.789252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.789873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.790223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.790490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.801379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.802939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:29.818634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:29.819701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:29.820554 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:29.820554 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:29.820554 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:29.824385 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 228/459] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:29.825262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.853160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b2b42-3afe-4c41-baeb-19e72d6c754a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.890890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.891443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.891718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.892007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.892800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:29.893154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.894604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.918303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 232/460] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:29.918303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:29.942531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abf3f-3678-4f38-98f8-1d257b0436d0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:29.980245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:29.980950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:29.981255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:29.981526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:29.988568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:29.990058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:29.992442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:30.001840 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:30.002731 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:30.003578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 229/461] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:30.004668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.033222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.033938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512b278-f180-4dc1-bb87-91d0e4a3a5e3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.071841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.072452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.072728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.073023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.074195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:30.074494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.075864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.091782 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 233/462] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:30.091782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.120034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957275ea-e643-4aa4-90a8-34be16f5b5e8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.156221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.156750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.157052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.157318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.157956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:30.158256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.159616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.172311 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 230/463] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:30.173222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.201442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537b59d-23ea-4341-b0f5-310d9f0a95e5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.231446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.240421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.241073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.241354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.241630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.265457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.280197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af762e-df5d-48a3-b05f-4c8a7fdb7474 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.317295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.318729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.319584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.320182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.320462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.320728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.321442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:30.321741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.323142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.335605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 231/464] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:30.341780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.430144 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 234/465] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:30.431209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.446651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958bd58-af87-41b5-bdef-ed341da0f910 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.464247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.482645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.483318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.483608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.483884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.492605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.494117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:30.506601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:30.507680 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:46:30.508849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:30.512836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 232/466] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:30.513720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.524532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.549875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628115d6-268b-444d-b5dd-92273af174cc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.590077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.590704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.590976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.591299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.598595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.600017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:30.613198 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:30.614121 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:30.615044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 235/467] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:30.615585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.629634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae694a5-6ae9-431a-8226-286566db0ec0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.664343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.665078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.665352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.665723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.666434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=437b718c34ab4dba9fe29716caaf2841) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:30.666734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.668505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.675118 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 233/468] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/role_assignments?user.id=437b718c34ab4dba9fe29716caaf2841&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:30.675989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.730068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.747423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e616c3f-5cd9-4358-bd44-984191770d6e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.760311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:30.790688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.791327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.791783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.792713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.797953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bea45-cf67-4003-9057-f112e5a738e4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:30.806641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.808580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:30.827591 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:30.828568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:30.830086 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:30.830086 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:30.830086 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:30.830086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 236/469] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:30.830086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.842059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:30.843081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:30.843576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:30.844102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:30.845063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:30.845561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:30.847291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:30.867155 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 234/470] 10.222.0.78 () {56 vars in 1137 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:30.868358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:30.960794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eab6-ba74-458f-9c13-c00a70084ce2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.007618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.008251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82c9d-8e2a-42a5-825b-8d8958db15b3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.009557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.011490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.012226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.013200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:31.013727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.015348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.027447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.039291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.045174 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 237/471] 10.222.0.78 () {56 vars in 1139 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:31.046980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.050034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.050713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.050907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.051173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.051807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:31.052102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.053531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.065986 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 235/472] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:31.066884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.167897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b1c1-1151-4ce9-a2f7-5b346c1f4720 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.171340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808b1c-38a3-452a-adcc-5c44668b0f75 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.206698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.207297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.207569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.207895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.209439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.210264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.210738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.211177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.275114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.284098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.285855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.287898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.290464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.291981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.407243 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 236/473] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:31.408443 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 238/474] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:31.408722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.414040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.523923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.526885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.532404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8972b-5c73-455d-818a-43a16d0a0e59 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.538989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dcdf7-1e79-4551-844e-b37f6c24a099 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.570238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.571144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.571510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.571869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.584225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.585904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.586062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.586999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.587515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.587926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.597281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.598752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:31.602207 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:31.603093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:31.603943 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:31.603943 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:31.603943 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:31.609281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 239/475] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:31.610142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c86d80c2-c4ae-46e1-802e-2ef12e3cba8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:31.611917 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:31.612749 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 237/476] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be21d-46d9-43d3-822d-c256f9f881d6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.620953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be21d-46d9-43d3-822d-c256f9f881d6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.621670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5be21d-46d9-43d3-822d-c256f9f881d6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.621670 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 238/477] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:31.621670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be21d-46d9-43d3-822d-c256f9f881d6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.719535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69ffc9-a32c-4f90-80fb-200319656e89 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.741594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5be21d-46d9-43d3-822d-c256f9f881d6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.770136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.770890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.771238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.771578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.780117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.780863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.781175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.781440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.782062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:31.782353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.783690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.783841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.785340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.801682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 239/478] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:31.801682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-44fea9b5-ee53-4045-bc2d-35cea17ddc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:31.801912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:31.802744 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:31.803582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:31.803582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:31.803582 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:31.803582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 240/479] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:31.804503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.804783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.805223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.811972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.820245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:31.824981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:31.826279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:31.898138 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 241/480] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:31.899370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:31.925683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d7a58-0b35-41d9-bcb0-138e80f411d1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:31.973575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:31.974215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:31.974490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:31.974757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:31.975548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:31.975914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:31.977671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:31.991474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 240/481] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:31.997864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.028772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ae321-72ac-4179-9fed-c9d1bd331f1f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.063538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.070414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.071398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.071868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.072349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.074110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.084116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.086525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:32.100899 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:32.101789 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:32.102615 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:32.110277 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 242/482] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:32.110277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.116845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ca155-63e4-4d11-85f6-de7eb47ccb4a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.153987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.154925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.155397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.155881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.156833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.157364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.159143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.172318 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 241/483] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.173544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.218015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81142918-b7a7-4539-afe7-265e61d92307 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.254142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.254772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.255040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.255359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.256091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=dd3b359a6c724c67853394a3a8481995) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.256418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.257920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.269760 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 243/484] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/role_assignments?user.id=dd3b359a6c724c67853394a3a8481995&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.269760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.313253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83604b2b-18ff-41fb-81e9-1a5dba8b744e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.349200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.356241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.364675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.365367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.365643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.365913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.366941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.367252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.368751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.389167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 242/485] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.390350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.424012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fcece-513c-4911-99eb-bcdbd0534a75 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.462967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.463644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.463955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.464226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.471318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.472764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:32.485342 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:32.486286 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:32.487135 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:32.487549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 244/486] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:32.488175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.511555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059b775-d1ba-4fc2-95e3-219266909c8d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.555990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.556960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.557473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.558031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.569914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:32.575214 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:32.576311 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:32.577275 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:32.578357 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 243/487] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:32.579200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.615357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e49f59-8200-47d7-bd07-b593a79f5151 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.637418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.653334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:32.658226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.659085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.659612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.660399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.661873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=d8cba31795664092a61c6176852b8481) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.662657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.664512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.672112 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 245/488] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/role_assignments?user.id=d8cba31795664092a61c6176852b8481&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.673242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.740417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08496-787f-4541-bfb2-8a6a4b7c204d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.819912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.820917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.821495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.822503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.824409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.825243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.828584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.854095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 244/489] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.860344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.892091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acebbf6-aae6-4b58-b87c-b9f92e617a60 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:32.935220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:32.935845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.936124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.936392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.938406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:32.938406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:32.940433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26b0c-fe5d-42d1-9b08-639e6386e7d8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:32.948547 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 246/490] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:32.949902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf6ca-8f63-490b-af8f-d2f75eed07bf None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:32.950194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf6ca-8f63-490b-af8f-d2f75eed07bf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:32.950465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf6ca-8f63-490b-af8f-d2f75eed07bf None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:32.952017 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 247/491] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:32.956431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf6ca-8f63-490b-af8f-d2f75eed07bf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:32.986545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224926e2-1e1b-40cb-9e46-ccd47beb5318 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.000697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.011404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.027292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.028219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.028716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.029198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.030104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=5cdf82dd7b714a26a2c4f396ca0b20be) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:33.030600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:33.032196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bde702-9b3f-4d33-8e89-31e4a901e3f1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:33.038686 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 245/492] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/role_assignments?user.id=5cdf82dd7b714a26a2c4f396ca0b20be&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:33.044527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.045403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.045872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.077893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf6ca-8f63-490b-af8f-d2f75eed07bf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.079978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:33.083236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:33.129490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.130104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.130377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.130642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.143125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:33.144507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:33.169654 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:33.170627 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:33.172123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:33.172123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:33.172123 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:33.172123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 248/493] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:33.172123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.210669 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 246/494] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:33.317664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.326260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b8f-6595-44c2-9a86-926526f9b020 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.363880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.364556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.364829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.365126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.365781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:33.366074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:33.367453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:33.380691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 249/495] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:33.386413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.491761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444283b1-1d32-417e-bc20-3acc1d395262 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.494010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.537775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.538443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.538719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.538984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.550658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:33.552112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:33.568251 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:33.569196 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:33.570199 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 247/496] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:33.575274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.616908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.696225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab9c79-9291-4ee3-9b6a-b07a9b7c9221 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.730952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.731556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.731870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.732399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.733158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:33.733453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:33.734850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:33.762553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 250/497] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:33.770031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.801364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:33.818471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dad25f-49cc-4d63-94ac-e7a15869f4fc None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.880980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:33.882603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:33.882882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:33.883152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:33.907457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:33.913125 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:33.914025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:33.914902 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 248/498] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:33.923646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:33.962475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5a691-bcd2-4ff2-b659-e6a42df0e33a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:33.978946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.028529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.029083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.029598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.029871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.133301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff7103-e822-44e3-803c-726bc62693b6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:34.164192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.165692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.185970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.208050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.209057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.209533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.209994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.210855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:34.211365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.212918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.233666 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 249/499] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:34.245475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.354652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 251/500] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 15:46:34.362054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.410919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.440156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e188ff-a971-4c31-83d7-8fa63f503f42 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:34.505583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.506230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.506505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.506770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.529809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.531260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.543431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98466-301e-4128-915b-a978826717e5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:34.551934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:34.553722 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:34.554850 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:34.554850 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:34.554850 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:34.554850 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 250/501] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:34.558851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.574375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.621271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.621828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.622102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.622365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.641661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.643107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:34.672162 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:34.673231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:34.674107 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:34.674107 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:34.674107 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:34.678395 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 252/502] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:34.679237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.723111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7be1e-095d-4a27-bacd-b75cf35942de None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:34.801518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.802119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.802393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.802660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.803296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:34.803592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.804950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.820046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.830782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 251/503] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:34.838224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.868841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731f283-cced-42e9-b6ef-5b5b8ac51641 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:34.910702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:34.911272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.911547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.911810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.912450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:34.912746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:34.914153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0ce5-b7de-41ea-9207-dc9bb37a9a1a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:34.927054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 253/504] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:34.928277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db31f4-ae2e-4311-be26-5cd36b771861 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:34.928554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db31f4-ae2e-4311-be26-5cd36b771861 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:34.928816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db31f4-ae2e-4311-be26-5cd36b771861 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:34.941334 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 254/505] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:34.942358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db31f4-ae2e-4311-be26-5cd36b771861 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:34.972765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:34.979407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0dbe2-3df6-43d1-a44b-96aca2165099 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.025648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.026840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.027374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.027874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.036473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.038311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-01b9589c-88ed-4709-ad85-439284fabfb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:35.051224 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:35.052297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:35.053247 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:35.060645 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 252/506] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:35.062490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53922090-1240-43d0-a353-173493ac55ac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.063030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53922090-1240-43d0-a353-173493ac55ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.063554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53922090-1240-43d0-a353-173493ac55ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.070430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db31f4-ae2e-4311-be26-5cd36b771861 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.084176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-53922090-1240-43d0-a353-173493ac55ac None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:35.085777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53922090-1240-43d0-a353-173493ac55ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:35.112602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.113373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.113648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.113928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.123275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.126272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:35.140405 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:35.141361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:35.142253 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 255/507] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:35.142741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.150158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.169242 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 253/508] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:35.169242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fe20-1c99-476c-bd1a-14ae3088a996 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.169242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fe20-1c99-476c-bd1a-14ae3088a996 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.169242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7fe20-1c99-476c-bd1a-14ae3088a996 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.170730 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 254/509] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:35.171376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7fe20-1c99-476c-bd1a-14ae3088a996 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.237937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.256388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40592a2-f2cc-4a36-a81c-e6f93b28ab87 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.292962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.293576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.293857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.294129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.294857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:35.295159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.296584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f812b-1393-468e-a7b2-26d4a43c5394 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.316900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7fe20-1c99-476c-bd1a-14ae3088a996 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.319999 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 256/510] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:35.321170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.321459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.321733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.340339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:35.341559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:35.365531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.366692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.367437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.367912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.369604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:35.370177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.372796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.391247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 255/511] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:35.392298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.421940 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 257/512] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:35.423820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.445202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.509258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.530924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877888a-47a0-48fa-b211-a587eb47dac1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.546208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396468a8-6fac-4d1c-b3c6-215173a9b664 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.567155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.567782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.568058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.568331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.579843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.581353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.585440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.586364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.586840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.587309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.588358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=8f98d1b53918419bad2040f49ad08092) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:35.589421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.591273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:35.596701 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:35.597689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:35.598607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:35.598607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:35.598607 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:35.598607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 256/513] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:35.599265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.602426 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 258/514] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/role_assignments?user.id=8f98d1b53918419bad2040f49ad08092&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:35.603483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.789516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.793163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048a4ca-b7cf-4ee1-9176-4f94498bb0e7 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.800922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee570f-3db7-46b6-8423-89854a85bfd6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.831990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.832546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.832824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.833680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.845302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:35.845480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.845921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.846199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.846479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.846801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.847132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:35.847423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:35.848772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db207348-bae8-4ce1-9fd2-8bbf1ca712d4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:35.851238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:35.863341 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:35.864327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:35.865259 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:35.865259 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:35.865259 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:35.865259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 257/515] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:35.865606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.873044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 259/516] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:35.873044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5605-ceb9-4ed5-991a-4120bf599125 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:35.873044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5605-ceb9-4ed5-991a-4120bf599125 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:35.873044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5605-ceb9-4ed5-991a-4120bf599125 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:35.873793 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 260/517] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:35.874368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a5605-ceb9-4ed5-991a-4120bf599125 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:35.971180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d64105-ab77-4756-a2fc-73172a5156db None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:35.989666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a5605-ceb9-4ed5-991a-4120bf599125 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.008268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.008900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.009210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.009482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] PATH_INFO: `/v3/services/network` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.010065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.012063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:36.023479 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:36.024534 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:36.026028 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 258/518] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:36.026887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.033174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.033809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.034069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.034342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.034991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:36.035290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.036647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6f6b-b5e1-4134-86bb-04cf5e64864c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.044373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.050304 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 261/519] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:36.051715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.051998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.052271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.070574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:36.071759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:36.129257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.137425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4746-9201-4b0f-b4c5-74dcae03d281 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.147675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 262/520] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:36.148275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.187427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.188790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.189299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.189807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.200125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.202627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:36.216919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:36.218007 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:36.218903 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 259/521] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:36.219385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.272812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b62382-5d54-4c15-8418-d0ebed1eba55 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.302618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.323742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.324877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.325737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.326439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.327227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:36.327676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.328614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44ab2-c17b-47ad-8116-90526b9cccc6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.329430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.335984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 263/522] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:36.337594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.365426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.366170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.366543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.366906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.367704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.369328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.401641 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 260/523] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:46:36 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:36.403174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.422929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.495675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa67ba-4544-491a-90d9-f442dec4dbde None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.540501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.541428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.542080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.542698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.543954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:36.544437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.546073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.562827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 264/524] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:36.563912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.567755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f473a0-f267-4f1a-af2a-fca19c952b5a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.610950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.620659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.621021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.621420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.621827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.622526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] RBAC: Adding query filter params (type=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:36.624449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.626785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.635782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 261/525] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:36.639954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.712588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d9bbb-2047-488e-8fb4-ebc894ed2a83 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.727911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:36.762609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.763521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.764010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.764429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.765228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.765597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571676e0-cc6c-4012-9bd6-8e944533e69e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.766931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:36.785243 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:36.786612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:36.787653 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:36.790753 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 265/526] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:36.797672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:36.808946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.810310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.810310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.810730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.812911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=437b718c34ab4dba9fe29716caaf2841, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.814523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.839564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 262/527] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:36 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:36.913645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670f85c-c7ba-4bcf-b806-ac0e53abd35c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:36.954527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:36.955416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:36.955842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:36.956258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:36.957123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:36.957572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:36.959142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cf805-170a-4549-8b99-cc01e4e5b6b7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:36.964897 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 266/528] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:36.970963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:37.044026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:37.096403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7507a-1fa8-40a1-b396-b6497b415fdd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:37.144830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:37.145703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:37.146130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:37.146565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:37.147359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:37.147806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:37.149373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d462115-0550-41ac-ab53-5d7fd33a85dc None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:37.162661 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 263/529] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:37.944529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3f4c7-852c-4d2f-9856-fba0d9b9a06f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:37.945039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3f4c7-852c-4d2f-9856-fba0d9b9a06f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:37.945122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3f4c7-852c-4d2f-9856-fba0d9b9a06f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:37.946629 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 267/530] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:37.952219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:37.953086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:37.953568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:37.989984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:37.991539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:38.079041 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 264/531] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:46:38.402965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3f4c7-852c-4d2f-9856-fba0d9b9a06f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:38.444640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:38.520133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3f4c7-852c-4d2f-9856-fba0d9b9a06f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:38.593031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:38.593031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:38.593031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:38.593031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:38.608298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:38.613583 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:38.614482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:38.615321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:38.622303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 268/532] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:38.629960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:38.747836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:38.819730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d52c3e-a361-4e2a-b9a2-ab78174b59a7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:38.879054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:38.879973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:38.880428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:38.880868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:38.881727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:38.882224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:38.883755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:38.900066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 265/533] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:38.906338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:39.067386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.077595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aa3a1-8baf-4618-8032-534bddf1d0da None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:39.167679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:39.168333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.168612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.168880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.189319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:39.190776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-556c846f-7fb9-4413-b960-3d451413f71a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:39.227505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:39.228503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:39.230506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:39.230506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:39.230506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:39.230506 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 269/534] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:39.242108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:39.284079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91745e-5c18-4f14-a907-3d583a034efa None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.284393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91745e-5c18-4f14-a907-3d583a034efa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.284631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91745e-5c18-4f14-a907-3d583a034efa None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.286270 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 270/535] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:39.292465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.292784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.293161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.342013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:39.343320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:39.375063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aa4ca-09e7-4699-aeea-2154547acb7c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:39.400382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.446530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:39.447128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.447401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.447687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.449474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:39.449773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:39.451136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f6f-4e1c-422b-98a3-445d8563e0d8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:39.467325 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 271/536] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 18 15:46:39.477145 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 266/537] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:39.483430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:39.550646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f86f-499d-41ee-97ce-f240a0513b92 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.550971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f86f-499d-41ee-97ce-f240a0513b92 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.551184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9f86f-499d-41ee-97ce-f240a0513b92 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.552562 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 267/538] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:39.562361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.562650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.562910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.594079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.603168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:39.604469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:39.615937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07982979-5068-4567-ab9d-7368aee44b0f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:39.659947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:39.660974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.661536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.662004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.670090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:39.671778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2ff6078f-a1f7-4271-90e1-ec58d6595e39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:39.685404 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:39.686365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:39.687293 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:39.689773 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 272/539] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:39.691377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed6e9-ffbb-47f4-9f3b-ce12d8f0e62f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.691923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed6e9-ffbb-47f4-9f3b-ce12d8f0e62f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.692389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed6e9-ffbb-47f4-9f3b-ce12d8f0e62f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.694187 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 273/540] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:39.698970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 268/541] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 15:46:39.700401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.700832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.701259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.704887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:39.733143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:39.734575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:39.845329 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 274/542] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:39.846222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:39.864675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b24e7-4ab6-4c85-91cb-2c9a2e4fce08 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:39.866848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.930520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:39.947071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:39.948236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:39.949032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:39.949032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:39.949522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:39.949827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:39.951276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:39.977582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636bb6f-4e8b-4089-9e13-42a29fb0128f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:39.991381 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 269/543] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:39.992198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.016466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.017539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.018106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.018385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.033016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:40.040273 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:40.041217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:40.042685 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 275/544] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:40.048796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.115941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1993-f93b-4496-98f5-8f9e3cb9c54d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.152312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.152916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.153223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.153496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.154147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.155517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.163978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6260d-6ac2-411a-9f3e-217f0c3a89f3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.175023 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 270/545] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:46:39 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:40.176082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.203097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.204895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.230411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.231432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.232257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.232884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.247175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.249198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:40.269948 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:40.271634 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:40.272532 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:40.272532 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:40.272532 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:40.274963 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 276/546] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:40.276828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.303206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a972585-fb55-4510-abe3-8ac15aa80a31 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.343320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.344001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.344286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.344613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.345770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:40.345770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.347571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.361882 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 271/547] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:40.363498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.403158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7292-d098-433e-bc6e-f4fc0952b39b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.443698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.444670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.445118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.445529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.459557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:40.466754 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:40.467810 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:40.468643 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:40.469413 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 277/548] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:40.469949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.470054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.491345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54acfc-be69-4948-a65a-9124cb53aa14 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.519455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.530552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.531201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.531501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.531912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.532414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:40.532716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.534112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.546583 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 272/549] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:40.551938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.587347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee5514-7a69-40e4-a811-98839c1fcb22 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.624343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.625118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.625440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.625757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.638492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.640331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-480bf5c4-d31f-4661-ba96-ab2bf25c6edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:40.657419 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:40.658710 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:40.660022 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:40.660022 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:40.660022 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:40.660022 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 278/550] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:40.662238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f17e-c6f8-4ddd-b000-94279219954d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.663995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f17e-c6f8-4ddd-b000-94279219954d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.664447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f17e-c6f8-4ddd-b000-94279219954d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.666227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 279/551] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:40.667874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f17e-c6f8-4ddd-b000-94279219954d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.668251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876edd-6a49-4d8a-ab33-88395b43e792 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.706436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.707041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.707320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.708247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.708247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:40.708553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.709934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.722984 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 273/552] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:40.722984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.725675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.774915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:40.788017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f17e-c6f8-4ddd-b000-94279219954d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.823912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.824550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.824819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.825183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.832593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.832759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadae1c-45d5-4514-9914-c30fb3106f83 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:40.834110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dca5f1a3-ade8-4ffc-9d83-69b5b142179f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:40.845016 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:40.846092 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:40.847024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 280/553] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:40.847505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.847572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.848181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.865562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:40.866730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:40.874482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:40.875092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:40.875367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:40.875638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:40.876274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:40.876584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:40.878052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:40.891757 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 274/554] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:40.893159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.944804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 281/555] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:40 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 15:46:40.945490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:40.981296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.025531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bcd7b-75c8-4a0c-b30a-83982333f012 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.036571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.060380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2880-9733-4ebb-b6d1-d9ca2e5b9530 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.068777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.069505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.069879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.070217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.084150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.086344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.104313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:41.105140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:41.106044 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:41.106918 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:41.106918 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:41.106918 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:41.107378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.107378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.107378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.107378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:41.107378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.108946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.114355 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 275/556] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:41.115382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.127402 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 282/557] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:41.128485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.245938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9641f0-bb54-4509-800a-4c580d41e64a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.247275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5174f-dcd1-4dcb-afc6-c6196bd86af4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.263978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.283043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.283651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.283874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.283989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.284175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.284454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.284723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.284817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:41.284985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.285172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.286510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.293389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.294861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.296735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.301248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 283/558] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:41.302099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:41.311714 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:41.312981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 276/559] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:41.313951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.419062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9062ee-7ccb-4afa-a880-9f387b5586b6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.419658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2867bb-9157-4867-bff6-486589d05045 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.454390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.454966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.455093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.455271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.455511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.455608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.455878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.456145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/8f98d1b53918419bad2040f49ad08092/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.456240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.457553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.458042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=8f98d1b53918419bad2040f49ad08092, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.459449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.472983 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 284/560] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:41 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/8f98d1b53918419bad2040f49ad08092/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:41.477082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.481475 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 277/561] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:46:41 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:41.482745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.574542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.616650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.699868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23061d-6b84-4b25-b5eb-66bf82a19ae4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.713896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3f746-8b75-4ee3-8810-9ba0164d9424 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.746047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.747248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.747914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.748184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.748912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:41.749233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.750654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.762851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.763859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.764292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.764705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.769855 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 278/562] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:41.773182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.775649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.776303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:41.788648 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:41.789751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:46:41.790681 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:41.793169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 285/563] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:41.801938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:41.880758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.894431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424ab8-423f-4943-81d1-0027f2dcfbb4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.915884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0e5f2-d567-4ef0-8766-7f7efde8e42c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:41.945360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:41.957004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.957916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.959288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.959850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.983083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:41.984177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.985073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:41.986473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:41.986916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:41.987655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:41.988563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:41.989516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:41.991284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:42.021367 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:42.022352 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:42.023210 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:42.023210 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:42.023210 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:42.026462 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 279/564] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:42.029655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 286/565] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:46:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:42.033663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.034978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.211093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e1ad-0d74-400a-93d9-488dbeb0117d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.214657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c265bd-ccd4-4ce6-95bc-e54abc53faa1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.257227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.258085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.258358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.258621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.293766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.294383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.294663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.294934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.295579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:42.295880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.297272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.314472 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 280/566] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:42.317402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:42.320607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.324095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:42.365886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.369225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a04abf-184d-4d6d-9612-30f33263fec0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.475937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1ebc-de10-442e-ad35-3ccb1d1576ef None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.515555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.516244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.516526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.516792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.529020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.530490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2dd15983-dd78-421a-865e-5064dadc78c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:42.542886 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:42.543893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:42.544933 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 281/567] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:42.550007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3435-3009-46a6-aca9-b23f14bdbbbd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.550292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3435-3009-46a6-aca9-b23f14bdbbbd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.550562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3435-3009-46a6-aca9-b23f14bdbbbd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.551909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 282/568] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:42.552609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3435-3009-46a6-aca9-b23f14bdbbbd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.573123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 287/569] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:46:42.574582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.574938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.575278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.595235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:42.596568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:42.625525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:42.669492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3435-3009-46a6-aca9-b23f14bdbbbd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.677339 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 288/570] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:42.678318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.695628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:42.707290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.708213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.708637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.709096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.709976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:42.710451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.712104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.725573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 283/571] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:42.732503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:42.836851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c12a0d-c455-4ba0-8e48-aeaeeacaca9b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.860949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:42.874864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.875754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.876118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f249-28b0-4809-becb-9a8f1d5f4b77 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:42.876336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.876748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/7d592ee3501240448ef4ca7badae3c01/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.907606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=7d592ee3501240448ef4ca7badae3c01, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.909450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:42.929750 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 284/572] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:42 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/7d592ee3501240448ef4ca7badae3c01/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:42.966902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:42.967549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:42.967823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:42.968087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:42.989583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:42.990986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:43.018568 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:43.019649 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:43.020612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:43.020612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:43.020612 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:43.020612 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 289/573] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:43.025490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.087830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.179814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a053c2-44c8-49f2-880d-ec72e354e91c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.203712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:43.224934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.225572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.225848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.226120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.226759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:43.227072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.229604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.245064 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 285/574] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:43.253012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.272703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeccc6-5281-4d8a-9a90-8194a1d770a5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.295679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:43.345890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.346530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.346807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.347077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] PATH_INFO: `/v3/services/network` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.347664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.349038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:43.371167 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:43.372199 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:43.373044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 290/575] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:43.381997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.404618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a6349-2618-4100-8b45-83e41ac8e714 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.444198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.444945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.445347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.445628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.453374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.455134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:43.467901 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:43.468928 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:43.469903 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 286/576] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:43.475678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.605373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:43.616453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047356e9-aa30-4ced-ab33-395ca008824f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.643880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bf11-bf72-40a4-b094-9f650f475a94 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.655891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.656500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.656842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.657150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.658467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:43.658816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.660252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.676899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 287/577] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:43.684203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.701875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:43.720486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.721122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.721410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.721662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.722292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] RBAC: Adding query filter params (name=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:43.722585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.724165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.733730 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 291/578] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:43.740099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:43.869990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b5d03-21fc-4124-866c-6d304d1926ba None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:43.906634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:43.907245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:43.907524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:43.907793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:43.908827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=437b718c34ab4dba9fe29716caaf2841) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:43.909179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:43.910808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:43.918825 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 288/579] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/role_assignments?user.id=437b718c34ab4dba9fe29716caaf2841&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:43.956161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890020-28da-43cd-bd48-d52f686ec88f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:44.032822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:44.033484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.033761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.034027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.034685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] RBAC: Adding query filter params (type=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:44.034986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:44.036515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb7e21-9502-45f5-8119-8703e8551444 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:44.046957 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 292/580] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:44.053193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:44.084278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:44.111733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5771-b54e-43a5-966e-9fee9e365bb7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.112057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5771-b54e-43a5-966e-9fee9e365bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.112283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5771-b54e-43a5-966e-9fee9e365bb7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.114000 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 293/581] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:44.120302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1bf2-ae6e-4b2a-8a38-f1fe57617cb1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.120533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1bf2-ae6e-4b2a-8a38-f1fe57617cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.120766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1bf2-ae6e-4b2a-8a38-f1fe57617cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.159415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3eef1bf2-ae6e-4b2a-8a38-f1fe57617cb1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:44.165209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3eef1bf2-ae6e-4b2a-8a38-f1fe57617cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:44.196097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888260a-37ab-4f77-a308-428d4a9f64d2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:44.222209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:44.235891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:44.236499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.236770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.237052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.237812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] RBAC: Adding query filter params (interface=public, service_id=17555a4a7307418f8fd03674720dc956, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:44.238042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:44.239391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf43bf-4eb9-49f8-9d05-8862700bd607 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:44.247507 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 289/582] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/endpoints?service_id=17555a4a7307418f8fd03674720dc956&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:44.248755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4e90c-c09c-429f-a9e3-b02aa1d18d68 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.249052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4e90c-c09c-429f-a9e3-b02aa1d18d68 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.249349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4e90c-c09c-429f-a9e3-b02aa1d18d68 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.250725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 290/583] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:44.251410 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 294/584] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:46:44.258195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4e90c-c09c-429f-a9e3-b02aa1d18d68 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:44.259437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.260760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.261581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.301223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:44.302779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:44.363015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:44.388117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4e90c-c09c-429f-a9e3-b02aa1d18d68 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:44.427765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:44.429125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.429542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.430000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.430789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:44.432599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:44.439974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 291/585] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:44.463986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 295/586] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:44.520089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:44.660223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e81658-03e0-47d2-a62a-0a13b5537b75 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:44.696251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:44.696885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.697194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.697599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.698455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:44.699826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:44.708687 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:44.709752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:44.710702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 292/587] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:44.722098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:44.806017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:44.821778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:44.835254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63510ab0-0267-4c01-ae38-fd0caaa57438 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:44.847017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:44.871394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:44.872382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:44.872873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:44.873386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:44.874232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:44.874744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:44.876304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:44.881891 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 296/588] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:44.888063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.015101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b33cda-8ffa-4da9-a3c7-3e59ab304401 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.093704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.094339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.094613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.094885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.101021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105965d4-e679-456f-89d7-525c8f449dd9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:45.113019 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:45.114289 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:45.115393 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 293/589] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:45.125362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.159903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.160810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.161323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.161791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.162600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:45.163075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.164605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.179355 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 297/590] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:45.184917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.207230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:45.231182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:45.245422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407470e6-c230-4469-81d3-9314f7b48434 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.281581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.282293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.282634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.282970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.283688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:45.284104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.285708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.295858 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 294/591] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:45.301981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.304609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cd31b-3a21-4c36-a13c-d79976acea29 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.372049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.372937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.373397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.373872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.374725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] RBAC: Adding query filter params (interface=public, service_id=7818112384ee4bbe9e7855387265b154, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:45.379426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.381035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.396675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 298/592] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/endpoints?service_id=7818112384ee4bbe9e7855387265b154&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:45.409555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.516854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7e30-30ad-4b32-aa82-0a1dbb0d5b76 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.546245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6f9c-f289-4005-a1de-9a9ae994916e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.550029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:45.586139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.586874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.587239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.587513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.588763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.588932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:45.590300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.592857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.593530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.593802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.594071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.597078 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 299/593] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:45.608960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.610471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0fe9fe60-085b-4da7-9623-04edc443ab27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:45.628728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:45.629811 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:45.630700 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:45.630700 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:45.630700 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:45.630700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 295/594] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:45.636061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.743377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900dbe-d6d1-472c-bdf7-adbe8b0ddc83 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.743732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900dbe-d6d1-472c-bdf7-adbe8b0ddc83 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.743938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d900dbe-d6d1-472c-bdf7-adbe8b0ddc83 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.746171 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 296/595] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:45.755874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.756152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.756417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.780603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08755-dd84-4282-adb8-62eb80173fc2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:45.814105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:45.815326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:45.820799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:45.821599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:45.821965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:45.822356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:45.823602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:45.823993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:45.826048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:45.841591 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 300/596] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:45.847113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:45.883075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:45.914479 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 297/597] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:45.976088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaba5d-6782-4841-b599-f2f560d9cc88 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.024621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.025360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.026013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.026356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.035015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:46.036382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:46.054019 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:46.055015 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:46.056033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 301/598] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:46:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:46.062838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.201442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412e99-c26a-449b-b5a9-5a0a1dc96166 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.209554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.223640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:46.243809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.244943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.245452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.245867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.246615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:46.246985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:46.248535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:46.270241 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 298/599] 10.222.0.78 () {56 vars in 1135 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:46.276205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.412262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:46.412888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105ac7-ed0e-48ba-850c-272fc2578f65 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.435669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7268c8-1dfe-4b3f-a601-3bd69dc696c5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.474809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.475953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.476494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.476960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.491653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:46.498638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:46.499663 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:46:46.500505 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:46.501198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.501198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.501198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.501198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.503612 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 302/600] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:46.510653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.590254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:46.636377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275cab-6c96-4065-af89-c4296190b709 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.654026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:46.655489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8541-8d3b-4815-9621-d28ee4f28528 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:46.674348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.675283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.675753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.676237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.677143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:46.677674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:46.680109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ecf2d-188a-4cd6-ab2c-e1567f8b42dd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:46.690433 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 303/601] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:46.692090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68700b-6a0f-4911-94f1-7395632f25aa None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.692579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68700b-6a0f-4911-94f1-7395632f25aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.693069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68700b-6a0f-4911-94f1-7395632f25aa None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.694633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 304/602] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:46.695809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68700b-6a0f-4911-94f1-7395632f25aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.710305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:46.775030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 299/603] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:46:46.776741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.777052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.777337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.795606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:46.796792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:46.818224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68700b-6a0f-4911-94f1-7395632f25aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:46.858335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:46.859445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:46.860105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:46.861090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:46.863723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:46.873147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 300/604] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:46.874147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:46.874927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:46.876520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:46.903417 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:46.904562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:46.905479 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:46.905479 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:46.905479 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:46.907056 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 305/605] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:46.912797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.021450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.050984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07d78c-8c9b-47aa-b245-e8d12c5cce96 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.067656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730fede-5647-48e9-8d9a-e8041a6e2330 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.109787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.110667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.111017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.111358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.112236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:47.112611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.114358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fda91-2ada-4b3a-85f7-60416ac9856b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.114718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.115558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.116099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.116546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.131998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 306/606] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:47.131998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f063b8-f655-436b-8a8d-0667ac274a73 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.131998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f063b8-f655-436b-8a8d-0667ac274a73 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.131998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f063b8-f655-436b-8a8d-0667ac274a73 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.133597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.135097 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 307/607] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:47.135849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f063b8-f655-436b-8a8d-0667ac274a73 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.136121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9161dba1-58f4-47c1-b183-607c70611c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:47.153685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:47.154689 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:47.155604 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:47.155604 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:47.155604 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:47.157706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 301/608] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:47.159312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.159812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.160281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.180612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:47.182718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:47.246351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.251061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f063b8-f655-436b-8a8d-0667ac274a73 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.272371 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 302/609] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:47.273385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.289065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.303473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.304390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.304821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.305293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.314923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.316558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:47.333567 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:47.334809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:47.335838 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.338681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 308/610] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:47.339710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.417724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4d18-db16-4959-ba08-cb0f86366565 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.459712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc035-7afd-4aec-816e-9351cc028178 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.463748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.464482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.464858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.465252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.466052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:47.466449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.467969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.486332 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 303/611] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:47.487587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.500746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.501771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.502052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.502318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.502896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.504391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:47.515491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:47.516492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.517787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 309/612] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:47.518613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.546121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.578264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.612740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef992b-e0ef-4207-9547-6692fa297352 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.636897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a55d-17e2-4c32-9f78-88668948cb4b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.648643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.649353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.649695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.650033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.651443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:47.651919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.653480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.670969 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 304/613] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:47.672337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.673060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.673401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.673732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.676312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.681257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.683391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:47.695174 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:47.696272 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:47.697603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.698153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 310/614] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:47.698902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.783953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.788173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce77f-dc93-4879-b984-e6aa5900a8b4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.807735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed315b-50ce-4b49-9e42-793036e94686 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.816566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:47.825592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.826427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.826713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.826997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.827608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:47.827909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.829291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.833931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 305/615] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:47.834713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.846717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.847350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.847630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.847899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] PATH_INFO: `/v3/services/network` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:47.848481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:47.849862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:47.859699 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:47.860695 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:47.866032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 311/616] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:47.866847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:47.946618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ede7-ad2d-4c6b-8f11-671c0d4c6f70 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.985529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6d10-48be-42d1-9614-049d8efc847b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:47.985849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:47.986399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:47.986679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:47.987024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.018699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.022879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.023489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.023768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.024038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.024736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.025066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.027003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.044585 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 312/617] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.044585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.067215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.068703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.075037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.151610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32347-07b5-4684-a121-b30764f79b40 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.185277 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 306/618] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:46:48.186015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.190355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.191027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.191368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.191699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.192392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.192755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.194218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.209048 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 313/619] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.209048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.275733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.317899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab6bb-6d5f-4e9c-8a87-5070c92adfde None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.324021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.332957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944aee5-944b-412b-93c9-c99858548b92 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.355420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.356036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.356308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.356574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.357635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.357929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.359312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.368701 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 307/620] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.368701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.382783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.383245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.383525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.383793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.384522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=8f98d1b53918419bad2040f49ad08092) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.385629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.387420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999002df-a2b7-4e9a-89d0-c4213c34c204 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.394067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 314/621] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/role_assignments?user.id=8f98d1b53918419bad2040f49ad08092&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.395840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a6eb-022d-4786-a6ab-b41a40ac869a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.396185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a6eb-022d-4786-a6ab-b41a40ac869a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.396796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a6eb-022d-4786-a6ab-b41a40ac869a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.397737 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 315/622] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:48.398854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a6eb-022d-4786-a6ab-b41a40ac869a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.503725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65d7e-3c8e-4994-9131-bd093244a6c6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.534127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.545651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a6eb-022d-4786-a6ab-b41a40ac869a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.549308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.549978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.553412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.553963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.571362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.574101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-513c80e0-d690-445b-95e4-fb86ab4ece34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:48.591997 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:48.593397 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:48.594330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:48.594330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:48.594330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:48.594515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.594622 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 308/623] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:48.597079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.597079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.597079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.597356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.597356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.597504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] RBAC: Adding query filter params (type=network) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.597587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.597658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.597887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.605026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 316/624] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.605848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.622000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:48.623200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:48.634330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.710786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 309/625] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:48.712159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.747714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc87658-58c8-4c8f-ad8a-e9e98d28679e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.787034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.787893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.788337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.788762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.789613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:48.790119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.792202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.805683 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 317/626] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:48.812104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:48.906261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.928633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710fb04-7b24-43cb-aa91-e5597311f42c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.946083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a719-7c30-4ee5-99d7-0bc2de69cff7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:48.966656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:48.973878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.974692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.975147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.975582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.985036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.986762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:48.996182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:48.996908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:48.997315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:48.997671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:48.998454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:48.999941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:49.000730 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:49.001773 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:49.002855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:49.004838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 318/627] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:49.011437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.053774 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 310/628] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:46:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:49.054621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.195719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d28c4-562d-4044-886a-46b4698cec26 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.247774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db494-aeca-4c4d-90e2-2ecc0f3d31fe None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.249789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.250391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.250671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.250938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.252300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:49.252300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.253423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.267300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:49.274119 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 319/629] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:49.284746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.295539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.296501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.296981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.297489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.298367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.300054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:49.312108 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:49.313180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 15:46:49.314009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:49.317077 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 311/630] 10.222.0.78 () {56 vars in 1129 bytes} [Tue Oct 18 15:46:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:49.323728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.363893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:49.406345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507de307-c13a-40e5-92b4-50289087d87e None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.440866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46317e5e-5bdb-44dd-b602-3c13d634e039 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.449621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.450886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.451378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.452228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.453531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=7d592ee3501240448ef4ca7badae3c01) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:49.454065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.455691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.463840 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 320/631] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:49 2022] GET /identity/v3/role_assignments?user.id=7d592ee3501240448ef4ca7badae3c01&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:49.479515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.480238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.480516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.480784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.481479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:49.482039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.483513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.493496 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 312/632] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:49.495318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.568812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:49.617737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5e97-56c5-476b-b74c-8186188115b8 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.656802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11393-eefb-4526-939d-47a486756988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.657452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11393-eefb-4526-939d-47a486756988 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.657731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11393-eefb-4526-939d-47a486756988 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.657998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11393-eefb-4526-939d-47a486756988 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.658634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11393-eefb-4526-939d-47a486756988 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:49.658931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11393-eefb-4526-939d-47a486756988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.660300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11393-eefb-4526-939d-47a486756988 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.666824 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 321/633] 10.222.0.78 () {56 vars in 1124 bytes} [Tue Oct 18 15:46:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:49.672638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:49.772220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:49.780612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73662-f251-4879-b478-0f0cc8bb668f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:49.817070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:49.817678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:49.817954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:49.818222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:49.818891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:49.820246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b7fa5-ef5f-4db7-a3d9-cd1e3eac3f9d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:49.843148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 313/634] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:46:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:50.598259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff1ce-8437-45ae-8ee9-47335a41cf19 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:50.598807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff1ce-8437-45ae-8ee9-47335a41cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:50.598807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff1ce-8437-45ae-8ee9-47335a41cf19 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:50.600375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 322/635] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:50.606156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd886095-fda5-4246-ae2a-74f372e8b927 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:50.606438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd886095-fda5-4246-ae2a-74f372e8b927 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:50.606711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd886095-fda5-4246-ae2a-74f372e8b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:50.626066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd886095-fda5-4246-ae2a-74f372e8b927 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:50.627309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd886095-fda5-4246-ae2a-74f372e8b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:50.707780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 314/636] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:50.867068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129aac-4fb2-4dd8-a0e1-e9c7ece65699 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:50.867253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129aac-4fb2-4dd8-a0e1-e9c7ece65699 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:50.867520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129aac-4fb2-4dd8-a0e1-e9c7ece65699 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:50.868861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 323/637] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:50.874846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:50.875132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:50.875408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:50.893701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:50.894878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:50.970267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 315/638] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:50.991598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129aac-4fb2-4dd8-a0e1-e9c7ece65699 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:51.100760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129aac-4fb2-4dd8-a0e1-e9c7ece65699 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:51.128885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:51.139610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:51.140273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.140549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.140866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.141563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:51.142915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:51.165170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 324/639] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:46:50 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:51.246662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:51.256094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:51.368449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57054-3be6-4724-b305-f4d0e65c7e58 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:51.410112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:51.410658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.410929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.411191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.411763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:51.413160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:51.422487 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:51.423483 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:51.424347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 316/640] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:51.429673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:51.538965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cac3d-bb21-43e4-9f0e-32549ce94d96 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:51.577055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:51.577672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.577947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.578215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.578846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:51.579145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:51.580512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8818-f7d3-4407-8e25-24b8784e44ce None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:51.589101 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 325/641] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:51.592171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:51.666731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:51.705897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0385ca5-ff92-4798-b87f-252b7158f8cd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:51.746152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:51.747569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.748043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.748508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.749389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:51.749917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:51.751477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d6d492-ed28-42a7-80bb-21c20042e8ce None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:51.756745 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 317/642] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:51.812524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092283-3281-477b-9281-ec5fa8c8038c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.813078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092283-3281-477b-9281-ec5fa8c8038c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.813078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092283-3281-477b-9281-ec5fa8c8038c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.814813 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 326/643] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:51.820623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068a42-0aa9-4267-a300-470629b2a77c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:51.820944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068a42-0aa9-4267-a300-470629b2a77c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:51.821228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de068a42-0aa9-4267-a300-470629b2a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:51.841195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-de068a42-0aa9-4267-a300-470629b2a77c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:51.842421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-de068a42-0aa9-4267-a300-470629b2a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:51.918898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 318/644] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:51 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:52.109450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf224-ed56-4e64-93d5-9eb0736a5f18 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.109844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf224-ed56-4e64-93d5-9eb0736a5f18 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.110022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf224-ed56-4e64-93d5-9eb0736a5f18 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.111602 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 327/645] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:52.116858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.117182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.117454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.137082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:52.138272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:52.199886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf224-ed56-4e64-93d5-9eb0736a5f18 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.201505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.221088 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 319/646] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:52 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:52.265158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.320451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf224-ed56-4e64-93d5-9eb0736a5f18 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.357214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.357845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.358119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.358386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.369490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:52.375322 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:52.376249 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:52.377122 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 328/647] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:52.382303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.495193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9f608-5eab-4abc-a4b5-495d4fcb61b9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.501006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.533010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.533627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.533904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.534171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.534835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:52.535141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:52.536514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:52.550422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 320/648] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:52.551325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.607568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.611585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1fc9-6e36-48c5-8f34-07ef646e7fb9 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.626777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.649972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.650970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.651444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.652125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.653270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:52.655112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:52.658611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20137-95b7-4ad5-b2bd-f36d5271f296 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:52.666506 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:52.667488 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:52.668339 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:52.675920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 329/649] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:52.677576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.704852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.706327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.706753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.707443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.722665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:52.724300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:52.743429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:52.744885 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:52.746069 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:52.746069 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:52.746069 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:52.748647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 321/650] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:52.753941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.801533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafb5d0-c5aa-46f6-988f-9ce06b20fe88 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.840407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.841943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.842391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.842820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.843591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:52.844035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:52.845570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:52.850985 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 330/651] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:52.857276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.864625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf5df-9f33-43be-ac28-3fcebdc5db0b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:52.867214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.902399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:52.904436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:52.905154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:52.906313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:52.906659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:52.907370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:52.907947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:52.909318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:52.922828 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 322/652] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:52.928454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:52.974722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fda7e-f8e1-49d7-921e-3b514fb9acc6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.014508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.015366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.015790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.016192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.016968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:53.017458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.018977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.024686 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 331/653] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:53.050793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e8662-b56c-48cf-be12-4951d7a63ce2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.090060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.090963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.091494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.091907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.100589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.102347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:53.115913 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:53.117155 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:53.118295 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:53.121535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 323/654] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:46:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:53.130348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.250199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c1a5-4b50-431b-b8fd-24eaf3c01885 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.251921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:53.287401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.287930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.288203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.288472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.289232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:53.289535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.291457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.309993 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 332/655] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:53.316061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.344652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:53.429538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23829e2-2380-4dd8-83f5-cab5e9dfe187 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.469063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.469693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.469965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.470229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.482000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.483446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2deca186-eabf-48bd-a6e5-b5321c2305db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:53.497753 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:53.498705 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:53.499589 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:53.499589 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:53.499589 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:53.499589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 324/656] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:53.506043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.511394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c324279-6b74-4f7f-831f-ea16cc9957cc None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.511678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c324279-6b74-4f7f-831f-ea16cc9957cc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.511950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c324279-6b74-4f7f-831f-ea16cc9957cc None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.513531 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 325/657] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:53.521120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.521402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.521676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.541212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:53.542615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:53.621272 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 326/658] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:53 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:46:53.623745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211bc2-6705-427b-9769-2508b33b854f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.660652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.661297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.661576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.661847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.662544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:53.662847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.664211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.676489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 333/659] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:53.682571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.693344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:53.785440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b8a2-cd1e-4829-9e7d-f02a4ed80ce8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.820528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:53.821105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:53.821383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:53.821655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:53.828987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:53.830461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:53.843916 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:53.846097 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:53.848222 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 327/660] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:53.853030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.881453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:53.904751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:53.983219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1872a-0b5d-40b9-8739-20e3a99d2dad None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:53.993619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:54.028933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.029783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.030074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.030742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.031764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:54.032303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.033837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aed54a-6d87-493a-ab98-9be556a35522 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.036339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0239f-69fa-4674-8222-0a5604ec3180 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.050950 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 334/661] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:54.052957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c554d0-2c33-4c2b-849b-3525a893fa98 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.053452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c554d0-2c33-4c2b-849b-3525a893fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.053724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c554d0-2c33-4c2b-849b-3525a893fa98 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.054991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 335/662] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:54.055770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c554d0-2c33-4c2b-849b-3525a893fa98 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.075921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.076473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.076751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.077061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.077647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.079007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5ea20656-6020-48ed-bbbd-f747be9d6496 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:54.087965 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:54.088870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:54.089785 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 328/663] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 18 15:46:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:54.090637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.091316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.091316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.109408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:54.110600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:54.150992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:54.172596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c554d0-2c33-4c2b-849b-3525a893fa98 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.185255 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 329/664] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:54 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:54.187931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.218232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.219205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.219734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.220357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/7d592ee3501240448ef4ca7badae3c01/roles/22c8c9d9eae1476faf64603b61e794e6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.222874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=7d592ee3501240448ef4ca7badae3c01, role_id=22c8c9d9eae1476faf64603b61e794e6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.224918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.240610 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 336/665] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:46:54 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/7d592ee3501240448ef4ca7badae3c01/roles/22c8c9d9eae1476faf64603b61e794e6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:46:54.251963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:54.302482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16064-c1f5-4935-a3f4-0bc4e5294705 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.342330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.342957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.343233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.343507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.344197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:54.344503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.345960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.351590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 330/666] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:54.357969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.470165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.470595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dba3f9-519d-42dd-a1bc-ca9d805fa4cd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.511450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.512611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.513175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.513661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.515707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:54.516225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.517872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.525468 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 337/667] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:54.530699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.536504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:54.604927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d58f1-b2e3-485e-bdad-b935a3354da3 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.637651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:54.653790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.654417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.654913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.655187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.655843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.657856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.663745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4372-be63-4f32-9f6b-f2ca7520c995 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.681024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 331/668] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:46:54 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:46:54.726517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.727139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.727419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.727691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.729061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] RBAC: Adding query filter params (interface=public, service_id=17f2252cc82e49509798f7c9ace0b1b2, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:54.729378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.730826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53800-26bc-4689-adf5-6565a80623ff None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.738137 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 338/669] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:46:54 2022] GET /identity/v3/endpoints?service_id=17f2252cc82e49509798f7c9ace0b1b2&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:54.743714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:54.857618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b63c5-063b-4eea-b51c-eafe8b183e74 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:54.895681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:54.896295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:54.896570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:54.896839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:54.897475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:54.898850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84860-97b9-4fca-9002-780bb2ee353b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:54.906051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 332/670] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:46:54 2022] GET /identity/v3/services => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:46:55.358364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb349-6510-4b49-bb62-5707f708ef4b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:55.358906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb349-6510-4b49-bb62-5707f708ef4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:55.358906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afb349-6510-4b49-bb62-5707f708ef4b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:55.360510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 339/671] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:55.365929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3674-213c-48fa-83b1-bee3606ab83f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:55.366215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3674-213c-48fa-83b1-bee3606ab83f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:55.366483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3674-213c-48fa-83b1-bee3606ab83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:55.385808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f7fe3674-213c-48fa-83b1-bee3606ab83f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:55.386999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f7fe3674-213c-48fa-83b1-bee3606ab83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:55.436480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:55.461551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 333/672] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:55 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:55.737035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb349-6510-4b49-bb62-5707f708ef4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:55.804246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:55.847911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afb349-6510-4b49-bb62-5707f708ef4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:55.883403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:55.884243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:55.884864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:55.885324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:55.886162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:55.887655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242e87-5ba7-4039-9919-651f80e6ead9 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:55.905519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 340/673] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:46:55 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:56.558537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ff44-614f-4369-b16f-e20c065e8f89 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:56.559107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ff44-614f-4369-b16f-e20c065e8f89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:56.559107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926ff44-614f-4369-b16f-e20c065e8f89 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:56.560682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 334/674] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:56.566113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9911d9-2196-4078-a430-eea2f0152e4e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:56.566550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9911d9-2196-4078-a430-eea2f0152e4e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:56.566661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9911d9-2196-4078-a430-eea2f0152e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:56.584934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1f9911d9-2196-4078-a430-eea2f0152e4e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:56.586167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f9911d9-2196-4078-a430-eea2f0152e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:56.663739 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 341/675] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:56.942083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ff44-614f-4369-b16f-e20c065e8f89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:56.976213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8f50-b2f3-4252-a657-87843a256dcb None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:56.976522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8f50-b2f3-4252-a657-87843a256dcb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:56.976760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8f50-b2f3-4252-a657-87843a256dcb None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:56.978962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 342/676] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:56.984381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:56.984661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:56.984934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.003569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:57.004670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:57.059417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926ff44-614f-4369-b16f-e20c065e8f89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.070056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.098457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.099089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.099364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.099632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.101608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 343/677] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:46:57.118324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4cd8e8df-a555-4ccd-b8de-993654135181 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:46:57.123652 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:57.124601 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:46:57.125491 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:57.128980 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 335/678] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:46:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:57.135384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.144460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c201d4-206f-4e52-832a-c5874f67d3ee None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.144770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c201d4-206f-4e52-832a-c5874f67d3ee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.145031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c201d4-206f-4e52-832a-c5874f67d3ee None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.150263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 336/679] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:46:57.152105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.152718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.153020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.171809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:57.172986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:57.204062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.247104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b3bb7-31b1-45b7-8490-cca5737adb2b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.253027 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 337/680] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:46:57.293887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.294833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.295363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.295828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.296677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:57.297200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.298761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.308041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 344/681] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:57.314361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.392812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.415150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0305d2-a57e-43d4-a2ee-c807e9a0251c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.441110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.453113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.454240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.454641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.455087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.466663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.468608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:57.483671 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:57.484682 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:57.486217 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:57.486217 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:57.486217 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:57.486217 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 338/682] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:57.490322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.508208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29f158-2178-49b7-b4a2-c63077093c7f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.514072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.547838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.548954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.549439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.549984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.550746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.552389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:57.563646 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:57.564644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:46:57.565533 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.566717 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 345/683] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:46:57.566717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.605025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a0415-0ab0-4967-97e2-7cf5988d6b30 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.644422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.645328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.645751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.646166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.646945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:57.647801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.649718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.664298 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 339/684] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:57.665564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.678112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6471a-5899-4525-9568-780a2ddcb633 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.686389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.715928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.716572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.717026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.717184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.717748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.719107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:57.728491 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:57.730009 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.731474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 346/685] 10.222.0.78 () {56 vars in 1132 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:57.732541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.765588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.785315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49be010-0070-4193-99c9-d7002ad20579 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.819973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.820570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.820847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.821149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.822312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:57.822616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.824112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.833115 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 340/686] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:57.833115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.847551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ab6b1-9bd4-4074-830e-39842fc024e4 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.886145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.886776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.887053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.887326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.895232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.896657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:46:57.907951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:57.908892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 15:46:57.910464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:57.913890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 347/687] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:57.914510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:57.945082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e84ee-7773-4277-bfaf-473f96f12988 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:57.948938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:57.986284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:57.987200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:57.987671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:57.988126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:57.988963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:57.989351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:57.990772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:57.998917 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 341/688] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:57.999731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.010879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.031849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5fb0b-076d-453d-ac11-dad3a7b0d86a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.073287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.074288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.074794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.075152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.075805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:58.076093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.077471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.087048 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 348/689] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:58.087048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.121144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fccc2-b384-4068-8e43-b1ed5ccd813b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.155650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.156244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.156516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.156779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.157519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:58.157816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.159216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.176457 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 342/690] 10.222.0.78 () {56 vars in 1149 bytes} [Tue Oct 18 15:46:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:58.177295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.185524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.192722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1042503-877a-4858-a4b5-882d79eb4423 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.226170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.226760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.227029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.227295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.227983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:58.228275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.229650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fde1c-7b9c-498d-bc6d-8a626f904f46 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.235052 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 349/691] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:58.236250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f4cc-773a-465a-b023-1a5383e98a33 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.236587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f4cc-773a-465a-b023-1a5383e98a33 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.236801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f4cc-773a-465a-b023-1a5383e98a33 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.238303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 350/692] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:46:58.238993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3f4cc-773a-465a-b023-1a5383e98a33 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.244762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.279552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c637ff-04eb-453a-a05c-5e16e96d712e None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.313271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.313865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.314136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.314800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.315486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] RBAC: Adding query filter params (interface=public, service_id=b42751d2764f40d0bc36b318f7365a8b, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:58.315787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.317538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.323114 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 343/693] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/endpoints?service_id=b42751d2764f40d0bc36b318f7365a8b&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:58.323905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.344523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3f4cc-773a-465a-b023-1a5383e98a33 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.378073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.378670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.378940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.379207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.405461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.422353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15212a-0b7a-46c5-9142-3ab50765b1e8 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.448247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.449073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.449700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.455071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.455662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.455930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.456195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.456846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.458230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d5f38-c23d-40af-b000-813b6239813e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.477426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 344/694] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:46:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:46:58.479304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.479578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.479849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.502671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:46:58.503845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:46:58.581531 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 351/695] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:46:58.581531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.597256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 345/696] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:46:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:46:58.597256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.662007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.714426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dda202-aff8-462a-8a76-b6a491c3fc04 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.718534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d719637-b28b-4256-ba77-421c6e002948 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.734403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.754759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.755293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.755566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.755833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.756437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.757810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.765105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 352/697] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:46:58.773089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.774061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.774520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.775099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.787624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.789536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:46:58.807957 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:58.808971 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:46:58.809893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:46:58.809893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:46:58.809893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:58.811786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 346/698] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:58.817427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.887035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:58.943033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9fe29-3168-4b50-87f2-437b37f57868 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:58.972639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:58.987365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:58.988213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:58.988213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:58.988496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:58.989559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:58.989685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:58.990969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.006258 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 353/699] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:59.011150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.035647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66fe3-c885-47c8-bfdf-d1489bc56dd0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.076239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.077058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.077341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.077917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.078775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.080307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:59.092428 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:59.093493 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:46:59.094317 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 347/700] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:59.100026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.131607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbdaf-783e-4803-a301-51ab51f124d1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.137667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:59.175561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.176242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.176523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.176792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.185558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.187819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:46:59.200413 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:46:59.201458 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:46:59.202361 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 354/701] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:46:59.207106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.235009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e348-688b-46c6-b52d-80428828662b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.251540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:59.286783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.287758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.288265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.289264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.290115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:59.291602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.293956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.306093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 348/702] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:59.307641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.327087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b5799-7c5e-4c17-ab26-ffc853485895 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.368763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.369574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.369945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.370307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.371659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:59.372134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.374055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.390082 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 355/703] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:59.400836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.417756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:59.430785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec348d-1a91-45be-ac72-c36d722ede6d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.468096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.469218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.469782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.470253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.471101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:59.471607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.473262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.485166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 349/704] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:59.486744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.513257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe272f-f1a9-4b09-a2a8-7c30253ce732 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.514764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:46:59.551052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.552003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.552508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.552981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.553921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] RBAC: Adding query filter params (role.id=22c8c9d9eae1476faf64603b61e794e6, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=7d592ee3501240448ef4ca7badae3c01) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:59.554471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.556314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.568539 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 356/705] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/role_assignments?user.id=7d592ee3501240448ef4ca7badae3c01&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=22c8c9d9eae1476faf64603b61e794e6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:46:59.598254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f110cd-89de-41dd-bbbd-38058c37e164 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.638357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.638975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.639247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.639512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.640217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] RBAC: Adding query filter params (interface=public, service_id=dd365521e00847419ba1af43d99a0807, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:46:59.640517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.642001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daf7f8-3760-46a3-b740-60dff82e66c7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.648411 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 350/706] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/endpoints?service_id=dd365521e00847419ba1af43d99a0807&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:46:59.655174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:46:59.773469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6471-eb1e-4ad0-a24f-89e8ce4a9d03 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:46:59.813569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:46:59.814100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:46:59.814377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:46:59.814645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:46:59.815247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:46:59.816588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93694d-2f24-4387-bc00-04a8c25399d0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:46:59.823115 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 357/707] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:46:59 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:47:00.773433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512c28-0456-4d43-8994-bc9290d6c5c3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:00.773965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512c28-0456-4d43-8994-bc9290d6c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:00.774251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3512c28-0456-4d43-8994-bc9290d6c5c3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:00.776056 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 351/708] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:00.781488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778633-a6ce-4df1-9399-d8c8b9710bbc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:00.781922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778633-a6ce-4df1-9399-d8c8b9710bbc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:00.782217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778633-a6ce-4df1-9399-d8c8b9710bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:00.801012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5778633-a6ce-4df1-9399-d8c8b9710bbc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:00.802190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5778633-a6ce-4df1-9399-d8c8b9710bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:00.826458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:00.877947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 358/709] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:00.986971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91377-2be5-43c0-ab5e-3d068be226d5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:00.987252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91377-2be5-43c0-ab5e-3d068be226d5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:00.987523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f91377-2be5-43c0-ab5e-3d068be226d5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:00.989111 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 352/710] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:00.994562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:00.994844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:00.995111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.013710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:01.014872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:01.081362 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 359/711] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:01.156914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f91377-2be5-43c0-ab5e-3d068be226d5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.180455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:01.265524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f91377-2be5-43c0-ab5e-3d068be226d5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.300670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.301316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.301586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.301856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.302428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.303784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:01.313294 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:01.314292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.315162 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 353/712] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:01.320702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.362324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.424221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:01.437868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25887ca-ab8c-4c08-a3a7-7b99c24eff0a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.474884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:01.483960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.484764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.485073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.485346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.485982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:01.486623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.488279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.494217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 360/713] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:01.496596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c098-370d-491a-a440-2335bff0d7c1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.500074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.535345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.536391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.536867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.537397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.538172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.539731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:01.549426 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:01.550504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:01.551349 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:01.554007 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 354/714] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:01.560843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.615025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6dc13-3c52-466b-b640-4b78819de453 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.656565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.657241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.657516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.657780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.658410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:01.658707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.660165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.669024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 361/715] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:01.692715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707548-6eac-4d69-b6af-4d46ae1b1dee None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.734242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.734870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.735141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.735404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.736060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:01.736361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.737833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf900-2703-42a7-b9c6-f0b115c8017c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.744334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 355/716] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:01.750741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.775396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:01.864046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c263-01d8-45c2-b545-850d69cd5242 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.864596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c263-01d8-45c2-b545-850d69cd5242 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.864677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c263-01d8-45c2-b545-850d69cd5242 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.866442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 356/717] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:01.872491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd089c-9b9e-492e-a100-091d5aa28937 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.872780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd089c-9b9e-492e-a100-091d5aa28937 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.873106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd089c-9b9e-492e-a100-091d5aa28937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.873226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248074-3990-4cff-94f7-9679a81e93ee None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:01.893195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-76dd089c-9b9e-492e-a100-091d5aa28937 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:01.894385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76dd089c-9b9e-492e-a100-091d5aa28937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:01.903636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:01.914392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:01.915620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:01.916381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:01.916923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:01.917864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:01.918363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:01.920064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:01.932023 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 362/718] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:01.939711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:01.994419 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 357/719] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:02.042508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.064588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52620240-746b-4052-8ca3-1229f5041fb1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.102594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.103900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.104571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.105822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.106788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.107260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1aa4-0409-48c1-a1f1-b89819b48d4e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.107546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1aa4-0409-48c1-a1f1-b89819b48d4e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.108509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1aa4-0409-48c1-a1f1-b89819b48d4e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.108599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.114097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 358/720] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:02.115723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.115854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.116096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.136601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:02.137769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:02.138951 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 363/721] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:47:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:02.225469 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 359/722] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:02.286171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.400344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ddb80-8b4f-45d5-a804-538235220e16 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.435872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.436517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.436794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.437088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.437678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.439045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:02.448638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:02.449671 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.450905 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 364/723] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:02.455894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.498556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.502112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.539361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.577730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc79f-f72c-470e-9286-aa5206c1799d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.618125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198fe12-ea0f-478a-b05c-8804e6d23c6b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.624074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.624693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.624968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.625384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.626437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:02.626532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.628643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.641426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 360/724] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:02.642301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.661658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.662229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.662482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.662747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.663327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.664706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:02.674145 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:02.675173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:02.676288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 365/725] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:02.681854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.749388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.756950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe4f8-5831-423f-964e-51a72f9cbd6c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.787858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:02.788360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c54198-dda5-4f8c-8311-d8f1501c98cc None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:02.795264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.796207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.796722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.797231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.798047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:02.798558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.800092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.805414 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 361/726] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:02.827326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:02.827955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:02.828229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:02.828497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:02.829176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:02.829475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:02.830878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:02.837549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 366/727] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:02.843297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:02.972207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8c3e6-852b-440c-9203-35bc03d93fcb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:03.009643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:03.010259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:03.010528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:03.010790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:03.011416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:03.011709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:03.013100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea11d3-10c5-43dc-bb66-fe0dcf5e5c45 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:03.018711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 362/728] 10.222.0.78 () {56 vars in 1114 bytes} [Tue Oct 18 15:47:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:03.026108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:03.135005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3348c-b68f-4125-b768-a4e39f678161 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:03.167043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:03.173311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:03.173937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:03.174358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:03.174832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:03.175501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:03.176860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2515-bdd3-4596-b79e-2856b2a4565f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:03.199884 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 367/729] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:47:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:03.949132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011c70-ccca-4942-9c4d-373cbcbffefd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:03.949422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011c70-ccca-4942-9c4d-373cbcbffefd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:03.949675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011c70-ccca-4942-9c4d-373cbcbffefd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:03.951262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 363/730] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:47:03.956627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe67-823d-4ed5-840c-00bb52e3691c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:03.956910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe67-823d-4ed5-840c-00bb52e3691c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:03.957202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094fe67-823d-4ed5-840c-00bb52e3691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:03.976205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c094fe67-823d-4ed5-840c-00bb52e3691c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:03.977476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c094fe67-823d-4ed5-840c-00bb52e3691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:04.056495 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 368/731] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:04.325252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011c70-ccca-4942-9c4d-373cbcbffefd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:04.390089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:04.428761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6707139-7d46-4a05-9a97-7161c05ada2b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:04.429425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6707139-7d46-4a05-9a97-7161c05ada2b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:04.429972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6707139-7d46-4a05-9a97-7161c05ada2b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:04.432418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 369/732] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:04.435641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011c70-ccca-4942-9c4d-373cbcbffefd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:04.438483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:04.438766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:04.439037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:04.457135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:04.458324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:04.478950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:04.479555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:04.479825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:04.480090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:04.481305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:04.483302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:04.504312 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 364/733] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:47:04 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:04.552214 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 370/734] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:04.823640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:04.931954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fec87f-4d71-4cd2-be0b-a1f1d26ce586 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:04.957964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:04.974314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:04.975513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:04.976411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:04.976682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:04.977448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:04.979258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-d0ddb0e0-ed37-492e-bf8e-81d807289359 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:04.989816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:04.990900 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:04.991761 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:04.996859 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 365/735] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:47:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:04.998367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.041798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.106968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1420ea-7455-4a7c-82f9-edd3d65abb1c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.107636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1420ea-7455-4a7c-82f9-edd3d65abb1c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.108100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1420ea-7455-4a7c-82f9-edd3d65abb1c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.109339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618c07-a620-4405-a156-f6f97bfe0bb5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.114092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 366/736] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:05.115754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.116234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.116714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.136582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:05.138256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:05.146692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.147626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.147626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.147854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.148704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:05.149203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.151278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.156745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 371/737] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:05.162393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.225385 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 367/738] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:05.281073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553242-b4d7-4eb0-a2e6-509454171f83 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.284047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.324541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.325430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.325713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.325982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.326616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:05.326920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.328281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ecc8e-0a5b-4703-aac1-cbf17405e2a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.334010 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 372/739] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:05.340307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.406761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f407d-ff4a-4563-8aa5-3b125b1cc7cf None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.407368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f407d-ff4a-4563-8aa5-3b125b1cc7cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.407856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f407d-ff4a-4563-8aa5-3b125b1cc7cf None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.409880 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 373/740] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:47:05.415603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.416180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.416682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.436605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:05.438295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:05.447484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900be4-5eb9-4bd8-8fdb-6fd46814f8ae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.463623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.486006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.486821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.487239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.487673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.488625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] RBAC: Adding query filter params (interface=admin, service_id=b42751d2764f40d0bc36b318f7365a8b, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:05.489138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.490781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.501133 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 368/741] 10.222.0.78 () {56 vars in 1249 bytes} [Tue Oct 18 15:47:05 2022] GET /identity/v3/endpoints?service_id=b42751d2764f40d0bc36b318f7365a8b&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:05.503004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.516592 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 374/742] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:05.519812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.610333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67505-a2e9-4ef4-9da2-80163964b154 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.621560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.629985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f3f0-7b10-474b-a9ce-698360dafc80 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.650208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.651214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.651744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.652210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.653020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.654748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.669279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 369/743] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:47:05 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 15:47:05.672502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.673181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.673462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.673732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.674400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.675791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.695042 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 375/744] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:47:05 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:47:05.788646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:05.839647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:05.911574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868d287-a741-41c9-b1e2-ef47930cc497 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:05.955808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:05.956436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:05.956706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:05.956970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:05.957621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:05.959032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:05.961644 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.common [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 15:47:05.980707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:05.980707 n-d-858383-14 devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:47:05.980707 n-d-858383-14 devstack@keystone.service[81775]: [parameters: {'id': '4a3bb6933b8a4aefa5a3c3f3b419a99a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 15:47:05.980707 n-d-858383-14 devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a3bb6933b8a4aefa5a3c3f3b419a99a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a3bb6933b8a4aefa5a3c3f3b419a99a. Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:05.988189 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 15:47:05.989032 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Oct 18 15:47:05.990457 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:47:05.991697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 15:47:05.992920 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:05.994033 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': '4a3bb6933b8a4aefa5a3c3f3b419a99a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:05.996532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:05.998692 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a3bb6933b8a4aefa5a3c3f3b419a99a. Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:06.006478 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 370/745] 10.222.0.78 () {60 vars in 1140 bytes} [Tue Oct 18 15:47:05 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:06.008189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:06.107817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232744c-d4b0-4539-8a02-0dd833c81383 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:06.144331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:06.145143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:06.145311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:06.145499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:06.156313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:06.157785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9a94e9db-ebb2-4817-b119-ae9d8326d297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:47:06.171180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:06.173187 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:06.175357 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 376/746] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:06.180771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:06.280599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:06.288269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885559bc-1d8b-4fc3-b46e-16854280de04 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:06.329467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:06.330082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:06.330349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:06.330614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:06.331280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:06.331575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:06.333203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d91a9-d7f6-4659-8895-2ce094226ee7 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:06.354896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 371/747] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:06.747955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c40dd-e7e4-4a9b-8d84-60b00e673800 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:06.748356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c40dd-e7e4-4a9b-8d84-60b00e673800 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:06.748534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c40dd-e7e4-4a9b-8d84-60b00e673800 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:06.750047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 377/748] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:06.755461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:06.755748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:06.756018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:06.775471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:06.776960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:06.845670 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 372/749] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:06 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:07.126133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c40dd-e7e4-4a9b-8d84-60b00e673800 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:07.145494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:07.237975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c40dd-e7e4-4a9b-8d84-60b00e673800 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:07.272252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:07.272872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:07.273169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:07.273436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:07.274011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:07.275970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:07.284701 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:07.287156 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:07.289075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 378/750] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:07.292278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:07.382663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:07.400151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bab28-fbf3-4ac1-89a0-213414b3ca6b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:07.435152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:07.435743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:07.436015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:07.436278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:07.436896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:07.437215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:07.438568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:07.444050 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 373/751] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:07.450084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:07.534281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:07.556328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd7aa-afc2-41b2-abca-569771b9b0a1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:07.591816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:07.592418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:07.592754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:07.593041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:07.593675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:07.594018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:07.595361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:07.600585 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 379/752] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:07.607438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:07.718683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ead6b5-ab69-46e3-83a9-2012631e9d51 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:07.754850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:07.755452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:07.755728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:07.755994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:07.756689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] RBAC: Adding query filter params (interface=public, service_id=4ffa395d75f34a588fac5c64b8fb757a, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:07.757008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:07.758385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b218b-a267-4c5e-8387-7198c74ab3a4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:07.764731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 374/753] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:47:07 2022] GET /identity/v3/endpoints?service_id=4ffa395d75f34a588fac5c64b8fb757a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:07.770297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:07.873615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3e0-3dcb-453e-87fc-b455b58c678b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:07.908440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:07.909113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:07.909395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:07.909667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:07.910292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:07.911689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b582-8d1a-4f0d-a9e3-72e643b51c7f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:07.920064 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 380/754] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:47:07 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:47:08.036339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff26c-df9a-4c3d-a3cc-1d463a09df01 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.036523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff26c-df9a-4c3d-a3cc-1d463a09df01 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.036833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff26c-df9a-4c3d-a3cc-1d463a09df01 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.038629 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 375/755] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:08.044785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dfb9d-4592-4092-8559-ca97e7bdf809 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.045126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dfb9d-4592-4092-8559-ca97e7bdf809 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.045382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dfb9d-4592-4092-8559-ca97e7bdf809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.066913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e5dfb9d-4592-4092-8559-ca97e7bdf809 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:08.068172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e5dfb9d-4592-4092-8559-ca97e7bdf809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:08.070542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:08.147300 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 381/756] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:08 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:08.171839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d9112-5c3b-472e-abb9-de69431dd954 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.172144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d9112-5c3b-472e-abb9-de69431dd954 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.172378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d9112-5c3b-472e-abb9-de69431dd954 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.174019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 376/757] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:08.179235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.179527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.179804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.202775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:08.203948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:08.277090 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 382/758] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:08 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:08.426941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d9112-5c3b-472e-abb9-de69431dd954 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:08.443248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:08.540785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d9112-5c3b-472e-abb9-de69431dd954 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:08.561677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:08.584281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:08.584911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.585209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.585477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.586058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:08.588096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:08.600010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:08.601038 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:08.601893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 377/759] 10.222.0.78 () {56 vars in 1126 bytes} [Tue Oct 18 15:47:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:08.607420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:08.651408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:08.691363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73724c-2fa1-49d6-b9db-7a79e869429b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:08.700099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:08.727193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e905315-f6b8-4108-a9f3-ab12a263ca1a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:08.766311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:08.766935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.767216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.767477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.768117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:08.768417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:08.769849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728ee2e-4a28-4252-b62f-7131558924ae None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:08.781207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 378/760] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:08.781207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d995bc-7cba-44aa-be24-a5606d743273 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.781207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d995bc-7cba-44aa-be24-a5606d743273 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.781207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d995bc-7cba-44aa-be24-a5606d743273 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.781207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 379/761] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:08.781942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d995bc-7cba-44aa-be24-a5606d743273 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:08.846872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:08.847644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.847923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.848188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.848936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:08.850665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-337d7ca6-7081-4741-b074-298258c8517d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:08.859993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:08.865208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:08.866238 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 383/762] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 18 15:47:08 2022] GET /identity/v3/services/image => generated 86 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:08.867088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17396979-5085-4060-84ed-43cac7094532 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.867088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17396979-5085-4060-84ed-43cac7094532 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.867088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17396979-5085-4060-84ed-43cac7094532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.884754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-17396979-5085-4060-84ed-43cac7094532 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:08.886274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17396979-5085-4060-84ed-43cac7094532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:08.897888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d995bc-7cba-44aa-be24-a5606d743273 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:08.934441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:08.935047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:08.935326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:08.935593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:08.936225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:08.936523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:08.938053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:08.943213 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 380/763] 10.222.0.78 () {56 vars in 1122 bytes} [Tue Oct 18 15:47:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:08.943919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:08.950893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:08.981271 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 384/764] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:08 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:08.982259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17396979-5085-4060-84ed-43cac7094532 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.052955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:09.066439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b6ec8-a2e5-49dd-9325-d583a8b92405 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.102134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.103381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.103678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.103908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.104586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:09.104888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.105948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17396979-5085-4060-84ed-43cac7094532 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.106320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.116328 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 381/765] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:09.118722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.145850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.146850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.147165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.147531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.148289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.149878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.177016 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 385/766] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:47:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:09.209244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:09.250499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e5b7-7d9f-46fb-84f4-6d2d62f8f732 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.259904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.306686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.307313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.307588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.307900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.309113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:09.309421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.311602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.319434 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 382/767] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:09.326035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.383969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf3dc2-5ef0-4e35-972a-10a160ba5d6c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.413487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:09.435754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.436630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.436906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.437375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.438309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.439745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.442729 n-d-858383-14 devstack@keystone.service[81776]: WARNING keystone.server.flask.common [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 15:47:09.455548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57bd3-0dd9-4bb3-b55c-b525f29a60a9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.456047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.sql.core [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 15:47:09.456047 n-d-858383-14 devstack@keystone.service[81776]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 15:47:09.456047 n-d-858383-14 devstack@keystone.service[81776]: [parameters: {'user_id': '254d9cf7d1024fc2b0a021f2e806657a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 15:47:09.456047 n-d-858383-14 devstack@keystone.service[81776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:09.463975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:09.464854 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 15:47:09.465886 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:47:09.468023 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:09.468929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:09.469775 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [parameters: {'user_id': '254d9cf7d1024fc2b0a021f2e806657a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:09.471504 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 18 15:47:09.473448 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 386/768] 10.222.0.78 () {60 vars in 1131 bytes} [Tue Oct 18 15:47:09 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:09.474859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.503087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:09.513218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.513928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.514203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.514471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.515168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] RBAC: Adding query filter params (interface=public, service_id=8dc7fcff22e542929ebc4ef7edf03c27, region_id=RegionOne) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:09.515470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.516937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.522838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 383/769] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:47:09 2022] GET /identity/v3/endpoints?service_id=8dc7fcff22e542929ebc4ef7edf03c27&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:09.530078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.590601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380423b5-f32e-40c7-97ed-c145e372c854 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.628239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.628916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.629240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.629512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.639313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.640953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.647830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3abab-ea31-4dcb-9889-4bbfae78988d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:47:09.653553 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:09.654529 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 15:47:09.656087 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:09.659877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 387/770] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:09.660729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:09.690099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.691054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.691612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.692074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.692945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.694700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a69fe-8903-4719-93f9-8029001036d9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.709280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 384/771] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:47:09 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:47:09.711321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:09.780572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050f39-3df0-4a84-bb3f-5398f985c57a None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:09.819680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:09.820302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:09.820576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:09.820842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:09.822815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:09.823117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:09.824617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6a3c4-7825-4556-9c69-63c07dd6712d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:09.868247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 388/772] 10.222.0.78 () {56 vars in 1101 bytes} [Tue Oct 18 15:47:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:10.225265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85b00-1923-4715-be21-9c0d63edc787 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:10.225648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85b00-1923-4715-be21-9c0d63edc787 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:10.225851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d85b00-1923-4715-be21-9c0d63edc787 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:10.227365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 385/773] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:10.232820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:10.233286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:10.233444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:10.252160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:10.253691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:10.319310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 389/774] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:10.595416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d85b00-1923-4715-be21-9c0d63edc787 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:10.776708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:10.822100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d85b00-1923-4715-be21-9c0d63edc787 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:10.857039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:10.857591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:10.857863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:10.858125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:10.858702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:10.860046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:10.869230 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:10.870180 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:10.871151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 386/775] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:10.876112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:10.907679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:10.984573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33470b8d-2791-41d0-986c-7ef19df66206 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:11.019078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:11.019684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.019954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.020217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.020836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:11.021159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:11.022492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:11.027738 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 390/776] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:11.033199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:11.132463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126010-ee7d-4412-b476-19496142e508 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:11.152733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:11.168080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:11.168673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.168942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.169228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.169843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:11.170136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:11.171480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f7bb-c657-47cb-be02-ee898262b63e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:11.176417 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 387/777] 10.222.0.78 () {56 vars in 1112 bytes} [Tue Oct 18 15:47:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:11.182223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:11.277125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:11.284622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a32fe-a4aa-44d6-ad0c-a122096cb415 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:11.318852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:11.319452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.319724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.319988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.320647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:11.322148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f64de-c914-47f4-8aa6-6e9c6321cf88 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:11.349043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 391/778] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:47:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:47:11.470715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777132-a2f4-48f7-aa56-6de02f1299f7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.470918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777132-a2f4-48f7-aa56-6de02f1299f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.471161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8777132-a2f4-48f7-aa56-6de02f1299f7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.472655 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 388/779] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:11.478925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42d60-a677-4abb-b29c-ecc1dd6d7dca None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.479220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42d60-a677-4abb-b29c-ecc1dd6d7dca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.479462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42d60-a677-4abb-b29c-ecc1dd6d7dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.499665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6ac42d60-a677-4abb-b29c-ecc1dd6d7dca None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:11.500872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ac42d60-a677-4abb-b29c-ecc1dd6d7dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:11.580608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 392/780] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:11.853585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8777132-a2f4-48f7-aa56-6de02f1299f7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:11.931115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e618c5-4a59-4d17-b6ab-ec55871a2c42 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.931390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e618c5-4a59-4d17-b6ab-ec55871a2c42 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.931655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e618c5-4a59-4d17-b6ab-ec55871a2c42 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.933151 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 393/781] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:11.938647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:11.938923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:11.939199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:11.957356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:11.958519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:11.968631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8777132-a2f4-48f7-aa56-6de02f1299f7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.007594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.008495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.009214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.009655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.010961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.012699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.014712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 389/782] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:12.019893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:12.029908 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 394/783] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:12.077505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:12.126602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea7a8-7279-46ad-9c55-7d830dbc7ec6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.162677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.163281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.163555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.163823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.164466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.166483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.201028 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 390/784] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:47:12 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:47:12.315229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:12.327711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:12.427377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e7b05-e462-4ab0-9653-9166efd61f46 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.462171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.462806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.463081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.463338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] PATH_INFO: `/v3/services/image` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.463913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.465329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:12.474252 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:12.475269 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:12.476714 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 395/785] 10.222.0.78 () {56 vars in 1105 bytes} [Tue Oct 18 15:47:12 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:12.481921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:12.583861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ecde1-9220-49bc-97ed-00ef2a239757 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.586225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:12.621207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.621812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.622085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.622352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.622985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] RBAC: Adding query filter params (name=image) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:12.623282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.624702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.630657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 391/786] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:12.636410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:12.711659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:12.744533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a11db4-7ae9-495d-8642-d0bc41fdb68c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.777967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.778576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.778852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.779122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.779771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] RBAC: Adding query filter params (type=image) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:12.780070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.781447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca2129-6186-403b-aecb-5dd0ef6dba36 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.786327 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 396/787] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:12.792769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:12.893608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca76e72-2b61-45dd-80e9-fb4383c39161 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:12.926931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:12.927532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:12.927810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:12.928077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:12.933458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:12.933458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef118a-b9fb-4ccd-bfd0-efb3d92323c1 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:12.956239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 392/788] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:47:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:13.624378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667030ab-666f-4390-872c-c553f4e2b28b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:13.624924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667030ab-666f-4390-872c-c553f4e2b28b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:13.624924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667030ab-666f-4390-872c-c553f4e2b28b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:13.626523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 397/789] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:13.631983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:13.632269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:13.632542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:13.651826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:13.653048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:13.671577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:13.729575 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 393/790] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:14.000286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667030ab-666f-4390-872c-c553f4e2b28b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.103251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667030ab-666f-4390-872c-c553f4e2b28b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.137635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.138260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.138535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.138806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.141449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.150912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:14.155757 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:14.156700 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:47:14.157898 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:14.161070 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 398/791] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:47:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:14.163144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.263248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48990-4e00-4fec-b2a9-f660615c17c1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.299238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.299834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.300105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.300373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.301077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:14.301373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.302717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafc0c-a773-47c8-9fc1-d88180902270 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:14.310926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 394/792] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:14.316768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.424641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10bb36-10cb-4e3a-b573-4cac26898235 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.440483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560620-5c03-49b0-bd5e-d4d281f4e504 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.440775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560620-5c03-49b0-bd5e-d4d281f4e504 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.441064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a560620-5c03-49b0-bd5e-d4d281f4e504 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.442394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 395/793] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:47:14.448036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.448373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.448711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.459934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.460566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.460870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.461195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.467406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:14.468581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:14.472409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.473937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:14.476776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:47:14.489975 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:14.490941 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:47:14.497321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:47:14.497321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:14.497321 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:14.497321 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 399/794] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:14.498938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.544700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 396/795] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:14.550284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.603607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993a64-4377-4df4-be58-1212a98a2a52 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.639290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.639917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.640136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.640404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.641064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:14.641362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.642771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:14.659264 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 400/796] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:14.660806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.764073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ddde1-dd31-47bc-ae96-1b7d3cc348ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.797691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.798238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.798512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.798778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.806463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.807885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:14.813932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:47:14.820577 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:14.821792 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:47:14.822736 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:14.825299 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 397/797] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:14.827461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.830228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.921837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601e3c-c70a-4410-9697-898e3b3f8d92 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.932063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:14.950349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2feb-d4f4-4be3-8def-711aaf535d32 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:14.961286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.961926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.962204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.962461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.963595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.965030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:14.969173 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 401/798] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:14.972203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:14.991301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:14.992226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:14.992555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:14.993035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:14.993828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:14.994132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:14.995983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.015221 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 398/799] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:47:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:15.020863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.080742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d555b-4224-464e-b2b4-fc84f7e329bf None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.100080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.115624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.116230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.116506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.116777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.117463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.119317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4178c-71e4-4692-8042-e0e9cc8c995a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.152783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 402/800] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:47:14 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:47:15.153014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9024-8332-4d39-8d64-b3a0e40ce2fd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.153714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2136-1d96-4a8b-b502-e7d4393c8c7f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.153998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2136-1d96-4a8b-b502-e7d4393c8c7f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.154271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2136-1d96-4a8b-b502-e7d4393c8c7f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.155643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 403/801] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:47:15.161547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.161837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.162084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.182614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:15.183836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:15.193275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.194022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.194190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.194445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.205873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.207424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.213445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:47:15.224262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:15.225338 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:47:15.226245 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:47:15.226245 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:15.226245 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.226245 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 399/802] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:15.232666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.269657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 404/803] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:15.344634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c707f-8a3e-458c-873c-7de7952dc39f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.358842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.381852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.382452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.382723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.382984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.383963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:15.384409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.385790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.398320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 400/804] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:15.404559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.504183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b1b6d-b4a1-49de-b4e4-1a070e2347be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.538987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.539792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.540072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.540408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.547236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.548659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.559654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:47:15.560895 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:15.561930 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:15.562832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:15.565327 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 405/805] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:15.567624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.594926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.673192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1789-3093-4407-8bb0-3d74c121ad2a None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.675627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196e1b2-93c0-46a3-bce5-17ba57e5c623 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.710350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.710944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.711120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.711291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.711577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.711940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.712244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.712339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.712593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.713324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:15.713617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.713711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.715013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.721440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:15.721440 n-d-858383-14 devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:47:15.721440 n-d-858383-14 devstack@keystone.service[81775]: [parameters: {'id': 'e3e336039eb54eb1afcd3443df4d3a97', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 15:47:15.721440 n-d-858383-14 devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:15.729237 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 15:47:15.730297 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 15:47:15.731674 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 15:47:15.732729 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 15:47:15.734608 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 15:47:15.736429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': 'e3e336039eb54eb1afcd3443df4d3a97', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 15:47:15.737582 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:15.738666 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 15:47:15.740694 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:15.742192 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 406/806] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:15.742341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 401/807] 10.222.0.78 () {60 vars in 1137 bytes} [Tue Oct 18 15:47:15 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:15.742478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.743320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:15.777770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.825400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:15.845537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9a0f-b901-4e03-87ed-58d66ee9e7e5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.857529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156149-1bf4-4a0d-8550-e64efccf22f2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:15.887030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.887666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.888104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.888432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.893263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:15.893915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:15.894187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:15.894462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/22c8c9d9eae1476faf64603b61e794e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:15.896977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=437b718c34ab4dba9fe29716caaf2841, role_id=22c8c9d9eae1476faf64603b61e794e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.898921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.899176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:15.900573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-eee7e2ab-4945-4edb-9cda-fea4751f0df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:47:15.917245 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:15.918310 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:47:15.919229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:47:15.919229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:15.919229 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:15.921083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 402/808] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:47:15 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/437b718c34ab4dba9fe29716caaf2841/roles/22c8c9d9eae1476faf64603b61e794e6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:47:15.923587 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 407/809] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:15.924559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:16.036866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:16.045120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552f3d7-1ee8-4467-9b19-b19d45424c91 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:16.084448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:16.085099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:16.085378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:16.085646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:16.086827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:16.087396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:16.089141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5eb86-7933-41e2-84bd-2bdba38995de None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:16.105129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 403/810] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:17.362689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28ef9-0aad-4e57-a196-7ea64586808b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:17.363235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28ef9-0aad-4e57-a196-7ea64586808b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:17.363235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a28ef9-0aad-4e57-a196-7ea64586808b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:17.364523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 408/811] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:17.369772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:17.370201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:17.370323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:17.388581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:17.389782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:17.454734 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 404/812] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:17.725518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28ef9-0aad-4e57-a196-7ea64586808b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:17.826539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a28ef9-0aad-4e57-a196-7ea64586808b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:17.858477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:17.859090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:17.859363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:17.859630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:17.861447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:17.871140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:17.875900 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:17.877010 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:17.877892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 409/813] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:17.883666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:17.979153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:17.996749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fb8ba-4444-47d0-a1b4-2516924810ac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.029086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.029674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.029942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.030204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.030854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:18.031149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.032490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed7ad-8269-4b11-8eef-5841ab64dc02 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.040841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 405/814] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:18.046540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.060442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c657ab-d437-4c16-a0e4-40e1a62c0da5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.060718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c657ab-d437-4c16-a0e4-40e1a62c0da5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.060986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c657ab-d437-4c16-a0e4-40e1a62c0da5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.062440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 406/815] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:47:18.067527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.067808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.068081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.086139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:18.087346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:18.146735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17e41-99d0-4d01-ba37-2a0b03d22734 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.154558 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 407/816] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:47:18.180922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.181560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.181837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.182105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] PATH_INFO: `/v3/users/ba80ab98292b4fa0bfef7a8243f60bf5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.194757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] RBAC: Authorizing `identity:get_user(user_id=ba80ab98292b4fa0bfef7a8243f60bf5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.196334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.198869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 410/817] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/users/ba80ab98292b4fa0bfef7a8243f60bf5 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:18.204815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.280086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:18.301854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635a423-763f-48f6-8dd9-04ea172f10a4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.339834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.340455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.340728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.341011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.342114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] RBAC: Authorizing `identity:get_project(project_id=08d7cfaef20b4112a22ce19fa4f3b692)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.343520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.345169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 408/818] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:18.351184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.404934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:18.423853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.452447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eceb4bf-1974-4732-99a4-d8f7ff9d62d1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.484984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.485719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.485987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.486251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692/users/ba80ab98292b4fa0bfef7a8243f60bf5/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.488078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] RBAC: Authorizing `identity:create_grant(project_id=08d7cfaef20b4112a22ce19fa4f3b692, user_id=ba80ab98292b4fa0bfef7a8243f60bf5, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.489508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.502687 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 411/819] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:47:18 2022] PUT /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692/users/ba80ab98292b4fa0bfef7a8243f60bf5/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:47:18.527563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73132e40-8a36-48e8-bcc0-b02094d85270 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.563426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.563982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.564252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.564514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.577136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:18.581944 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:18.583140 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 15:47:18.584292 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:18.588445 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 409/820] 10.222.0.78 () {56 vars in 1120 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:47:18.589474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.697380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa173281-bb22-45ff-9afd-5e78d992d426 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.709855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:18.735399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.736341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.736611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.736873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.737552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:18.737847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.739185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.748545 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 412/821] 10.222.0.78 () {56 vars in 1115 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:18.754455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:18.763666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:18.852551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9ee5b-d489-450a-bf6e-e2b6c927c3a1 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:18.884964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:18.885592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:18.885862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:18.886126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:18.896018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:18.897447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:47:18.911048 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:18.912040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:47:18.912934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:47:18.912934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:18.912934 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:18.912934 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 410/822] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:18.918506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.021971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15297-9219-4837-8850-03f787e9c1f5 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.055867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.056463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.056737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.057016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.057658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:19.057953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:19.059293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:19.070257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 413/823] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:19.075895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.134033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:19.176432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3122f9d-e02e-45c2-8903-3b0815f4cc8b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.209477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.210097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.210372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.210641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.218740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:19.220161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:47:19.232148 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:19.233156 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:19.234429 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 411/824] 10.222.0.78 () {56 vars in 1093 bytes} [Tue Oct 18 15:47:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:19.239035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.272002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:19.337360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bd2c4-bc1e-4964-afb2-ccc33fc86691 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.371034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.371665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.371941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.372209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.372960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:19.373292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:19.374739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:19.392748 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 414/825] 10.222.0.78 () {56 vars in 1133 bytes} [Tue Oct 18 15:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:19.398406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.495108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b246da-a406-4bf0-9564-f56f04cd8a50 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.511427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:19.528267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.528839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.529128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.529391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.593482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:19.594903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:19.690406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 412/826] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:47:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 18 15:47:19.696189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.786138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:19.796742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b769a57-1d86-4ef0-bf01-247fe21b9087 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.830483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.831110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.831381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.831648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.841914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:19.843315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:47:19.858029 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:19.859002 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:47:19.859929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:47:19.859929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:47:19.859929 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:19.859929 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 415/827] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:19.864834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:19.882629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:19.964858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be589e5-74f2-4390-8778-eb5f93c3060d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:19.998137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:19.998725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:19.998999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:19.999267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:19.999893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:20.000191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:20.001577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:20.012299 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 413/828] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:20.017927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:20.114338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b4c6f-f504-44c0-92bc-fa016abcdc99 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:20.147991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:20.148660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:20.148932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:20.149231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:20.155741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:20.157192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:47:20.168166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:20.169180 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:47:20.170093 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:20.173143 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 416/829] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:20.175124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:20.253809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:20.276628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a05d-4737-4a9e-8357-a605d65e7e0f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:20.311338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:20.311968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:20.312249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:20.312518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:20.313236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:20.313537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:20.314948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7fe35-661d-4d46-b5b5-7caf71f6886c None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:20.327476 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 414/830] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:20.333637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:20.337831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:20.436659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ea4a2-43b5-48ba-bf15-2528adec1b3f None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:20.469916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:20.470519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:20.470793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:20.471062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:20.471784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] RBAC: Adding query filter params (role.id=22c8c9d9eae1476faf64603b61e794e6, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=437b718c34ab4dba9fe29716caaf2841) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:20.472088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:20.473563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea9370-a2bf-45ec-a396-fdef01ab00a2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:20.480024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 417/831] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:47:20 2022] GET /identity/v3/role_assignments?user.id=437b718c34ab4dba9fe29716caaf2841&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=22c8c9d9eae1476faf64603b61e794e6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:20.660017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d8b6-0796-4d19-9d4c-110c76fa5eb8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:20.660553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d8b6-0796-4d19-9d4c-110c76fa5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:20.660553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d8b6-0796-4d19-9d4c-110c76fa5eb8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:20.662032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 415/832] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:20.667719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:20.668009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:20.668279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:20.686622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:20.687817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:20.751205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:20.761312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 418/833] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:21.031388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d8b6-0796-4d19-9d4c-110c76fa5eb8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:21.133728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d8b6-0796-4d19-9d4c-110c76fa5eb8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:21.167725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:21.168339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:21.168612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:21.168875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:21.175608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:21.180433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:21.185662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:21.186865 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:21.187968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 416/834] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:21.193372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:21.295572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e241122-83fe-4c90-8b5d-c9c5d092c6fd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:21.329886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:21.330483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:21.330753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:21.331016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:21.331677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:21.331970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:21.333348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:21.342181 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 419/835] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:21.348191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:21.444145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e13896-7712-4e0a-bd8a-04adda341a19 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:21.476317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:21.476943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:21.477241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:21.477503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] PATH_INFO: `/v3/users/ba80ab98292b4fa0bfef7a8243f60bf5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:21.478587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ba80ab98292b4fa0bfef7a8243f60bf5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:21.479985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:21.481810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 417/836] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/users/ba80ab98292b4fa0bfef7a8243f60bf5 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:21.487548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:21.545500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:21.586239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fb81d-77e9-4725-ab8d-813133a6c17b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:21.618979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:21.619567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:21.619844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:21.620111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:21.686338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:21.687748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:21.744197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:21.784839 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 420/837] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:47:21.790720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:21.853734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:21.887340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10e3b-1901-441f-abb4-2b6a3ecb71f9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:21.918899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:21.919503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:21.919775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:21.920039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:21.921139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] RBAC: Authorizing `identity:get_project(project_id=08d7cfaef20b4112a22ce19fa4f3b692)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:21.922547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42554754-5f3e-45c5-9546-313c3fe2f584 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:21.924114 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 418/838] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:21.930185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:22.025601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd1ae-bba5-4374-860b-5ec1903ee56c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:22.057927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:22.058515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:22.058790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:22.059057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:22.059778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=08d7cfaef20b4112a22ce19fa4f3b692, user.id=ba80ab98292b4fa0bfef7a8243f60bf5) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:22.060078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:22.061512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432e08-39ae-4dc3-a558-c4555fb82a0a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:22.067030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 421/839] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:47:21 2022] GET /identity/v3/role_assignments?user.id=ba80ab98292b4fa0bfef7a8243f60bf5&scope.project.id=08d7cfaef20b4112a22ce19fa4f3b692&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:24.199748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874be4-7d36-440d-811e-79c0a22c79e7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:24.200283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874be4-7d36-440d-811e-79c0a22c79e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:24.200283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874be4-7d36-440d-811e-79c0a22c79e7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:24.201569 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 419/840] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:24.206820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:24.207229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:24.207364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:24.226347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:24.227543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:24.244543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:24.293628 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 422/841] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:24.564778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874be4-7d36-440d-811e-79c0a22c79e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:24.662961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874be4-7d36-440d-811e-79c0a22c79e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:24.696358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:24.697077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:24.697355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:24.697625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:24.698744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:24.700176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49854085-7409-4524-b80b-39fd6897b3e6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:24.701779 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 420/842] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:24.707685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:24.811047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393b9dc-8f98-478a-86e0-54294804ce7c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:24.850378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:24.850991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:24.851266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:24.851623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:24.852474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:24.853913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff81c8-523b-4add-836c-5ef148cddbef None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:24.879771 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 423/843] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:47:24 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:27.097167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ca8e-136b-46d1-a0c1-e51072104595 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:27.097688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ca8e-136b-46d1-a0c1-e51072104595 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:27.097688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228ca8e-136b-46d1-a0c1-e51072104595 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:27.099039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 421/844] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:27.104700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:27.105113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:27.105268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:27.123726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:27.124885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:27.127695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:27.189489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 424/845] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:27.461855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228ca8e-136b-46d1-a0c1-e51072104595 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:27.464626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:27.563013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228ca8e-136b-46d1-a0c1-e51072104595 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:27.597187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:27.597795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:27.598068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:27.598338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] PATH_INFO: `/v3/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:27.599702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] RBAC: Authorizing `identity:get_role(role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:27.601085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:27.603110 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 422/846] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:27 2022] GET /identity/v3/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:27.609343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:27.704106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf093f-874c-4170-b8f7-06ecf79aea67 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:27.737141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:27.737704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:27.737978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:27.738245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] PATH_INFO: `/v3/users/141cd95212e74650837864a5f4555c6c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:27.748726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:27.752150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] RBAC: Authorizing `identity:get_user(user_id=141cd95212e74650837864a5f4555c6c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:27.753756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:27.755333 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 425/847] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:27 2022] GET /identity/v3/users/141cd95212e74650837864a5f4555c6c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:27.761263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:27.828649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:27.859484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57539c-608a-4920-b8f1-dd9b2a144ccb None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:27.892682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:27.893313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:27.893587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:27.893852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:27.894926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] RBAC: Authorizing `identity:get_project(project_id=08d7cfaef20b4112a22ce19fa4f3b692)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:27.896357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a50ec1-01cb-4c2a-9ef8-3848a0150626 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:27.897965 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 423/848] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:27 2022] GET /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:27.903914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:27.999940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448de7-ab19-4b58-8de7-414b5cacdfb0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:28.031642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:28.032285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:28.032557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:28.032823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692/users/141cd95212e74650837864a5f4555c6c/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:28.034919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] RBAC: Authorizing `identity:create_grant(project_id=08d7cfaef20b4112a22ce19fa4f3b692, user_id=141cd95212e74650837864a5f4555c6c, role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:28.036319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edcc48-4c79-40e3-8884-fe560229d63a None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:28.049822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 426/849] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:47:27 2022] PUT /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692/users/141cd95212e74650837864a5f4555c6c/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:47:30.149369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae48b5-797f-4bc7-9740-0f2845b80e0a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:30.149890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae48b5-797f-4bc7-9740-0f2845b80e0a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:30.149890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae48b5-797f-4bc7-9740-0f2845b80e0a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:30.151212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 424/850] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:30.156679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:30.157073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:30.157268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:30.175460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:30.176620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:30.228303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:30.242632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 427/851] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:30.510004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae48b5-797f-4bc7-9740-0f2845b80e0a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:30.607082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae48b5-797f-4bc7-9740-0f2845b80e0a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:30.640661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:30.641294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:30.641566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:30.641830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] PATH_INFO: `/v3/roles/e836d7d42e2b405ea81e90a304bcb4ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:30.643174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] RBAC: Authorizing `identity:get_role(role_id=e836d7d42e2b405ea81e90a304bcb4ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:30.644521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:30.645824 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 425/852] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:30 2022] GET /identity/v3/roles/e836d7d42e2b405ea81e90a304bcb4ff => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:30.651630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:30.745732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f6d5-249c-4e69-876f-e1536cda52a5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:30.777883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:30.778438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:30.778713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:30.778981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] PATH_INFO: `/v3/users/141cd95212e74650837864a5f4555c6c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:30.780082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] RBAC: Authorizing `identity:get_user(user_id=141cd95212e74650837864a5f4555c6c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:30.781524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:30.783067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 428/853] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:30 2022] GET /identity/v3/users/141cd95212e74650837864a5f4555c6c => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:30.789392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:30.798180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:30.891642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a02d8-b254-435b-89af-cb3aabad96aa None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:30.924324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:30.924918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:30.925218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:30.925493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:30.993348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:30.994773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:31.002135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:31.089430 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 426/854] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:47:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:47:31.095225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:31.150630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:31.193120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9500722-255b-4d77-97bc-1b1d7a032106 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:31.225343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:31.225975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:31.226891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:31.227360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] PATH_INFO: `/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:31.228477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=08d7cfaef20b4112a22ce19fa4f3b692)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:31.229914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba6541-f78f-4558-b8c7-3e82fe05fbd2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:31.231762 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 429/855] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:31 2022] GET /identity/v3/projects/08d7cfaef20b4112a22ce19fa4f3b692 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:31.237928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:31.333479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868abf6d-3d68-49f7-aeeb-a92450f6f950 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:31.341119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:31.368461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:31.369071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:31.369351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:31.369621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:31.370331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] RBAC: Adding query filter params (role.id=e836d7d42e2b405ea81e90a304bcb4ff, scope.project.id=08d7cfaef20b4112a22ce19fa4f3b692, user.id=141cd95212e74650837864a5f4555c6c) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:31.370632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:31.372043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188ce6c-f298-4345-9c47-fd3a26937db9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:31.377689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 427/856] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:47:31 2022] GET /identity/v3/role_assignments?user.id=141cd95212e74650837864a5f4555c6c&scope.project.id=08d7cfaef20b4112a22ce19fa4f3b692&role.id=e836d7d42e2b405ea81e90a304bcb4ff => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:33.522181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e17af-a4ac-48d1-a04c-9a917d37ac5e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:33.522717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e17af-a4ac-48d1-a04c-9a917d37ac5e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:33.522717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e17af-a4ac-48d1-a04c-9a917d37ac5e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:33.524787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 430/857] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:33.529928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:33.530383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:33.530478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:33.549210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:33.550372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:33.614292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 428/858] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:33.885126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e17af-a4ac-48d1-a04c-9a917d37ac5e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:33.985721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e17af-a4ac-48d1-a04c-9a917d37ac5e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:34.008706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:34.019333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:34.019952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:34.020231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:34.020499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:34.021598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:34.023601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84d642-330d-420c-a77f-cf27d70561a3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:34.025164 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 431/859] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:34.031073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:34.123153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:34.126040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1317d-fecb-4b09-af3e-262131245e17 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:34.160443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:34.161019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:34.161324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:34.161627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:34.162285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:34.163845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11979262-b8e0-47d1-a1b5-59169afa8889 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:34.189305 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 429/860] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:47:34 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:36.333659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ba876-4ddf-4f00-8227-836b8471542e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:36.334182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ba876-4ddf-4f00-8227-836b8471542e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:36.334182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ba876-4ddf-4f00-8227-836b8471542e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:36.336160 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 432/861] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:36.341379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436822a-7eea-42fb-9671-be014633d436 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:36.341802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436822a-7eea-42fb-9671-be014633d436 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:36.341911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436822a-7eea-42fb-9671-be014633d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:36.360496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f436822a-7eea-42fb-9671-be014633d436 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:36.361688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f436822a-7eea-42fb-9671-be014633d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:36.424864 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 430/862] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:36.695354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ba876-4ddf-4f00-8227-836b8471542e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:36.794396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ba876-4ddf-4f00-8227-836b8471542e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:36.826996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:36.827602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:36.827879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:36.828143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:36.829256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:36.830653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d542ea9-0da6-42e0-8a58-b5ab165b2145 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:36.832161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 433/863] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:47:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:36.837946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436822a-7eea-42fb-9671-be014633d436 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:36.915680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:36.934963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436822a-7eea-42fb-9671-be014633d436 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:36.969247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:36.969780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:36.970138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:36.970495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:36.971130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:36.972545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa557d-51c0-4f9b-8b1d-d1569ddceb0d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:36.993382 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 431/864] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:47:36 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:39.202980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e746e9-29c4-4fed-aeeb-437d99a53118 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:39.203526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e746e9-29c4-4fed-aeeb-437d99a53118 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:39.203526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e746e9-29c4-4fed-aeeb-437d99a53118 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:39.204767 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 434/865] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:39.210644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:39.211481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:39.211481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:39.228741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:39.229948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:39.293845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 432/866] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:39.562450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e746e9-29c4-4fed-aeeb-437d99a53118 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:39.621441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:39.664214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e746e9-29c4-4fed-aeeb-437d99a53118 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:39.697767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:39.698389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:39.698684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:39.698958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:39.708689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:39.714301 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:39.715547 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:39.716888 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 435/867] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:39.721613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:39.784753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:39.818930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca397d72-9302-4424-ad56-bab2703659a3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:39.852949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:39.853555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:39.853830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:39.854096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:39.854745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:39.855044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:39.856691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:39.864455 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 433/868] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:39.871171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:39.969159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e09979-f6e6-45ed-86c5-eb94a0c004d7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:39.988658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:40.003152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:40.003763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:40.004033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:40.004295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] PATH_INFO: `/v3/users/b91576f118cc49aaaaf5eeeabeecf054` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:40.016834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] RBAC: Authorizing `identity:get_user(user_id=b91576f118cc49aaaaf5eeeabeecf054)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:40.018266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:40.019818 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 436/869] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:39 2022] GET /identity/v3/users/b91576f118cc49aaaaf5eeeabeecf054 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:47:40.025978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:40.122010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf316-7594-4837-85b5-a8f149802718 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:40.148577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:40.154407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:40.155027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:40.155303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:40.155572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] PATH_INFO: `/v3/projects/56eff441cc4f414784101430426ee94f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:40.156673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] RBAC: Authorizing `identity:get_project(project_id=56eff441cc4f414784101430426ee94f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:40.158138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8befb-7df4-4dc4-8e55-6ed4b5a9f508 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:40.159740 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 434/870] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:40 2022] GET /identity/v3/projects/56eff441cc4f414784101430426ee94f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:40.166212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:40.262378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab20c-8596-4619-9dcb-097a1d9fae1d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:40.295274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:40.295917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:40.296192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:40.296460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] PATH_INFO: `/v3/projects/56eff441cc4f414784101430426ee94f/users/b91576f118cc49aaaaf5eeeabeecf054/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:40.298386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=56eff441cc4f414784101430426ee94f, user_id=b91576f118cc49aaaaf5eeeabeecf054, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:40.299781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044917e-cfbb-471a-a8b7-851c9c5057f4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:40.312672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 437/871] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:47:40 2022] PUT /identity/v3/projects/56eff441cc4f414784101430426ee94f/users/b91576f118cc49aaaaf5eeeabeecf054/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:47:42.454040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0181-a5bf-44f8-ac33-3491b4581f02 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:42.454592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0181-a5bf-44f8-ac33-3491b4581f02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:42.454592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0181-a5bf-44f8-ac33-3491b4581f02 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:42.455950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 435/872] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:42.461679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:42.462101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:42.462209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:42.481705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:42.482872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:42.510747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:42.547818 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 438/873] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:42.831692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0181-a5bf-44f8-ac33-3491b4581f02 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:42.929900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0181-a5bf-44f8-ac33-3491b4581f02 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:42.964885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:42.965528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:42.965802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:42.966068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:42.976694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:42.981835 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:42.982891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:42.983746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 436/874] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:42.989439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:43.087770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53d1e-829a-4993-8446-b1bfe7e396f3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:43.120903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:43.121523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:43.121800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:43.122069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:43.122756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:43.123081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:43.124496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:43.132275 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 439/875] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:43.138406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:43.196087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:43.237515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b963-3dea-4491-9f89-5ec3faec562c None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:43.270131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:43.270739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:43.271016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:43.271284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] PATH_INFO: `/v3/users/b91576f118cc49aaaaf5eeeabeecf054` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:43.272985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] RBAC: Authorizing `identity:get_user(user_id=b91576f118cc49aaaaf5eeeabeecf054)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:43.274430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:43.275966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 437/876] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:43 2022] GET /identity/v3/users/b91576f118cc49aaaaf5eeeabeecf054 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:43.281860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:43.312315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:43.379988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35fe0-a892-44b1-8264-c94834c5927d None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:43.412085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:43.412676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:43.413093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:43.413368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:43.477720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:43.479136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:43.506395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:43.573681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 440/877] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:47:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:47:43.579578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:43.677077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683ef88-d5ee-4c02-b336-fc4924674e50 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:43.701922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:43.710923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:43.711539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:43.711815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:43.712084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] PATH_INFO: `/v3/projects/56eff441cc4f414784101430426ee94f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:43.713232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] RBAC: Authorizing `identity:get_project(project_id=56eff441cc4f414784101430426ee94f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:43.714656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7921-d11b-4cda-9589-009e2f7d595d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:43.716247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 438/878] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:43 2022] GET /identity/v3/projects/56eff441cc4f414784101430426ee94f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:43.722368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:43.817469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a06a62-4ee2-4b8f-9e77-903d32d04807 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:43.844902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:43.851525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:43.852107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:43.852383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:43.852651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:43.853399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=56eff441cc4f414784101430426ee94f, user.id=b91576f118cc49aaaaf5eeeabeecf054) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:43.853702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:43.855104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273a5fd-9486-4e64-86e4-b565ca059e33 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:43.860935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 441/879] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:47:43 2022] GET /identity/v3/role_assignments?user.id=b91576f118cc49aaaaf5eeeabeecf054&scope.project.id=56eff441cc4f414784101430426ee94f&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:45.981152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4328d-95ce-4869-a85f-482fe5195528 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:45.981677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4328d-95ce-4869-a85f-482fe5195528 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:45.981677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4328d-95ce-4869-a85f-482fe5195528 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:45.982992 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 439/880] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:45.988110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c562-5dcb-4d2d-89b5-70476de8a75b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:45.988551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c562-5dcb-4d2d-89b5-70476de8a75b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:45.988643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c562-5dcb-4d2d-89b5-70476de8a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:46.006260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e11c562-5dcb-4d2d-89b5-70476de8a75b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:46.008008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e11c562-5dcb-4d2d-89b5-70476de8a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:46.071823 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 442/881] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:46.342490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4328d-95ce-4869-a85f-482fe5195528 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:46.441006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4328d-95ce-4869-a85f-482fe5195528 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:46.476003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:46.476591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:46.476865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:46.477164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:46.477836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:46.479179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f5631-4144-4232-a2d0-831d9b6ebf97 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:46.494383 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 440/882] 10.222.0.78 () {60 vars in 1138 bytes} [Tue Oct 18 15:47:46 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:48.663330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee19d2-5f5c-483b-83cf-d0fc64a8176f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:48.663896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee19d2-5f5c-483b-83cf-d0fc64a8176f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:48.663896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee19d2-5f5c-483b-83cf-d0fc64a8176f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:48.665240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 443/883] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:48.670831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:48.671251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:48.671365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:48.690887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:48.692055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:48.741549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:48.759021 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 441/884] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:49.025375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee19d2-5f5c-483b-83cf-d0fc64a8176f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:49.125693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee19d2-5f5c-483b-83cf-d0fc64a8176f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:49.149322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:49.159962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:49.160582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:49.160861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:49.161162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] PATH_INFO: `/v3/domains/0d763677303f4cb2812267ef31fdd66b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:49.171384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d763677303f4cb2812267ef31fdd66b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:49.172871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34fb00-e0d9-4a6c-9028-8d191ae946bc None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:49.174553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 444/885] 10.222.0.78 () {56 vars in 1183 bytes} [Tue Oct 18 15:47:49 2022] GET /identity/v3/domains/0d763677303f4cb2812267ef31fdd66b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:49.181255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:49.276197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e18b3a-682a-4e7a-a0fd-737f42596955 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:49.308500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:49.309111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:49.309385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:49.309649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:49.310270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:49.311671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95085258-fdec-461d-8c9e-57e2bc112dec None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:49.337800 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 442/886] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:47:49 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:51.542519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e90-4e14-4fa5-a60a-6d68efa9da62 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:51.543079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e90-4e14-4fa5-a60a-6d68efa9da62 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:51.543079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e90-4e14-4fa5-a60a-6d68efa9da62 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:51.544397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 445/887] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:51.549541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:51.549921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:51.550084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:51.569510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:51.570854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:51.598315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:51.636261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 443/888] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:51.902018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847e90-4e14-4fa5-a60a-6d68efa9da62 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:52.003472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847e90-4e14-4fa5-a60a-6d68efa9da62 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:52.037527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:52.038210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:52.038487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:52.038755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] PATH_INFO: `/v3/domains/0d763677303f4cb2812267ef31fdd66b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:52.039865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d763677303f4cb2812267ef31fdd66b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:52.041302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57829c9-2095-492b-b589-6f0eb0f1de15 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:52.042863 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 446/889] 10.222.0.78 () {56 vars in 1183 bytes} [Tue Oct 18 15:47:51 2022] GET /identity/v3/domains/0d763677303f4cb2812267ef31fdd66b => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:52.048651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:52.144160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01e074-2489-4b93-91b9-0e75ab7601b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:52.177168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64407cc-5507-4faa-918d-16606890839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:52.177702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64407cc-5507-4faa-918d-16606890839e None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:52.178529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64407cc-5507-4faa-918d-16606890839e None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:52.178802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64407cc-5507-4faa-918d-16606890839e None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:52.179544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64407cc-5507-4faa-918d-16606890839e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:52.180960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64407cc-5507-4faa-918d-16606890839e None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:52.201163 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 444/890] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:47:52 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:47:54.326254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f4-58e7-4319-bfd4-e5ba01c97749 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:54.326792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f4-58e7-4319-bfd4-e5ba01c97749 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:54.326792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c9f4-58e7-4319-bfd4-e5ba01c97749 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:54.328036 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 447/891] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:54.333096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:54.333513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:54.333696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:54.353241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:54.354419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:54.370679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:54.420370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 445/892] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:54.698012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c9f4-58e7-4319-bfd4-e5ba01c97749 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:54.752016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:54.799900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c9f4-58e7-4319-bfd4-e5ba01c97749 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:54.833291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:54.833907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:54.834224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:54.834490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:54.844109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:54.849231 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:54.850876 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:47:54.852102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 448/893] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:54.857336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:54.952153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5511a-6014-4079-866f-c6a00b3d3b4f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:54.985578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:54.986163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:54.986438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:54.986702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:54.987350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:54.987646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:54.989018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:54.997546 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 446/894] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:55.003326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:55.099376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4686e67-3ac8-4fab-a749-43e57ec90240 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:55.112832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:55.133179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:55.133793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:55.134063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:55.134327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] PATH_INFO: `/v3/users/32115f6294bb4ca08e6d0d3865ec57ac` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:55.147386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] RBAC: Authorizing `identity:get_user(user_id=32115f6294bb4ca08e6d0d3865ec57ac)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:55.148797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:55.150393 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 449/895] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:55 2022] GET /identity/v3/users/32115f6294bb4ca08e6d0d3865ec57ac => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:55.156129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:55.172458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:55.257505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3a437-a51f-4979-b6e9-dc81ebfc446f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:55.289973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:55.290700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:55.290970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:55.291234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] PATH_INFO: `/v3/projects/531f632679f24d08b23b061aa89cd28c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:55.292320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] RBAC: Authorizing `identity:get_project(project_id=531f632679f24d08b23b061aa89cd28c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:55.293757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9ac4b-779c-4e0e-934d-d9e88e615ebb None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:55.295348 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 447/896] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:55 2022] GET /identity/v3/projects/531f632679f24d08b23b061aa89cd28c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:55.301449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:55.397681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197cc56-4781-43b8-9cda-0a8a68a22e21 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:55.430679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:55.431317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:55.431592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:55.431863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] PATH_INFO: `/v3/projects/531f632679f24d08b23b061aa89cd28c/users/32115f6294bb4ca08e6d0d3865ec57ac/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:55.433763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] RBAC: Authorizing `identity:create_grant(project_id=531f632679f24d08b23b061aa89cd28c, user_id=32115f6294bb4ca08e6d0d3865ec57ac, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:55.435192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e948-065b-4b34-8376-2d0b57aa3216 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:55.448242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 450/897] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:47:55 2022] PUT /identity/v3/projects/531f632679f24d08b23b061aa89cd28c/users/32115f6294bb4ca08e6d0d3865ec57ac/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:47:57.540411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526218da-f814-44be-9163-285af6a8e02b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:57.540966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526218da-f814-44be-9163-285af6a8e02b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:57.540966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526218da-f814-44be-9163-285af6a8e02b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:57.542288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 448/898] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:47:57.547608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:57.548004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:57.548155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:57.566885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:47:57.568086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:47:57.591501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:57.636295 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 451/899] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:47:57.912902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526218da-f814-44be-9163-285af6a8e02b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:57.993229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:58.012438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526218da-f814-44be-9163-285af6a8e02b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.045422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.046033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.046305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.046573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.057041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:47:58.061758 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:47:58.062807 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:47:58.064017 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 449/900] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:47:58.069432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:58.165903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ec8c-4071-4b20-bad7-4bc1436200f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.199497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.200086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.200359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.200626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.201314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:58.201610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:58.202952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:58.211569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 452/901] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:47:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:58.217577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:58.318161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b454cf-cbb6-4d92-b80f-2719d42ad7cd None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.353207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.353814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.354090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.354361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] PATH_INFO: `/v3/users/32115f6294bb4ca08e6d0d3865ec57ac` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.355482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=32115f6294bb4ca08e6d0d3865ec57ac)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:58.357203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:58.358753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 450/902] 10.222.0.78 () {56 vars in 1177 bytes} [Tue Oct 18 15:47:58 2022] GET /identity/v3/users/32115f6294bb4ca08e6d0d3865ec57ac => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:58.364448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:58.389938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:58.462092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42134e-0811-4d7b-8226-23e8aea13920 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.493273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.493858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.494128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.494391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.558403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:58.559804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:58.581431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:58.656824 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 453/903] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:47:58.663397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:58.675579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:58.760321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b87fe-4bfb-4791-9ffa-c4cd4fd96ac9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.793562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.794175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.794447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.794713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] PATH_INFO: `/v3/projects/531f632679f24d08b23b061aa89cd28c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.795801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] RBAC: Authorizing `identity:get_project(project_id=531f632679f24d08b23b061aa89cd28c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:58.797245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432fa46-b3f2-429d-962f-d09ebc008b81 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:58.798836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 451/904] 10.222.0.78 () {56 vars in 1186 bytes} [Tue Oct 18 15:47:58 2022] GET /identity/v3/projects/531f632679f24d08b23b061aa89cd28c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:47:58.805723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:47:58.906418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafb472-84ef-4b78-8a01-d86dc8dd06de None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:47:58.928521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:47:58.942170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:47:58.942765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:47:58.943036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:47:58.943970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:47:58.944770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=531f632679f24d08b23b061aa89cd28c, user.id=32115f6294bb4ca08e6d0d3865ec57ac) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:47:58.945112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:47:58.946514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367acc5-e980-47a3-bc36-712d9733ffe5 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:47:58.952041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 454/905] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:47:58 2022] GET /identity/v3/role_assignments?user.id=32115f6294bb4ca08e6d0d3865ec57ac&scope.project.id=531f632679f24d08b23b061aa89cd28c&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:48:08.789479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=61 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:08.949532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:54.935223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd964c44-7460-4d45-bc36-806e2bf81215 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:54.936183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd964c44-7460-4d45-bc36-806e2bf81215 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:54.936568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd964c44-7460-4d45-bc36-806e2bf81215 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:54.938060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 452/906] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:48:54.945398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:54.945988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:54.945988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:54.968296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:48:54.969555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:48:55.065678 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 455/907] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:48:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:48:55.364219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd964c44-7460-4d45-bc36-806e2bf81215 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:55.492794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd964c44-7460-4d45-bc36-806e2bf81215 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:55.541905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:55.542536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:55.542849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:55.543066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:55.555825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:55.557896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:48:55.579255 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:48:55.580381 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:48:55.582025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:48:55.582025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:48:55.582025 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:48:55.584326 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 453/908] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:48:55.591123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:55.738559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c56f0-938b-4313-aff1-ebf99446e808 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:55.784838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:55.796943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:55.797600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:55.797876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:55.798144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:55.798798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:48:55.799094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:55.801107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b1984-4c08-472f-b546-21ee3272fa07 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:55.820513 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 456/909] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:48:55.823066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:55.897487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:55.965902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3de2-809b-4c20-975a-1492393c16c5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:56.044769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:56.045410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:56.045879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:56.046262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:56.047184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:56.049183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1fc75-a8df-4d7f-b3dd-f1b6847a4c8f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:56.075287 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 454/910] 10.222.0.78 () {60 vars in 1132 bytes} [Tue Oct 18 15:48:55 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:48:58.478066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fcfa-c3c3-4407-a1f3-1dee41c31685 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:58.478657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fcfa-c3c3-4407-a1f3-1dee41c31685 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:58.478657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10fcfa-c3c3-4407-a1f3-1dee41c31685 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:58.480856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 457/911] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:48:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:48:58.486255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:58.486696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:58.486806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:58.506663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:48:58.507860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:48:58.597042 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 455/912] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:48:58.886148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fcfa-c3c3-4407-a1f3-1dee41c31685 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:59.028449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10fcfa-c3c3-4407-a1f3-1dee41c31685 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:59.075611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:59.076276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:59.076589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:59.076867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:59.091565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:48:59.097365 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:48:59.099102 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:48:59.100140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 458/913] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:48:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:48:59.104535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:59.149055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:59.240781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6af75-967c-4e83-a2a1-378f1832ca4a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:59.290257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:59.290797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:59.291074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:59.291338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:59.292010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:48:59.292447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:59.293872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:59.303535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 456/914] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:48:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:48:59.310751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:59.373137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:59.432582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946f38b-1ab1-41cb-a72c-600bf5c787cd None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:59.477061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:59.477699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:59.477973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:59.478239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:59.490004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:59.491463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:48:59.508484 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:48:59.509863 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:48:59.510745 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:48:59.510745 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:48:59.510745 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:48:59.510745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 459/915] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:48:59.515713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:59.636656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:59.642732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4aabc-d60a-4605-b279-9c5c4e16fc23 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:59.693490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:59.694170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:59.694543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:59.694950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:59.695769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:48:59.696199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:59.697852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:59.715683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 457/916] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:48:59.723159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:48:59.835867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11117e-2aa6-438a-8b7e-b4cbeb20a388 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:48:59.837713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:48:59.875309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:48:59.876034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:48:59.876395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:48:59.876725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:48:59.884901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:48:59.886535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:48:59.899098 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:48:59.900291 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:48:59.901492 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:48:59.902340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 460/917] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:48:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:48:59.909517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.034883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5b641-b986-4e37-9b5d-efd0932b61e2 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.074517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.075199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.075578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.075887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:00.077642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:00.077642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:00.078594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:00.103605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 458/918] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 18 15:48:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:49:00.105115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.213109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65fb79-bc8b-4a01-94af-606c4a58c2a6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.250119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.250739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.251069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.251280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:00.262189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:00.263609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:00.277641 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:00.278652 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:00.279594 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:00.279594 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:00.279594 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:00.283582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 461/919] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:00.285475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.305239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:00.392051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4db29-2e63-406e-bbdd-831f541cc112 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.429219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.429828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.430106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.430380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:00.431017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:00.431309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:00.432674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:00.446460 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 459/920] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:49:00.451318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.470209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:00.568119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd838-ede7-4397-aa1e-f2c56058dd1c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.608413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.609071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.609346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.609612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:00.617196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:00.618626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:49:00.630848 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:00.631809 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:00.632741 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:00.637740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 462/921] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:00.639463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.737574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:00.763112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b0aff-a7e2-47e9-824c-3cb7121eaa0d None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.801892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.802865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.803487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.803867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:00.805062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:00.805698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:00.807856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491455a-c7e9-441e-b431-bd81986a11b0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:00.829499 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 460/922] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:00.831523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:00.926512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:00.958515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348dfc3-0404-4d4a-811c-2993c7b2348b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:00.995731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:00.996498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:00.996744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:00.997432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/c0d2b97624d649e3b36fd2fad9f31dbf/roles/ebe7b26822a5461ba35150dfb8264e8d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:01.015359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=c0d2b97624d649e3b36fd2fad9f31dbf, role_id=ebe7b26822a5461ba35150dfb8264e8d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:01.016793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bbd54-7fb0-49b7-b5b5-1cbf6ecf7855 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:01.031017 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 463/923] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:49:00 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/c0d2b97624d649e3b36fd2fad9f31dbf/roles/ebe7b26822a5461ba35150dfb8264e8d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:49:03.427611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bb18-c407-4063-98eb-182d6328b51d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:03.428186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bb18-c407-4063-98eb-182d6328b51d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:03.428186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bb18-c407-4063-98eb-182d6328b51d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:03.429515 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 461/924] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:03.434877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:03.435337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:03.435428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:03.453874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:03.455102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:03.525859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 464/925] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:03.815099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bb18-c407-4063-98eb-182d6328b51d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:03.937588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bb18-c407-4063-98eb-182d6328b51d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:03.973558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:03.974185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:03.974456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:03.974720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:03.982286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:03.987456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:49:03.995769 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:03.996827 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:03.998000 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 462/926] 10.222.0.78 () {56 vars in 1102 bytes} [Tue Oct 18 15:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:04.003893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:04.066879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:04.116882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daf6c2-d6fe-4cd4-8139-4a60452d9a95 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:04.154007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:04.154707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:04.155035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:04.155371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:04.156126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:04.156430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:04.158209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:04.168529 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 465/927] 10.222.0.78 () {56 vars in 1103 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:04.175418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:04.290313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e0df8-e39a-420d-ac23-843bab014ed4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:04.332682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:04.333375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:04.333778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:04.334180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:04.350010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:04.354131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:04.372561 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:04.373978 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:04.374877 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:04.374877 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:04.374877 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:04.374877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 463/928] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:49:04.380481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:04.487824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eea0fe-0cdd-4725-9c1f-bf8f5ab6a3a7 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:04.505560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:04.524135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:04.524781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:04.525088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:04.525466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:04.526079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:04.526521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:04.527887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:04.545502 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 466/929] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:04.551507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:04.606205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:04.665712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9f083-b914-4957-895c-836e0898b62b None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:04.704882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:04.705617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:04.705891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:04.706152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:04.714480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:04.715910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:49:04.727446 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:04.728596 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:04.730085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 464/930] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:04.734801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:04.841706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eda40-3e79-45ae-86b1-1fa55a79defa None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:04.882254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:04.883017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:04.883369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:04.883737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:04.884671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:04.885206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:04.887051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:04.908069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 467/931] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:04.914258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:05.029664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236c79-09bc-4311-8be0-3115807174f5 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:05.041234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.068570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:05.069213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:05.069564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:05.069804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:05.148468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:05.149870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:05.257029 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 465/932] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:49:05.262389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:05.298854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.373878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60c67-8175-4b68-af02-00ae13550ac0 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:05.410027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:05.410605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:05.410882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:05.411152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:05.421417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:05.422879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:05.440218 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:05.441394 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:05.442592 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:05.442592 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:05.442592 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:05.442592 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 468/933] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:05.447801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:05.461580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.554895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa10f8-c878-4c68-87d5-aa48b8c46ba0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:05.594552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:05.595155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:05.595433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:05.595707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:05.596648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:05.597016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:05.598377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:05.611139 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 466/934] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:05.618210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:05.724231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.744279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21085ada-3113-49aa-92b8-6137bcc47919 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:05.782548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:05.783175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:05.783486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:05.783798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:05.791854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:05.793616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:49:05.806557 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:05.807684 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:05.808571 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 469/935] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:05.813562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:05.887856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:05.924739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60f375-69ad-4ed3-9466-d97bdddef734 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:05.963688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:05.964411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:05.964759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:05.965159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:05.965991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:05.966418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:05.968159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5933cbc-5487-49e3-b18f-eba511bd7428 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:05.984030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 467/936] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:49:05.990315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:06.108003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777da92d-3fca-42f9-8f5d-3d0caee6c2da None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:06.146271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:06.146861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:06.147135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:06.147406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:06.148128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] RBAC: Adding query filter params (role.id=ebe7b26822a5461ba35150dfb8264e8d, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=c0d2b97624d649e3b36fd2fad9f31dbf) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:06.148431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:06.150032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1f41-6b19-4339-8136-e072fcefa3b4 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:06.157202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 470/937] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:49:05 2022] GET /identity/v3/role_assignments?user.id=c0d2b97624d649e3b36fd2fad9f31dbf&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=ebe7b26822a5461ba35150dfb8264e8d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:08.432657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1768-c1b2-45ac-9623-3ba00275599e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:08.433249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1768-c1b2-45ac-9623-3ba00275599e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:08.433375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e1768-c1b2-45ac-9623-3ba00275599e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:08.434768 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 468/938] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:08.441271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:08.441715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:08.441877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:08.461946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:08.463134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:08.466466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:08.542034 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 471/939] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:08.818651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1768-c1b2-45ac-9623-3ba00275599e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:08.943135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e1768-c1b2-45ac-9623-3ba00275599e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:08.975545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:08.982492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:08.983157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:08.983492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:08.983763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:08.996000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:49:09.001215 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:09.002318 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:09.003339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 469/940] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:09.008786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:09.123380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583e77a-f94b-460e-b882-4d642dfc7c97 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:09.159596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:09.160257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:09.160578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:09.160928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:09.161721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:09.162036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:09.163665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:09.172981 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 472/941] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:09.178970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:09.303252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78656e-6877-4e0e-aa05-cb2dcad88611 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:09.344746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:09.345486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:09.345835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:09.346323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:09.356951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:09.358415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:09.373282 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:09.374455 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:09.375532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:09.375532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:09.375532 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:09.375532 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 470/942] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:49:09.382510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:09.385532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:09.501061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12f56-a114-4c49-b8fe-38a262ec39d3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:09.542688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:09.543298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:09.543572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:09.543839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:09.544484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:09.544810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:09.546364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:09.565064 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 473/943] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:09.568835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:09.622449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:09.701801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf80eb-8b5e-49c9-9ce2-6b155b2ec6f4 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:09.738813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:09.739507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:09.739814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:09.740066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] PATH_INFO: `/v3/users/placement` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:09.749269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:09.750810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:49:09.762909 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:09.769663 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:09.770896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 471/944] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:09.771620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:09.837758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:09.882346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff43b04-6eda-46ec-b264-c0939c40c61b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:09.918518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:09.919334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:09.919822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:09.920162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:09.921324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:09.921711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:09.923703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:09.944954 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 474/945] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:09.953397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:10.068712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31083e6-3ecf-4b50-9202-acfd5eba72be None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:10.070611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:10.106298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:10.106916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:10.107186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:10.107453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:10.118436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:10.119964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:10.134849 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:10.136031 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:10.137132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:10.137132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:10.137132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:10.137132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 472/946] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:10.141838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:10.249315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad3d-19e2-431a-b1b3-526f7e0cea73 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:10.271591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:10.286538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:10.287146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:10.287427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:10.287707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:10.288443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:10.288737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:10.290171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:10.303911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 475/947] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:10.309918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:10.427513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480de3-4aec-4761-8bb7-0c9fe8a0f596 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:10.464600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:10.465250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:10.465529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:10.465807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:10.473602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:10.475104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:49:10.489891 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:10.491009 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:10.491907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 473/948] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:10.497308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:10.617101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7f725-8c21-4744-80f9-cbc4ba7836f6 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:10.664143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:10.664833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:10.665134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:10.665399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:10.666085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:10.666385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:10.667848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57918a37-9193-45e6-903a-7d048cfe5578 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:10.681218 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 476/949] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:10.687713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:10.706454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:10.807229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d6de4-5dfd-4a05-9a3d-fb96504f808f None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:10.841915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:10.842565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:10.842838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:10.843108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] PATH_INFO: `/v3/projects/f1a7243113d548bcab5edb023b93447e/users/c0d2b97624d649e3b36fd2fad9f31dbf/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:10.845082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7243113d548bcab5edb023b93447e, user_id=c0d2b97624d649e3b36fd2fad9f31dbf, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:10.846737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7afc11-03cc-4837-9e44-fe7e64a263aa None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:10.860204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 474/950] 10.222.0.78 () {58 vars in 1439 bytes} [Tue Oct 18 15:49:10 2022] PUT /identity/v3/projects/f1a7243113d548bcab5edb023b93447e/users/c0d2b97624d649e3b36fd2fad9f31dbf/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:49:13.118885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767537e7-af7e-4f13-ac38-b89e3605c13e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:13.119441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767537e7-af7e-4f13-ac38-b89e3605c13e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:13.119441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767537e7-af7e-4f13-ac38-b89e3605c13e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:13.120775 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 477/951] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:13.126094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:13.126533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:13.126643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:13.146257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:13.147451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:13.218836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 475/952] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 15:49:13.504075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767537e7-af7e-4f13-ac38-b89e3605c13e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:13.551936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:13.609796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767537e7-af7e-4f13-ac38-b89e3605c13e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:13.644967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:13.645652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:13.645967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:13.646239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:13.659894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 15:49:13.666832 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:13.668101 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:13.669430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 478/953] 10.222.0.78 () {56 vars in 1096 bytes} [Tue Oct 18 15:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:13.676809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:13.680792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:13.791119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc48b5-8c92-4e9e-b6bb-c13f356eb1a3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:13.825987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:13.826643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:13.826953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:13.827244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:13.827951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:13.828247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:13.829710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:13.842339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 476/954] 10.222.0.78 () {56 vars in 1099 bytes} [Tue Oct 18 15:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:13.849339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:13.960455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:13.963649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e644acb-5abe-4f2e-b0a9-2d026b3f2b0b None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:14.004350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:14.004985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:14.005283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:14.005549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:14.015826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:14.017287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:14.032418 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:14.033706 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:14.034772 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:14.034772 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:14.034772 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:14.034772 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 479/955] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:14.039764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:14.112726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:14.153670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574329f4-914a-4969-aecb-880999bb0266 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:14.192390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:14.193051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:14.193354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:14.193630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:14.194331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:14.194669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:14.196233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:14.209580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 477/956] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:14.215553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:14.324599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972ffce-f849-4185-b1c7-06886af9b8ae None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:14.365045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:14.365591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:14.365865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:14.366130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:14.374374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:14.376000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 15:49:14.389262 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:14.390432 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 15:49:14.391804 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:14.396396 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 480/957] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:14.397297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:14.509386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d70ce-49a9-443b-b036-63bcdbbee1a6 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:14.539155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:14.550312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:14.551158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:14.551441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:14.551884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:14.552709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:14.553187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:14.555083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:14.582347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 478/958] 10.222.0.78 () {56 vars in 1143 bytes} [Tue Oct 18 15:49:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 15:49:14.583961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:14.603259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:14.714350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f5bce-c6f9-4b6f-aa35-55353a566ad3 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:14.752984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:14.753364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:14.753643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:14.753914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:14.826958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:14.828406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:14.843026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:14.938544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 481/959] 10.222.0.78 () {58 vars in 1282 bytes} [Tue Oct 18 15:49:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 15:49:14.945123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:15.047701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c9c0-ae06-4441-889d-b85ca11b39a9 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:15.082445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:15.083062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:15.083386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:15.083652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:15.093853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:15.095280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 15:49:15.110448 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:15.111982 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 15:49:15.113161 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 15:49:15.113161 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 15:49:15.113161 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:15.113161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 479/960] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 15:49:15.118326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:15.222760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0856-ff4b-4e25-a3db-c2ab9030ebb2 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:15.236095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:15.257732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:15.258337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:15.258610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:15.258874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:15.259508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:15.259803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:15.261176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:15.273100 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 482/961] 10.222.0.78 () {56 vars in 1109 bytes} [Tue Oct 18 15:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:15.278766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:15.313761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:15.378124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b979f-cdd6-490b-b65f-4fbcd91dcee0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:15.411516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:15.412120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:15.412390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:15.412652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:15.418976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:15.420393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 15:49:15.432143 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:15.433221 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 15:49:15.434453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 480/962] 10.222.0.78 () {56 vars in 1111 bytes} [Tue Oct 18 15:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:15.439083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:15.535366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad428fa-f23b-42ba-a40a-7e3685f41d84 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:15.567860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:15.568379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:15.568653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:15.568920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:15.569630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:15.569929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:15.571326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cac83-eb21-462f-8d2b-aa6fbe791564 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:15.583297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 483/963] 10.222.0.78 () {56 vars in 1148 bytes} [Tue Oct 18 15:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:15.589292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:15.692608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:15.698710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfca02c-9aed-440b-999e-577b16d6f6e0 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:15.732812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:15.733504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:15.733784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:15.734056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:15.734777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] RBAC: Adding query filter params (role.id=eb5fc6b45679476182540fe032952925, scope.project.id=f1a7243113d548bcab5edb023b93447e, user.id=c0d2b97624d649e3b36fd2fad9f31dbf) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:15.735112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:15.737327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd3963-964b-4bf0-9096-b133dd70d4c2 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:15.743069 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 481/964] 10.222.0.78 () {56 vars in 1374 bytes} [Tue Oct 18 15:49:15 2022] GET /identity/v3/role_assignments?user.id=c0d2b97624d649e3b36fd2fad9f31dbf&scope.project.id=f1a7243113d548bcab5edb023b93447e&role.id=eb5fc6b45679476182540fe032952925 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:17.868884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba0b9e-fee1-48c9-a948-94c3e9de528a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:17.869446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba0b9e-fee1-48c9-a948-94c3e9de528a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:17.869539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba0b9e-fee1-48c9-a948-94c3e9de528a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:17.870807 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 484/965] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:17.876171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:17.877162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:17.877320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:17.895142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:17.896326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:17.962580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 482/966] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:18.244287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba0b9e-fee1-48c9-a948-94c3e9de528a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:18.274418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:18.344253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba0b9e-fee1-48c9-a948-94c3e9de528a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:18.377379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:18.377994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:18.378267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:18.378533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:18.379115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:18.380453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:18.389278 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:18.390494 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:18.391517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 485/967] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:49:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:18.397178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:18.485187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:18.495118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1e03-41b2-4c29-803a-e6038b5306b7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:18.528034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:18.528619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:18.528890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:18.529178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:18.529816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:18.530108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:18.531474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d5779-42e7-4dc1-8b0f-1fa87236c006 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:18.536829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 483/968] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 18 15:49:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:18.542733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:18.633437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:18.639320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc843d6-93a6-4fab-bfec-b0d0fef3f772 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:18.679274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:18.679944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:18.680250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:18.680634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:18.681289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:18.681548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:18.682991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9aeea-7829-4016-9ccb-60bdb1b62235 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:18.687911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 486/969] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 18 15:49:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:20.795703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89429-976d-433f-a056-777f0a8e56a3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:20.796230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89429-976d-433f-a056-777f0a8e56a3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:20.796230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89429-976d-433f-a056-777f0a8e56a3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:20.797602 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 484/970] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:20.803049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dffdb-bd2c-47be-887f-bf8bc6f59d86 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:20.803427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dffdb-bd2c-47be-887f-bf8bc6f59d86 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:20.803584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dffdb-bd2c-47be-887f-bf8bc6f59d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:20.821352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-670dffdb-bd2c-47be-887f-bf8bc6f59d86 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:20.822529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-670dffdb-bd2c-47be-887f-bf8bc6f59d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:20.891110 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 487/971] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:21.156545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89429-976d-433f-a056-777f0a8e56a3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:21.256195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89429-976d-433f-a056-777f0a8e56a3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:21.289454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:21.290044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:21.290318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:21.290588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:21.291262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:21.292702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee15f6-ea97-4f97-879c-486ed7e03c1a None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:21.307472 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 485/972] 10.222.0.78 () {60 vars in 1141 bytes} [Tue Oct 18 15:49:21 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:49:23.487157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750871f-c860-4257-9f32-fd77ee22a528 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:23.487719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750871f-c860-4257-9f32-fd77ee22a528 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:23.487719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750871f-c860-4257-9f32-fd77ee22a528 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:23.489097 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 488/973] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:23.494289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:23.494694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:23.494832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:23.513523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:23.514704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:23.524395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:23.587236 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 486/974] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:23.886769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750871f-c860-4257-9f32-fd77ee22a528 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:23.982429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:23.993189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750871f-c860-4257-9f32-fd77ee22a528 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:24.026726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:24.027356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:24.027629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:24.027898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:24.028477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:24.029858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:24.038503 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:24.039763 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:24.040893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 489/975] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:49:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:24.045760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:24.140478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd070b-c818-437b-99e5-982cc63b3038 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:24.173125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:24.174297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:24.174571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:24.174840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:24.175456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:24.175751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:24.177121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:24.182172 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 487/976] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 18 15:49:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:24.188148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:24.284899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb093e-7f0a-4a9a-908e-cdae19fbd8b1 None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:24.316856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:24.317474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:24.317747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:24.318012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:24.318729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] RBAC: Adding query filter params (interface=public, service_id=35da9d81ac7f416daab83e2dc4126667, region_id=RegionOne) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:24.319030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:24.320365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d13f9-70b8-41e0-9ef8-238c8b4247ab None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:24.325158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 490/977] 10.222.0.78 () {56 vars in 1251 bytes} [Tue Oct 18 15:49:24 2022] GET /identity/v3/endpoints?service_id=35da9d81ac7f416daab83e2dc4126667&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:24.331759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:24.335439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:24.431854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c7e3b-3f74-4ef3-a44f-2c3de7c4d594 None admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:24.465842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:24.466434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:24.466731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:24.467032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:24.467667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:24.469081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594da53a-10a7-4c8a-9be3-e803365a6298 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:24.475833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 488/978] 10.222.0.78 () {56 vars in 1087 bytes} [Tue Oct 18 15:49:24 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:49:26.735076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bc1e-46b6-40ee-ae1c-c2207b0a3f2e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:26.736267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bc1e-46b6-40ee-ae1c-c2207b0a3f2e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:26.736267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bc1e-46b6-40ee-ae1c-c2207b0a3f2e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:26.737659 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 491/979] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:49:26.742797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:26.743217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:26.743330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:26.761549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:49:26.762716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:49:26.822500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:26.828081 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 489/980] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:49:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 15:49:27.099058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bc1e-46b6-40ee-ae1c-c2207b0a3f2e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:27.118840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:27.198348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bc1e-46b6-40ee-ae1c-c2207b0a3f2e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:27.232817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:27.233466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:27.233747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:27.234015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:27.234593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:27.236748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 15:49:27.245482 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 15:49:27.246644 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 15:49:27.247824 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 492/981] 10.222.0.78 () {56 vars in 1117 bytes} [Tue Oct 18 15:49:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 15:49:27.252528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:27.347962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416c9e5-b0e3-4edb-ad69-597dd55544ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:27.380945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:27.381569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:27.381843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:27.382109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:27.382729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:49:27.383031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:27.384378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92682-1cdd-4f88-a6ac-334bb86cc096 None admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:27.389365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 490/982] 10.222.0.78 () {56 vars in 1116 bytes} [Tue Oct 18 15:49:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:49:27.395476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:49:27.476900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:27.495644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75d99-9879-4980-b412-a74230b90a1c None admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:49:27.528329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:49:27.528939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:49:27.529223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:49:27.529492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:49:27.530160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:49:27.531514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6723d05-81da-4cde-8c78-920912e11171 None admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:49:27.551245 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 493/983] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:49:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 15:49:37.386535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=69 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:49:37.546719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:32.250002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15f7-de2a-485d-b444-e603ccd5dba6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:32.250477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15f7-de2a-485d-b444-e603ccd5dba6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:32.250693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15f7-de2a-485d-b444-e603ccd5dba6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:32.251874 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 491/984] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:32.257773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596456-9699-4530-80f2-28965425d153 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:32.258176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596456-9699-4530-80f2-28965425d153 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:32.258699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596456-9699-4530-80f2-28965425d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:32.379451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2596456-9699-4530-80f2-28965425d153 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:32.380578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2596456-9699-4530-80f2-28965425d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:32.515033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 494/985] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:32.816000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:32.816278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:32.816552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:32.818277 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 492/986] 10.222.0.78 () {54 vars in 964 bytes} [Tue Oct 18 15:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:32.825417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f69a-074b-4a7e-8922-684a7d7e6087 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:32.826500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f69a-074b-4a7e-8922-684a7d7e6087 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:32.826990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97f69a-074b-4a7e-8922-684a7d7e6087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:32.915932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5f97f69a-074b-4a7e-8922-684a7d7e6087 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:32.917555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f97f69a-074b-4a7e-8922-684a7d7e6087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:32.941896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:33.007851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 495/987] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 15:50:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:33.017338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:33.019329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:33.144288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba5820-c074-4ee0-a537-6aadc47b2bfa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:33.226090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:33.226944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:33.227386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:33.227832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:33.229964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:33.288596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:33.370555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:33.372412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22884f15-eb63-46f7-85ef-996f7ddfa670 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:33.395625 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 493/988] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:35.951561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:35.952016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:35.952140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:35.953567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 496/989] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:35.959032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc10-d6c9-4092-a03f-c3e46b066ca6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:35.959440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc10-d6c9-4092-a03f-c3e46b066ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:35.959578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ebc10-d6c9-4092-a03f-c3e46b066ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:36.030251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ce0ebc10-d6c9-4092-a03f-c3e46b066ca6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:36.031453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce0ebc10-d6c9-4092-a03f-c3e46b066ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:36.130143 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 494/990] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:36.420244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:36.421765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:36.526332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ba793-2bd3-48c3-9063-72fc26ff6182 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:36.600536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:36.602687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:36.603605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:36.604122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:36.604586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:36.606483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:36.714178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:36.715505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2a084-6c06-4280-bd5a-01cf804e902b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:36.734573 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 497/991] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:39.217080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:39.217607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:39.217607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:39.218929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 495/992] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:39.224728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2137be-fdc3-4b86-8812-6cb688c97be8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:39.225157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2137be-fdc3-4b86-8812-6cb688c97be8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:39.225328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2137be-fdc3-4b86-8812-6cb688c97be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:39.292260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0f2137be-fdc3-4b86-8812-6cb688c97be8 None None] MFA Rules not processed for user `dfa06ab28b1e449295f0f02e4ba9c768`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:39.293491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f2137be-fdc3-4b86-8812-6cb688c97be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:39.344420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:39.389415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 498/993] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:39.701929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:39.703446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:39.714078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:39.807786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012547a-0b31-4dc6-92f7-3ff4b5965e73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:39.879817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:39.880403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:39.880667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:39.880924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:39.882977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:39.943959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:39.991243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:39.992584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c64af5-9b9d-4105-91f7-1dc70477fb7e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:40.010457 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 496/994] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:50:42.765481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:42.766053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:42.766053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:42.767347 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 499/995] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:42.772508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308553e-6f74-4248-92bf-16f1d83d86de None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:42.772908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308553e-6f74-4248-92bf-16f1d83d86de None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:42.774047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308553e-6f74-4248-92bf-16f1d83d86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:42.837287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a308553e-6f74-4248-92bf-16f1d83d86de None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:42.838471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a308553e-6f74-4248-92bf-16f1d83d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:42.934758 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 497/996] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:43.218483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:43.220026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:43.322872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5659f-2adf-4501-9c83-a13ef2be5d85 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:43.394058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:43.394648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:43.394918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:43.395181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:43.396725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:43.404972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:43.503389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:43.504718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e32ec9-7891-4c60-8f84-5d5bb20aac6e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:43.522615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 500/997] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:46.345647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f3bb-3eb3-44e2-9dbe-6f7aefec81d6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:46.346208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f3bb-3eb3-44e2-9dbe-6f7aefec81d6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:46.346208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f3bb-3eb3-44e2-9dbe-6f7aefec81d6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:46.347523 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 498/998] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:46.353538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b412b-985d-4583-9b22-4145c7d6af8e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:46.353980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b412b-985d-4583-9b22-4145c7d6af8e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:46.354128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b412b-985d-4583-9b22-4145c7d6af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:46.427951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cb7b412b-985d-4583-9b22-4145c7d6af8e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:46.429493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb7b412b-985d-4583-9b22-4145c7d6af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:46.494321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:46.536916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 501/999] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:46.839997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:46.840387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:46.840965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:46.842263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 499/1000] 10.222.0.78 () {54 vars in 964 bytes} [Tue Oct 18 15:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:46.848648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47aee-4ead-4dee-b08a-20e7034a516c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:46.849006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47aee-4ead-4dee-b08a-20e7034a516c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:46.849353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47aee-4ead-4dee-b08a-20e7034a516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:46.928133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-59c47aee-4ead-4dee-b08a-20e7034a516c None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:46.929402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59c47aee-4ead-4dee-b08a-20e7034a516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:47.008123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 502/1001] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:47.017280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:47.018822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:47.039357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:47.122609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d9af-14b5-488e-967f-4443cfc2caee None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:47.194133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:47.194727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:47.194998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:47.195261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:47.196831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:47.269644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:47.306904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:47.308318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3fd0-2a5a-4153-a893-946ef856cfd5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:47.328246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 500/1002] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:49.822913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:49.823442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:49.823442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:49.824672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 503/1003] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:49.830929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb9d8-8b9d-48c6-9283-c20a0eb467fb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:49.831366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb9d8-8b9d-48c6-9283-c20a0eb467fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:49.831483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cb9d8-8b9d-48c6-9283-c20a0eb467fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:49.899360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d0cb9d8-8b9d-48c6-9283-c20a0eb467fb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:49.900561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d0cb9d8-8b9d-48c6-9283-c20a0eb467fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:50.003696 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 501/1004] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:50.288091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:50.289634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:50.350496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:50.393183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45265fbd-cc3f-4348-81d8-93819204c4d4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:50.467443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:50.467963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:50.468237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:50.468510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:50.470136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:50.580016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:50.582791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:50.585061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6376ab-2b68-4ffa-a158-7934ad97818e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:50.605796 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 504/1005] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:52.835133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:52.835575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:52.835662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:52.836976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 502/1006] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:52.842584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b95b-cd78-45a9-8bfc-cd169ecdfbf5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:52.843098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b95b-cd78-45a9-8bfc-cd169ecdfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:52.843098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b95b-cd78-45a9-8bfc-cd169ecdfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:52.911184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2c90b95b-cd78-45a9-8bfc-cd169ecdfbf5 None None] MFA Rules not processed for user `dfa06ab28b1e449295f0f02e4ba9c768`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:52.912376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c90b95b-cd78-45a9-8bfc-cd169ecdfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:53.011391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 505/1007] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:53.301774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:53.302792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:53.338904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:53.413288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b924e-d6c9-4050-a07f-94089c639a10 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:53.491033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:53.491762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:53.492037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:53.492309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:53.493948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:53.581470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:53.616750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:53.618275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ed3ea-e712-47fa-a777-c63cf40ba46c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:53.637736 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 503/1008] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:56.180079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:56.180495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:56.180618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:56.182021 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 506/1009] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:56.188209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b1c9-5779-4e09-b145-6715ae10b012 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:56.188637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b1c9-5779-4e09-b145-6715ae10b012 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:56.188737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b1c9-5779-4e09-b145-6715ae10b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:56.254717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c543b1c9-5779-4e09-b145-6715ae10b012 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:56.255915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c543b1c9-5779-4e09-b145-6715ae10b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:56.351313 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 504/1010] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:56.632674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:56.634247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:56.704064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:56.738783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ebcf9-f64b-4d83-a44a-4dbb60a9276b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:56.811294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:56.811884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:56.812153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:56.812417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:56.814012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:56.922173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:56.923508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f337d53-8eb6-4064-aef5-aafa9d6081ec service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:56.933628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:56.942912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 507/1011] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:50:59.140922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:59.141635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:59.141635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:59.142860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 505/1012] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:50:59.148255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c788-678d-4308-bc36-3e007296f99f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:59.148692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c788-678d-4308-bc36-3e007296f99f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:59.148792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c788-678d-4308-bc36-3e007296f99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:59.214846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-71d3c788-678d-4308-bc36-3e007296f99f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:50:59.216087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71d3c788-678d-4308-bc36-3e007296f99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:59.311835 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 508/1013] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:50:59.597845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:50:59.599449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:59.639771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:59.702663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16de5-5afc-4e88-ab54-63877ed6fe8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:50:59.774077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:50:59.774666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:50:59.774936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:50:59.775197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:50:59.776754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:50:59.859094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:50:59.884761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:50:59.886232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30f56a-b837-4e26-babf-5886bbe16b8c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:50:59.904161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 506/1014] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:02.364865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:02.365436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:02.365436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:02.366800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 509/1015] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:02.372240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ce58-d4c4-4bf1-aded-6e5e718a9093 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:02.372646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ce58-d4c4-4bf1-aded-6e5e718a9093 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:02.372753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480ce58-d4c4-4bf1-aded-6e5e718a9093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:02.439053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2480ce58-d4c4-4bf1-aded-6e5e718a9093 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:02.440258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2480ce58-d4c4-4bf1-aded-6e5e718a9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:02.536163 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 507/1016] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:02.828406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:02.830170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:02.906925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:02.935680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d5e73-f7c4-41a8-8cca-1657c9a892ca None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:03.008029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:03.008620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:03.008890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:03.009186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:03.010752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:03.117092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:03.118499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134afc81-fe53-4790-a0a9-42624ec2c6e4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:03.136234 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 510/1017] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:07.415972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:07.416538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:07.416538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:07.418436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 508/1018] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:51:07.424405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a78f-4fd4-4e1e-870e-c7f3d90a6771 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:07.424836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a78f-4fd4-4e1e-870e-c7f3d90a6771 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:07.424927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a78f-4fd4-4e1e-870e-c7f3d90a6771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:07.430398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:07.494486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fcb6a78f-4fd4-4e1e-870e-c7f3d90a6771 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:07.495613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcb6a78f-4fd4-4e1e-870e-c7f3d90a6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:07.595896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 511/1019] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:07.879995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:07.881844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:07.936855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:07.991442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f47de-9d43-4685-9b7f-809baa945ed7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:08.067826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:08.068489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:08.068766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:08.069144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:08.070856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:08.169523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:08.188008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:08.189500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52ac72-55fc-4c8e-b388-6917b811bdf9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:08.208338 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 509/1020] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:11.021979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:11.022502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:11.022502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:11.024102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 512/1021] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:11.029935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f67c-8c47-481a-9331-3debc24e930e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:11.030405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f67c-8c47-481a-9331-3debc24e930e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:11.030506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27f67c-8c47-481a-9331-3debc24e930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:11.097683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0a27f67c-8c47-481a-9331-3debc24e930e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:11.098881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a27f67c-8c47-481a-9331-3debc24e930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:11.197103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 510/1022] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:11.494233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:11.496322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:11.592159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:11.609387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09152d-2f8d-4a0c-9670-68718681c9a1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:11.692317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:11.692929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:11.693236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:11.693506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:11.695104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:11.806121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:11.807542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc12b05-9c0f-4313-a05b-3010ed2ec385 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:11.826056 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 513/1023] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:16.276886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:16.277405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:16.277984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:16.279047 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 511/1024] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:16.284517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80703b69-f73a-472c-b1a0-225f021c1868 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:16.284985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80703b69-f73a-472c-b1a0-225f021c1868 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:16.285282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80703b69-f73a-472c-b1a0-225f021c1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:16.301739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:16.355876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80703b69-f73a-472c-b1a0-225f021c1868 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:16.357121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80703b69-f73a-472c-b1a0-225f021c1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:16.458690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 514/1025] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:16.745334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:16.747546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:16.804816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:16.849237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fa7e9-3686-4a34-b588-f1a7dcedaa50 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:16.922114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:16.922708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:16.922983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:16.923249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:16.924840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:17.030059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:17.034063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:17.035486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6b81b-53e3-47d6-8e4a-f0322789acba service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:17.054192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 512/1026] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:22.000095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca0e35-36d8-4afa-9325-257613714ccd None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:22.000540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca0e35-36d8-4afa-9325-257613714ccd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:22.000705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca0e35-36d8-4afa-9325-257613714ccd None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:22.002324 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 515/1027] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 15:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:22.007269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31148-e393-4511-812e-e351724652ca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:22.007671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31148-e393-4511-812e-e351724652ca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:22.007815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31148-e393-4511-812e-e351724652ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:22.099888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aec31148-e393-4511-812e-e351724652ca None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:22.101307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aec31148-e393-4511-812e-e351724652ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:22.245051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 513/1028] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:26.457235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=59 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:26.569610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd359db-f423-471d-b88f-5b2b9105dd80 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:26.570525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd359db-f423-471d-b88f-5b2b9105dd80 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:26.571204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd359db-f423-471d-b88f-5b2b9105dd80 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:26.572917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 516/1029] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 15:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:26.579041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b4e-51fa-43cc-a705-7372d255d724 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:26.579527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b4e-51fa-43cc-a705-7372d255d724 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:26.579624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a9b4e-51fa-43cc-a705-7372d255d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:26.636946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:26.660021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-269a9b4e-51fa-43cc-a705-7372d255d724 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:26.661248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-269a9b4e-51fa-43cc-a705-7372d255d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:26.772073 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 514/1030] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:28.386592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c66d-256e-44a6-a090-d613a43c563f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:28.387112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c66d-256e-44a6-a090-d613a43c563f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:28.387112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c66d-256e-44a6-a090-d613a43c563f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:28.389297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 517/1031] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 15:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:28.395586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e02f6-36dd-4f88-a2d5-fa6606a3f483 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:28.396180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e02f6-36dd-4f88-a2d5-fa6606a3f483 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:28.396275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e02f6-36dd-4f88-a2d5-fa6606a3f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:28.488043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c7e02f6-36dd-4f88-a2d5-fa6606a3f483 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:28.490304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c7e02f6-36dd-4f88-a2d5-fa6606a3f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:28.537380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:28.631499 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 515/1032] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:31.923779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6196-10b0-4a72-a63e-c0817c550b03 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:31.924656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6196-10b0-4a72-a63e-c0817c550b03 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:31.925240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b6196-10b0-4a72-a63e-c0817c550b03 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:31.926911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 518/1033] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:31.932235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd5-940b-4bd4-8ef9-68bb636b8e94 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:31.933442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd5-940b-4bd4-8ef9-68bb636b8e94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:31.933744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd5-940b-4bd4-8ef9-68bb636b8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:32.006528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eb218bd5-940b-4bd4-8ef9-68bb636b8e94 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:32.007649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb218bd5-940b-4bd4-8ef9-68bb636b8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:32.111008 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 516/1034] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:32.420281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:32.420560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:32.421025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:32.422632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 519/1035] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 15:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:32.431266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4b72-e074-459d-bdfc-f2f48aef730d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:32.431675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4b72-e074-459d-bdfc-f2f48aef730d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:32.432072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4b72-e074-459d-bdfc-f2f48aef730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:32.469354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:32.530517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-deae4b72-e074-459d-bdfc-f2f48aef730d None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:32.531635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-deae4b72-e074-459d-bdfc-f2f48aef730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:32.666050 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 517/1036] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:32.674065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:32.675654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:32.833878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da4242-e60f-49e0-ac88-fa866ae374fa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:32.910159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:32.952950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:32.953733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:32.954075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:32.954409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:32.956048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:33.055538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:33.058222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57cbfb-0a27-49ed-9cf4-c21f5a2c418b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:33.078915 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 520/1037] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:35.514425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:35.514425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:35.514425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:35.520245 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 518/1038] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:35.521549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6bdf-a466-4c97-92ab-2aab4f51dac5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:35.521549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6bdf-a466-4c97-92ab-2aab4f51dac5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:35.521549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6bdf-a466-4c97-92ab-2aab4f51dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:35.593299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-affa6bdf-a466-4c97-92ab-2aab4f51dac5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:35.594535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-affa6bdf-a466-4c97-92ab-2aab4f51dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:35.638744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:35.704220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 521/1039] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:35.995029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:35.996635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:36.067615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.173876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649313d-8980-4ad7-a294-b8a53536e822 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:36.317659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:36.318269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:36.318541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:36.318810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:36.320529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:36.344400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:36.414504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:36.416018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed227200-39fa-4092-b9a6-c4bf98158f0c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:36.434953 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 519/1040] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:38.939865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df7c3-47ca-4b2a-a3ba-de53aae21f55 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:38.940857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df7c3-47ca-4b2a-a3ba-de53aae21f55 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:38.941159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df7c3-47ca-4b2a-a3ba-de53aae21f55 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:38.942684 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 522/1041] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:38.948504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbc8e-03fb-46e1-b51f-824f2b2a4118 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:38.948962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbc8e-03fb-46e1-b51f-824f2b2a4118 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:38.949099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcbc8e-03fb-46e1-b51f-824f2b2a4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:39.017715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5bbcbc8e-03fb-46e1-b51f-824f2b2a4118 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:39.018915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bbcbc8e-03fb-46e1-b51f-824f2b2a4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:39.138298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:39.141033 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 520/1042] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:39.439799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:39.440078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:39.440559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:39.442124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 523/1043] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:51:39.448608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b7ee-1246-41f9-831d-5864b2882fd6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:39.449294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b7ee-1246-41f9-831d-5864b2882fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:39.449691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213b7ee-1246-41f9-831d-5864b2882fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:39.536723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5213b7ee-1246-41f9-831d-5864b2882fd6 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:39.538094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5213b7ee-1246-41f9-831d-5864b2882fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:39.695723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 521/1044] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:39.705432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:39.708292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:39.913372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141832bc-c45e-4669-a863-6bd3475b18d1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:39.952940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:40.088139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:40.089516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:40.090707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:40.091106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:40.093654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:40.217426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:40.219694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35042439-e829-4b5c-889f-a95b877b1d6d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:40.244710 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 524/1045] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:42.842922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:42.843900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:42.844558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:42.846202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 522/1046] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:42.851908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1a21-fcb4-4d4e-a52b-29c674202016 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:42.852978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1a21-fcb4-4d4e-a52b-29c674202016 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:42.853620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a1a21-fcb4-4d4e-a52b-29c674202016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:42.901049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:42.944204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8b0a1a21-fcb4-4d4e-a52b-29c674202016 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:42.945737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b0a1a21-fcb4-4d4e-a52b-29c674202016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:43.060877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 525/1047] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:43.358431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:43.360923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:43.421544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:43.534855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476678-aa82-4484-aa17-396f251b90b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:43.659247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:43.659958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:43.660145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:43.660403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:43.662057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:43.672117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:43.759277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:43.762075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4c694-3ea6-48ca-bf30-e949e7b1b063 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:43.795622 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 523/1048] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:44.336218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564402e-fbc8-4204-8c2d-a7e30d883603 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:44.337280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564402e-fbc8-4204-8c2d-a7e30d883603 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:44.337559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564402e-fbc8-4204-8c2d-a7e30d883603 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:44.339713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 526/1049] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:44.345060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddb1b-09e4-4135-a9c0-5e4fa3c54307 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:44.345487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddb1b-09e4-4135-a9c0-5e4fa3c54307 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:44.345606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddb1b-09e4-4135-a9c0-5e4fa3c54307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:44.415715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-734ddb1b-09e4-4135-a9c0-5e4fa3c54307 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:44.417580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-734ddb1b-09e4-4135-a9c0-5e4fa3c54307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:44.517223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:44.531290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 524/1050] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:44.827941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:44.828217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:44.828482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:44.829819 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 527/1051] 10.222.0.78 () {54 vars in 963 bytes} [Tue Oct 18 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:44.834997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284278d-0974-4907-a35c-72bf603bb2b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:44.835414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284278d-0974-4907-a35c-72bf603bb2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:44.835691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284278d-0974-4907-a35c-72bf603bb2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:44.915212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4284278d-0974-4907-a35c-72bf603bb2b5 None None] MFA Rules not processed for user `5cdf82dd7b714a26a2c4f396ca0b20be`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:44.917071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4284278d-0974-4907-a35c-72bf603bb2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:45.002538 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 525/1052] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 18 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:45.010556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:45.012176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:45.124263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2a3d-1f99-4a04-8c77-331b61696995 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:45.128386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:45.208131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:45.208724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:45.208983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:45.209290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:45.210853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:45.331156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:45.332861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663089-b6f9-4d97-b43a-1fe560784783 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:45.351782 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 528/1053] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:46.098675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:46.098675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:46.098675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:46.104232 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 526/1054] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:46.105066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0f84-7e0c-457c-bba6-8438cbc99e2d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:46.105161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0f84-7e0c-457c-bba6-8438cbc99e2d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:46.105433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da0f84-7e0c-457c-bba6-8438cbc99e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:46.151129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:46.175047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-03da0f84-7e0c-457c-bba6-8438cbc99e2d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:46.176326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03da0f84-7e0c-457c-bba6-8438cbc99e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:46.278028 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 529/1055] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:46.569962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:46.571540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:46.662778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:46.733959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b9761-a11f-4cf7-bd58-108c7a41d8b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:46.855538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:46.857032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:46.857032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:46.857032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:46.858769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:46.904344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:46.967366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:46.969023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0193a-53a8-4bc4-84ba-83d54607e191 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:46.991391 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 527/1056] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:49.267699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:49.268884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:49.269360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:49.272405 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 530/1057] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:49.277994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018886f-d54d-4a39-b5ad-88daefe97cbc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:49.279112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018886f-d54d-4a39-b5ad-88daefe97cbc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:49.279562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018886f-d54d-4a39-b5ad-88daefe97cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:49.399848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b018886f-d54d-4a39-b5ad-88daefe97cbc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:49.401523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b018886f-d54d-4a39-b5ad-88daefe97cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:49.515410 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 528/1058] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:49.809024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:49.810519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:49.940951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:49.986036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653aa254-7b4f-4fe1-9e18-0c0d085ee749 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:50.123650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:50.124420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:50.124799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:50.125250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:50.127069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:50.213130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:50.229855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:50.231443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f1ee4-4a7b-4968-8127-6f5c4725c8ac service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:50.263622 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 531/1059] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:52.585113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:52.585644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:52.585644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:52.587120 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 529/1060] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:52.592914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e80f-e1e6-47e5-b3d2-15a9e5ddb608 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:52.593384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e80f-e1e6-47e5-b3d2-15a9e5ddb608 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:52.593481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e80f-e1e6-47e5-b3d2-15a9e5ddb608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:52.665960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1127e80f-e1e6-47e5-b3d2-15a9e5ddb608 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:52.667168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1127e80f-e1e6-47e5-b3d2-15a9e5ddb608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:52.772109 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 532/1061] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:53.059441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:53.061263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:53.082880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:53.233159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b229c-1bf1-4919-b7eb-d9ac8372ca3d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:53.372016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:53.401171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:53.401821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:53.402093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:53.402356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:53.404063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:53.502354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:53.504040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83ae6-bf9b-4ba8-8cd8-2622b12c7ce3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:53.523401 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 530/1062] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:51:55.836481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:55.837213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:55.837668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:55.839500 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 533/1063] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:51:55.845827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cede-61a5-4d72-866a-8aeeb5795df0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:55.846458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cede-61a5-4d72-866a-8aeeb5795df0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:55.846458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cede-61a5-4d72-866a-8aeeb5795df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:55.926861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2756cede-61a5-4d72-866a-8aeeb5795df0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:55.928151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2756cede-61a5-4d72-866a-8aeeb5795df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:55.998535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:56.051842 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 531/1064] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:56.367305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:56.369346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:56.427189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:56.546245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9a1d5-64d2-43d3-a40f-4c01ffc5b615 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:56.680092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:51:56.680700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:56.680973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:56.681842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:56.683723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:56.696984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:56.797407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:51:56.798943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc56ef9-da39-46a9-bdde-f5c5ff64f0d1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:51:56.819377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 534/1065] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:51:59.322706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:59.323349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:59.323349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:59.324756 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 532/1066] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:51:59.330443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9347ce-c0c3-44ab-a4aa-b82b50bebf76 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:51:59.330895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9347ce-c0c3-44ab-a4aa-b82b50bebf76 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:51:59.331021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9347ce-c0c3-44ab-a4aa-b82b50bebf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:51:59.400326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6d9347ce-c0c3-44ab-a4aa-b82b50bebf76 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:51:59.401620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6d9347ce-c0c3-44ab-a4aa-b82b50bebf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:59.491539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:51:59.503888 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 535/1067] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:51:59.798737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:51:59.800239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:51:59.956261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acad16-6b5e-40be-86b3-536f1c6c4df9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:51:59.996549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:00.074530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:00.075043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:00.075318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:00.075591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:00.077238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:00.170978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:00.172607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbf82d-a7e3-4dd8-8068-d58439176ddf service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:00.191925 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 533/1068] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:52:01.142724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6ac0-75ab-4d48-b9ff-76f9d44bc47f None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:01.143316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6ac0-75ab-4d48-b9ff-76f9d44bc47f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:01.143316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6ac0-75ab-4d48-b9ff-76f9d44bc47f None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:01.144585 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 536/1069] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:01.149795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff852-03ab-4a04-8de2-ca1251ff950c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:01.150207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff852-03ab-4a04-8de2-ca1251ff950c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:01.150534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff852-03ab-4a04-8de2-ca1251ff950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:01.204837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:01.218354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d0dff852-03ab-4a04-8de2-ca1251ff950c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:01.219571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d0dff852-03ab-4a04-8de2-ca1251ff950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:01.319018 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 534/1070] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:01.621456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:01.621741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:01.622018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:01.623370 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 537/1071] 10.222.0.78 () {54 vars in 962 bytes} [Tue Oct 18 15:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:01.628662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea87b7-b3e4-40b4-a0e3-e3233ac55664 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:01.628975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea87b7-b3e4-40b4-a0e3-e3233ac55664 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:01.629331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea87b7-b3e4-40b4-a0e3-e3233ac55664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:01.705143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a6ea87b7-b3e4-40b4-a0e3-e3233ac55664 None None] MFA Rules not processed for user `dd3b359a6c724c67853394a3a8481995`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:01.706317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6ea87b7-b3e4-40b4-a0e3-e3233ac55664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:01.771215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:01.785486 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 535/1072] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 18 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:01.794932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:01.796440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:01.904826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de457a3-c2be-4041-8c3f-d6bc6a546a29 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:01.989497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:01.990114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:01.990387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:01.990655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:01.992243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:02.036883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:02.104423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:02.105876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395d97-fa6f-46ff-8024-5511e1d44217 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:02.123991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 538/1073] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:02.440624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5716f-4d9e-4486-b3bf-cd68a2008a97 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:02.441219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5716f-4d9e-4486-b3bf-cd68a2008a97 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:02.441317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5716f-4d9e-4486-b3bf-cd68a2008a97 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:02.442697 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 536/1074] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:02.449229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:02.449714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:02.449807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:02.524243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:02.525949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:02.631035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:02.633791 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 539/1075] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:02.881652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc652-7e6b-41af-9311-cbced76de480 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:02.881959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc652-7e6b-41af-9311-cbced76de480 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:02.882265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc652-7e6b-41af-9311-cbced76de480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:02.941753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:02.942959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:02.959469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d9abc652-7e6b-41af-9311-cbced76de480 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:02.960664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9abc652-7e6b-41af-9311-cbced76de480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:03.052589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 537/1076] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:03.062845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4bbc-f642-42e6-9f77-3b3a712d8f0a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:03.100436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c4e75-73d2-4547-9056-a86569466824 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:03.100719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c4e75-73d2-4547-9056-a86569466824 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:03.101018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c4e75-73d2-4547-9056-a86569466824 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:03.102658 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 538/1077] 10.222.0.78 () {54 vars in 943 bytes} [Tue Oct 18 15:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:52:03.109240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:03.109577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:03.109834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:03.177771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:03.183669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:03.184281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:03.184550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:03.184815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:03.186494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:03.189857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] MFA Rules not processed for user `8f98d1b53918419bad2040f49ad08092`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:03.191102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:03.212563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:03.287015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:03.288594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bf276-7317-4ab1-84cb-23053867cd75 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:03.303428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 539/1078] 10.222.0.78 () {58 vars in 1040 bytes} [Tue Oct 18 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:52:03.308165 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 540/1079] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:52:03.313712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:03.324315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d16fba-33e9-4925-bca4-600274e5d154 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:03.444482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:03.445344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:03.445457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:03.445654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:03.447545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:03.478720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:03.543395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:03.545017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428ab4c-58d7-4eac-b07e-c308c4e80596 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:03.554151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 540/1080] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 15:52:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 15:52:05.624277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:05.624826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:05.624954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:05.626388 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 541/1081] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:05.631509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4db12-1f14-4f77-8429-44d7966c562f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:05.631956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4db12-1f14-4f77-8429-44d7966c562f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:05.632052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4db12-1f14-4f77-8429-44d7966c562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:05.711435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59c4db12-1f14-4f77-8429-44d7966c562f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:05.713362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59c4db12-1f14-4f77-8429-44d7966c562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:05.824028 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 541/1082] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:06.124545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:06.126083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:06.257608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:06.298413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82d0b-f2b6-4448-9ec0-063d800c60ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:06.425840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:06.426443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:06.426713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:06.426980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:06.428551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:06.521335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:06.533502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:06.535263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f48196-6cb5-49bf-a25f-8b73ed39bda7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:06.554702 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 542/1083] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:08.800468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:08.801107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:08.801107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:08.808871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3231c-a33c-421a-9034-f3343c2f4cb2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:08.808871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3231c-a33c-421a-9034-f3343c2f4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:08.808871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3231c-a33c-421a-9034-f3343c2f4cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:08.829726 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 542/1084] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:52:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:08.913064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-44f3231c-a33c-421a-9034-f3343c2f4cb2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:08.913064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44f3231c-a33c-421a-9034-f3343c2f4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:09.062553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 543/1085] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:09.355799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:09.357344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:09.378230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:09.521277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d1453-f234-4785-8a87-5df72227ee7c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:09.617893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:09.648426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:09.649115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:09.649401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:09.649688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:09.651280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:09.755332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:09.756931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a216-d58a-4902-b8d8-3267fccd5e44 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:09.776078 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 543/1086] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:19.059795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=74 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:19.772955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=54 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:27.523811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1250-ae5a-4aa2-a7a6-0e96c7800040 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:27.524406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1250-ae5a-4aa2-a7a6-0e96c7800040 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:27.524512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc1250-ae5a-4aa2-a7a6-0e96c7800040 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:27.525856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 544/1087] 10.222.0.78 () {54 vars in 918 bytes} [Tue Oct 18 15:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:27.531251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9a37-7aac-4676-83a3-dbc59b3e55c5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:27.531710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9a37-7aac-4676-83a3-dbc59b3e55c5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:27.531913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9a37-7aac-4676-83a3-dbc59b3e55c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:27.607600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3dbd9a37-7aac-4676-83a3-dbc59b3e55c5 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:27.608801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3dbd9a37-7aac-4676-83a3-dbc59b3e55c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:27.716011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 544/1088] 10.222.0.78 () {58 vars in 1015 bytes} [Tue Oct 18 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:27.731395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892b90-166c-4055-b73f-b02717fb01dc None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:27.731676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892b90-166c-4055-b73f-b02717fb01dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:27.731944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0892b90-166c-4055-b73f-b02717fb01dc None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:27.733330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 545/1089] 10.222.0.78 () {54 vars in 918 bytes} [Tue Oct 18 15:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:27.737929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcef1a-6edf-41d8-8a58-df386c1fc0bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:27.738248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcef1a-6edf-41d8-8a58-df386c1fc0bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:27.738547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcef1a-6edf-41d8-8a58-df386c1fc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:27.814937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:27.817601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8ddcef1a-6edf-41d8-8a58-df386c1fc0bf None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:27.819440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ddcef1a-6edf-41d8-8a58-df386c1fc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:27.934698 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 545/1090] 10.222.0.78 () {58 vars in 1015 bytes} [Tue Oct 18 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:30.663677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e140-575f-4e77-b998-600d6e4958de None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:30.664248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e140-575f-4e77-b998-600d6e4958de None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:30.664478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809e140-575f-4e77-b998-600d6e4958de None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:30.665883 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 546/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:52:30.671305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d7b6-fd1a-42e7-8bfe-cb75fa5d63b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:30.671764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d7b6-fd1a-42e7-8bfe-cb75fa5d63b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:30.671878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d7b6-fd1a-42e7-8bfe-cb75fa5d63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:30.739462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b862d7b6-fd1a-42e7-8bfe-cb75fa5d63b4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:30.740659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b862d7b6-fd1a-42e7-8bfe-cb75fa5d63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:30.795140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:30.836733 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 546/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:31.134390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e140-575f-4e77-b998-600d6e4958de None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:31.135961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6809e140-575f-4e77-b998-600d6e4958de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:31.279532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809e140-575f-4e77-b998-600d6e4958de None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:31.358023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:31.398521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:31.398989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:31.399255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:31.399513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:31.401130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:31.493457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:31.495075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8fd5-f369-4e84-aa03-e9393b8612f9 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:31.513365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 547/1093] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:32.680610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:32.681215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:32.681215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:32.682547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 547/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:32.688824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09acf-de9b-48cd-b235-e0a331c57236 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:32.689250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09acf-de9b-48cd-b235-e0a331c57236 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:32.689426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd09acf-de9b-48cd-b235-e0a331c57236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:32.764258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7bd09acf-de9b-48cd-b235-e0a331c57236 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:32.765492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7bd09acf-de9b-48cd-b235-e0a331c57236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:32.792290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:32.861457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 548/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:33.020726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:33.022278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:33.170801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a93c59-e1b4-4435-a488-780408780aa7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:33.211263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:33.284825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:33.285448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:33.285719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:33.285986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:33.287563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:33.380506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:33.382168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f877642-e5c0-4519-8813-f86030bb94af service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:33.400947 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 548/1096] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:34.575526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:34.576107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:34.576292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:34.578252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 549/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:34.584660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d45-ce49-4347-ae32-96d1ca051045 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:34.585179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d45-ce49-4347-ae32-96d1ca051045 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:34.585828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78d45-ce49-4347-ae32-96d1ca051045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:34.640142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:34.663037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ebb78d45-ce49-4347-ae32-96d1ca051045 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:34.664872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ebb78d45-ce49-4347-ae32-96d1ca051045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:34.761058 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 549/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:34.913934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:34.915445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:35.059808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126ef0b-ba26-43a3-b963-46d80e699d7c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:35.072433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:35.181323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:35.181931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:35.182205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:35.182475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:35.184056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:35.273654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:35.275220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc1821-a609-47f3-a402-68bef02f227e service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:35.292869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 550/1099] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:36.410292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:36.410863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:36.410863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:36.412169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 550/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:36.419036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff29d-6529-4b95-b726-b98b14e391e8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:36.419444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff29d-6529-4b95-b726-b98b14e391e8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:36.419572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedff29d-6529-4b95-b726-b98b14e391e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:36.439620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:36.496126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dedff29d-6529-4b95-b726-b98b14e391e8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:36.497290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dedff29d-6529-4b95-b726-b98b14e391e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:36.593546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 551/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:36.749499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:36.750921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:36.860225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:36.895160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba81c43-8021-4d84-9561-96658d378971 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:37.008119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:37.008642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:37.008915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:37.009213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:37.010788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:37.086310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:37.099358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:37.100955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ff163-4988-4e80-bcea-ec57511a6ab2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:37.119031 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 551/1102] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:38.239475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:38.240002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:38.240002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:38.241280 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 552/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:38.248478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9273-20c0-4b12-98bf-3f3b336da9fd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:38.248940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9273-20c0-4b12-98bf-3f3b336da9fd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:38.249172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9273-20c0-4b12-98bf-3f3b336da9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:38.323428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e9b9273-20c0-4b12-98bf-3f3b336da9fd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:38.324611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e9b9273-20c0-4b12-98bf-3f3b336da9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:38.422636 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 552/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:38.575525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:38.576935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:38.661776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:38.722509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe0e8-df14-4441-895e-d9eb1685d60e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:38.835688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:38.836193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:38.836462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:38.836726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:38.838387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:38.886206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:38.927096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:38.929733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b687c-068b-4408-90c8-8d0802ccf3e2 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:38.949253 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 553/1105] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:39.990826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:39.991350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:39.991350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:39.993244 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 553/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:39.999558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0123-d76b-4f45-8cb2-0e1a4d0f8169 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:40.000001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0123-d76b-4f45-8cb2-0e1a4d0f8169 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:40.000122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e0123-d76b-4f45-8cb2-0e1a4d0f8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:40.077014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-247e0123-d76b-4f45-8cb2-0e1a4d0f8169 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:40.078217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-247e0123-d76b-4f45-8cb2-0e1a4d0f8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:40.173860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 554/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:40.324862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:40.326394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:40.380022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:40.485126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e918e1-238b-4d3f-a3ef-2febae4520c6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:40.600764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:40.601387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:40.601659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:40.602185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:40.603764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:40.610536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:40.695859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:40.697473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3630e-f66a-433e-a879-03039984a3fb service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:40.715332 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 554/1108] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:41.784633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:41.785267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:41.785267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:41.786574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 555/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:41.793052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07599c-c94a-41f7-a991-8b91ca948ab9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:41.793481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07599c-c94a-41f7-a991-8b91ca948ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:41.793590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07599c-c94a-41f7-a991-8b91ca948ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:41.867666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aa07599c-c94a-41f7-a991-8b91ca948ab9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:41.868851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa07599c-c94a-41f7-a991-8b91ca948ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:41.935463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:41.965504 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 555/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:42.114959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:42.116972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:42.134753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:42.261465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d555a-a26b-4bdd-a933-d5ee11d0726b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:42.348697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:42.376815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:42.377395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:42.377665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:42.377930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:42.379516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:42.468778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:42.470389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ec98b-b00f-4de3-887b-7ec07c1ba07d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:42.488855 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 556/1111] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:43.549146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:43.549704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:43.549704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:43.551080 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 556/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:43.557756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335b00-08eb-4af7-bee5-1908c5c5baf8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:43.558182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335b00-08eb-4af7-bee5-1908c5c5baf8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:43.558315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335b00-08eb-4af7-bee5-1908c5c5baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:43.633577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-42335b00-08eb-4af7-bee5-1908c5c5baf8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:43.634762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42335b00-08eb-4af7-bee5-1908c5c5baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:43.675352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:43.731884 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 557/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:43.880364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:43.881916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:44.033396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5778c-1487-4209-b1c8-06dcf2c6d3ed None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:44.088139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:44.146888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:44.147409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:44.147680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:44.147940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:44.149613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:44.238928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:44.240499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59b9e2-23cd-472f-b3dc-91f68c8e7e76 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:44.258351 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 557/1114] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:45.322524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:45.323069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:45.323069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:45.324372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 558/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:45.331508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eda255-7d9e-4858-ba5c-eb74b579a2be None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:45.331923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eda255-7d9e-4858-ba5c-eb74b579a2be None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:45.332028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eda255-7d9e-4858-ba5c-eb74b579a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:45.408910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1eda255-7d9e-4858-ba5c-eb74b579a2be None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:45.410140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1eda255-7d9e-4858-ba5c-eb74b579a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:45.412122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:45.510635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 558/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:45.658951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:45.660628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:45.808193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc7a18-2ffd-49a8-a1e3-6ab3b5b8be73 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:45.836188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:45.922512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:45.923035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:45.923302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:45.923564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:45.925203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:46.015976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:46.017622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079bc3b-e15f-43af-9de0-ba92c678f262 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:46.036249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 559/1117] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:48.114160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:48.114756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:48.114756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:48.116025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 559/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:48.122003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65f905-55f5-4034-955b-cb4d4bb94cb5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:48.122469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65f905-55f5-4034-955b-cb4d4bb94cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:48.122578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65f905-55f5-4034-955b-cb4d4bb94cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:48.163596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:48.190076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8e65f905-55f5-4034-955b-cb4d4bb94cb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:48.191193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e65f905-55f5-4034-955b-cb4d4bb94cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:48.287978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 560/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:48.574259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:48.575781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:48.681503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd424f1-3d4d-467d-b37a-9cc7c4f457d2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:48.713343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:48.755595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:48.756185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:48.756453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:48.756714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:48.758444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:48.867700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:48.869162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cce53-6ee1-44b2-8bb6-29e3d17c1630 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:48.886516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 560/1120] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:51.214820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:51.215366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:51.215366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:51.216618 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 561/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:51.221727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173ec4-7d45-4ee9-b69d-ac93408cb4f8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:51.222147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173ec4-7d45-4ee9-b69d-ac93408cb4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:51.222254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37173ec4-7d45-4ee9-b69d-ac93408cb4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:51.289899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37173ec4-7d45-4ee9-b69d-ac93408cb4f8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:51.291182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37173ec4-7d45-4ee9-b69d-ac93408cb4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:51.304840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:51.389801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 561/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:51.674096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:51.675673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:51.777737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e1fa-bfbb-481c-8e0c-2a21d35c78a7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:51.790476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:51.851569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:51.852166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:51.852703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:51.852970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:51.854592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:51.962989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:51.964418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05cf66-1fd5-4493-a00a-0821e96f3b42 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:51.982741 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 562/1123] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:52:54.454648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:54.455177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:54.455177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:54.456509 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 562/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 15:52:54.462343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94f3d-2652-4bc0-b18a-1242fd5a89a1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:54.462814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94f3d-2652-4bc0-b18a-1242fd5a89a1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:54.462923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc94f3d-2652-4bc0-b18a-1242fd5a89a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:54.510675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:54.529307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6cc94f3d-2652-4bc0-b18a-1242fd5a89a1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:54.530512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6cc94f3d-2652-4bc0-b18a-1242fd5a89a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:54.628979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 563/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:52:54.915558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:54.917113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:55.021150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2073be6-b8d9-42e8-990b-d11b8de09da3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:55.062930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:55.097243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:55.097865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:55.098139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:55.098405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:55.099984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:55.207221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:55.208566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938f21-1c43-4a70-8318-0ef2bcf5f19d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:55.227242 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 563/1126] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:52:57.510062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:57.510632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:57.510632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:57.511915 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 564/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:52:57.517133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e775f-c03a-4bd6-86af-b2576e54208b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:57.517564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e775f-c03a-4bd6-86af-b2576e54208b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:57.517761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e775f-c03a-4bd6-86af-b2576e54208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:57.583633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e87e775f-c03a-4bd6-86af-b2576e54208b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:52:57.584829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e87e775f-c03a-4bd6-86af-b2576e54208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:57.606198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:57.683478 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 564/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:52:57.966288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:52:57.967802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:58.068647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abe213-5e73-49f4-8c37-61b3293117c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:52:58.089673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:52:58.141623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:52:58.142223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:52:58.142493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:52:58.142755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:52:58.144331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:52:58.251931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:52:58.253380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c992-3b28-425a-8db1-50833f1378e4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:52:58.271414 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 565/1129] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:53:00.535351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:00.535918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:00.535918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:00.537174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 565/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:00.543350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89464-8721-4dab-be13-8a5f6842ad62 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:00.543787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89464-8721-4dab-be13-8a5f6842ad62 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:00.543895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e89464-8721-4dab-be13-8a5f6842ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:00.606459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:00.609488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4e89464-8721-4dab-be13-8a5f6842ad62 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:00.611354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4e89464-8721-4dab-be13-8a5f6842ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:00.710996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 566/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:01.008096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:01.009657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:01.113861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b837-1e2c-4472-9250-437e12cfdb7b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:01.162586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:01.188176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:01.188703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:01.188973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:01.189272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:01.190836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:01.298610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:01.300042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da645a5d-671c-4daa-944b-01a85e8d8a8c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:01.318679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 566/1132] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:03.596543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:03.597138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:03.597138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:03.598474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 567/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:03.604587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27012c-ace5-4987-84ca-19fd3680169a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:03.605085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27012c-ace5-4987-84ca-19fd3680169a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:03.605178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27012c-ace5-4987-84ca-19fd3680169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:03.672935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd27012c-ace5-4987-84ca-19fd3680169a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:03.674168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd27012c-ace5-4987-84ca-19fd3680169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:03.704067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:03.771896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 567/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:04.065821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:04.067366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:04.172503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4755d79-4e6d-40fc-bf7c-e8b16f29570d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:04.202306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:04.250456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:04.251094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:04.251383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:04.251650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:04.253395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:04.365978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:04.368076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60466a46-6acd-4b36-a9d7-89d2a1daf087 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:04.385650 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 568/1135] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:06.620125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:06.620682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:06.620682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:06.622060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:06.627465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a1a8-5eac-4ab2-8f6b-4fc00eaa80a8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:06.627881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a1a8-5eac-4ab2-8f6b-4fc00eaa80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:06.628019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a1a8-5eac-4ab2-8f6b-4fc00eaa80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:06.696542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7d88a1a8-5eac-4ab2-8f6b-4fc00eaa80a8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:06.697812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7d88a1a8-5eac-4ab2-8f6b-4fc00eaa80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:06.706768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:06.796540 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:07.092214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:07.093989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:07.197223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa635b-9694-4679-967d-6bc8b5eca128 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:07.252349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:07.270478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:07.271071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:07.271345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:07.271611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:07.273340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:07.380244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:07.381698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acfd68-315f-463a-a22a-224decac9f49 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:07.399219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 569/1138] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:09.624146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:09.624757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:09.624757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:09.626095 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:09.631522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecf909-8abd-4f3c-9b43-545e7e397c85 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:09.632053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecf909-8abd-4f3c-9b43-545e7e397c85 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:09.632181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecf909-8abd-4f3c-9b43-545e7e397c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:09.699162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a0ecf909-8abd-4f3c-9b43-545e7e397c85 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:09.700547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0ecf909-8abd-4f3c-9b43-545e7e397c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:09.739030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:09.797313 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:10.090947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:10.092454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:10.198631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88721819-e9b3-43ee-be2d-ddf0ed1d1ae7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:10.236564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:10.273601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:10.274204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:10.274506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:10.274768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:10.276466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:10.386659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:10.388130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9b0d8-416d-4ca8-a599-c280e026adc5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:10.407549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 571/1141] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:12.654865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:12.655430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:12.655532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:12.656845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:12.662900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6392f-aa09-4b53-b3ca-d8463fcfdbd5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:12.663342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6392f-aa09-4b53-b3ca-d8463fcfdbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:12.663808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6392f-aa09-4b53-b3ca-d8463fcfdbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:12.732697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8ad6392f-aa09-4b53-b3ca-d8463fcfdbd5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:12.733963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ad6392f-aa09-4b53-b3ca-d8463fcfdbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:12.752943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:12.838009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:13.134183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:13.135699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:13.238128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6c99a-a020-49c8-ae45-8817a9278b11 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:13.303098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:13.310548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:13.311149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:13.311421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:13.311688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:13.313291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:13.420165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:13.421616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be9fa3-cbe1-4b85-8075-930d6c8a6209 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:13.440156 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 572/1144] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:15.663679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:15.664222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:15.664317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:15.665652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:15.671119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3c5d-a1cf-46b5-841d-c93bee9ee7e9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:15.671534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3c5d-a1cf-46b5-841d-c93bee9ee7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:15.671665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3c5d-a1cf-46b5-841d-c93bee9ee7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:15.739422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a9a3c5d-a1cf-46b5-841d-c93bee9ee7e9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:15.740622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a9a3c5d-a1cf-46b5-841d-c93bee9ee7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:15.788352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:15.837789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:16.121597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:16.123120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:16.226866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1601-b257-46d3-99bf-61c09fe2a10c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:16.275853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:16.304983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:16.305613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:16.305883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:16.306143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:16.307872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:16.418293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:16.419702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e866bf3-69d5-4a99-bca1-321b837eeb83 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:16.438491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 574/1147] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:25.836738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=22 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:26.436253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=66 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:36.708795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4238d-c7ba-46f4-b0ad-db93303910f3 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:36.709368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4238d-c7ba-46f4-b0ad-db93303910f3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:36.709368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4238d-c7ba-46f4-b0ad-db93303910f3 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:36.710921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 574/1148] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:36.716902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ebac-164b-4ac5-bf36-4b6565a6640b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:36.717335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ebac-164b-4ac5-bf36-4b6565a6640b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:36.717564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ebac-164b-4ac5-bf36-4b6565a6640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:36.789474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d611ebac-164b-4ac5-bf36-4b6565a6640b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:36.790844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d611ebac-164b-4ac5-bf36-4b6565a6640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:36.892625 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 575/1149] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:37.208884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:37.209206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:37.209541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:37.211085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 575/1150] 10.222.0.78 () {54 vars in 962 bytes} [Tue Oct 18 15:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:37.216238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032c99-f118-454b-bf50-d5d7b5f52671 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:37.216517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032c99-f118-454b-bf50-d5d7b5f52671 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:37.216790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032c99-f118-454b-bf50-d5d7b5f52671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:37.292467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-03032c99-f118-454b-bf50-d5d7b5f52671 None None] MFA Rules not processed for user `dd3b359a6c724c67853394a3a8481995`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:37.293671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03032c99-f118-454b-bf50-d5d7b5f52671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:37.316678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:37.372715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 576/1151] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 18 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:37.380637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:37.382184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:37.485148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98389a72-09b0-4573-8b2b-38461f772034 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:37.557380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:37.557969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:37.558236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:37.558494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:37.560051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:37.614115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:37.669488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:37.670913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58e831-b1d1-488a-9b3f-fc4e86525c36 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:37.689234 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 576/1152] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:39.963456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:39.963926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:39.964048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:39.965380 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 577/1153] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:39.970490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ab45-23e7-4f8b-82eb-79c68e23369b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:39.970917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ab45-23e7-4f8b-82eb-79c68e23369b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:39.971026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489ab45-23e7-4f8b-82eb-79c68e23369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:40.036759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a489ab45-23e7-4f8b-82eb-79c68e23369b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:40.038000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a489ab45-23e7-4f8b-82eb-79c68e23369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:40.134959 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 577/1154] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:40.415749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:40.417407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:40.545795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf321168-7275-48cf-9a6b-43ac64fb00fe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:40.595470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:40.640650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:40.641283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:40.641558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:40.641825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:40.642456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:40.643546 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:53:40.643546 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:53:40.643546 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:53:40.644724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c52019-d511-4df0-883c-c2b76d57c8cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:40.665812 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 578/1155] 10.222.0.78 () {56 vars in 1108 bytes} [Tue Oct 18 15:53:40 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:53:42.830632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:42.831219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:42.831219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:42.832507 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 578/1156] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:42.838051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc9b8-8a09-446a-8216-58aac05b85ad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:42.838480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc9b8-8a09-446a-8216-58aac05b85ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:42.838671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc9b8-8a09-446a-8216-58aac05b85ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:42.905815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b44fc9b8-8a09-446a-8216-58aac05b85ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:42.907023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b44fc9b8-8a09-446a-8216-58aac05b85ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:43.015021 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 579/1157] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:43.319060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:43.320861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:43.330691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:43.468056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395aea4-c349-41c8-b745-cfe45d4fa52c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:43.546658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:43.580731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:43.581280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:43.581551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:43.581814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:43.583389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:43.677390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:43.678997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f315048-c3be-4ec0-92b6-6d11b97bd268 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:43.696983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 579/1158] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:46.026405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:46.026959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:46.027066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:46.028392 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 580/1159] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:46.033568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa671-5426-4d1c-83d2-0dbed3f75a39 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:46.034071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa671-5426-4d1c-83d2-0dbed3f75a39 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:46.034205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa671-5426-4d1c-83d2-0dbed3f75a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:46.100324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d62fa671-5426-4d1c-83d2-0dbed3f75a39 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:46.101548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d62fa671-5426-4d1c-83d2-0dbed3f75a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:46.147909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:46.198840 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 580/1160] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:46.497748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:46.499345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:46.523568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:46.605832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa470d-0ad1-46e2-8280-a1298afc496e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:46.681923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:46.682543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:46.682792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:46.683051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:46.684629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:46.761709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:46.798591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:46.800181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf911cf5-9537-4676-a9c0-33e786df9f10 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:46.818576 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 581/1161] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:49.031234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:49.031823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:49.031823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:49.033192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 581/1162] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:49.038522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85406-6910-429b-82ca-97ca1f6e8e74 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:49.038987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85406-6910-429b-82ca-97ca1f6e8e74 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:49.039094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85406-6910-429b-82ca-97ca1f6e8e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:49.105036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-adf85406-6910-429b-82ca-97ca1f6e8e74 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:49.106238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-adf85406-6910-429b-82ca-97ca1f6e8e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:49.200903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 582/1163] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:53:49.490340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:49.491862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:49.596352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f3e78-93c7-452a-98c2-20a1008f803b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:49.671600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:49.673424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:49.674257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:49.674724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:49.675043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:49.676793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:49.786543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:49.787901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f42d80-4d50-4c18-8b89-c958a16f056a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:49.805959 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 582/1164] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 15:53:52.096321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:52.096917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:52.096917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:52.098224 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 583/1165] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:52.103945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ff9-d7dc-4fee-b407-e3ea36119763 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:52.104553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ff9-d7dc-4fee-b407-e3ea36119763 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:52.104553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299ff9-d7dc-4fee-b407-e3ea36119763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:52.171178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a2299ff9-d7dc-4fee-b407-e3ea36119763 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:52.172429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2299ff9-d7dc-4fee-b407-e3ea36119763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:52.224269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:52.267983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 583/1166] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:52.561395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:52.562962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:52.598434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:52.666052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d72ab-d735-439a-8934-43ae745a5415 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:52.741746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:52.742344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:52.742617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:52.742883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:52.745315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:52.824744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:52.854594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:52.856006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8339c-d1ec-44ab-b53b-99aac560b53a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:52.874561 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 584/1167] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:53:55.337624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:55.338154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:55.338154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:55.339552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 584/1168] 10.222.0.78 () {54 vars in 927 bytes} [Tue Oct 18 15:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:53:55.345119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376691-88f1-42ab-b4ec-fef3ba22f657 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:55.345527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376691-88f1-42ab-b4ec-fef3ba22f657 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:55.345653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376691-88f1-42ab-b4ec-fef3ba22f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:55.411856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6a376691-88f1-42ab-b4ec-fef3ba22f657 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:53:55.413075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a376691-88f1-42ab-b4ec-fef3ba22f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:55.508931 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 585/1169] 10.222.0.78 () {58 vars in 1024 bytes} [Tue Oct 18 15:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:53:55.802181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:53:55.803738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:55.906290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16112e47-a142-43ae-8cae-d6b022aaaeae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:53:55.980402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:53:55.981041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:53:55.981316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:53:55.981578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:53:55.983157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:53:55.991720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:53:56.094599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:53:56.096037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14a1bc-ffb0-4f29-8f72-7a8e5ef9896c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:53:56.113992 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 585/1170] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:54:05.507377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:54:06.111724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=50 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:09.615040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:09.615646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:09.615646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:09.689754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:55:09.690942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:09.787258 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 586/1171] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 15:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:55:09.796142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:09.796643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:09.796747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:09.871043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:55:09.872154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:09.968433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 586/1172] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 15:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:55:09.973087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:09.974480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:09.987476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213eb91-c8ea-4096-81d5-f2d56b67f4e3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.049319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:10.084230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.084837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.085143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.085412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.086670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 15:55:10.087134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.088143 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:55:10.088143 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:55:10.088143 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:55:10.089040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.101312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 587/1173] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 15:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:55:10.111171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:10.120899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fca099-9ff4-49a0-ad6a-32bb936f9340 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.183085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:10.217983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.218623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.218924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.219199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.219827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.220933 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:55:10.220933 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 15:55:10.220933 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 15:55:10.222234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.278445 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 587/1174] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 15:55:10 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:55:10.282701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:10.284207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:10.322379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b11e1-abff-43a5-9e61-9c699cfc7ff8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.420575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.421227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.421502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.421767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.422404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.423405 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:55:10.423405 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:55:10.423405 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:55:10.424597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.468320 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 588/1175] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 15:55:10 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 15:55:10.472431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:10.473997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:10.536847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61778fb-2c80-4731-aa88-3ac442b38379 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.626225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:10.639212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.639808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.640083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.640340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.640965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.642589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.654909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 588/1176] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 15:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:55:10.659203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:10.660766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:10.673140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79a05-0877-4ef2-a7f8-9ff0777fbeda admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.699387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:10.770207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.770722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.770994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.771258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.771888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.773741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305a409-670d-44cd-83f1-76a272fffdde admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.786079 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 589/1177] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 15:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 15:55:10.791085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:10.792580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:10.826145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89442697-4ad5-46b1-a72d-402098591e6c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:10.921517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:10.922170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.922446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.922731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] PATH_INFO: `/v3/projects/cbf1f4225a744336a2a41e1c41789da1/users/88e058575014472c8f7556c6c2158ba6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:10.949505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf1f4225a744336a2a41e1c41789da1, user_id=88e058575014472c8f7556c6c2158ba6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:10.952178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6277a2-d9f3-4247-a47b-292e9bf031f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:10.976932 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 589/1178] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 15:55:10 2022] PUT /identity/v3/projects/cbf1f4225a744336a2a41e1c41789da1/users/88e058575014472c8f7556c6c2158ba6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:55:10.988164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295523-cd71-40fc-808b-ea40212a612b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:10.988447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295523-cd71-40fc-808b-ea40212a612b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:10.988719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295523-cd71-40fc-808b-ea40212a612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.047925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af295523-cd71-40fc-808b-ea40212a612b None None] MFA Rules not processed for user `88e058575014472c8f7556c6c2158ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:55:11.049271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af295523-cd71-40fc-808b-ea40212a612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:11.128297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 590/1179] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 15:55:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:55:11.142071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.142441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.142780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.144230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 590/1180] 10.222.0.78 () {54 vars in 963 bytes} [Tue Oct 18 15:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:55:11.150105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd79a-657c-442a-b748-caf45f14c44d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.150375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd79a-657c-442a-b748-caf45f14c44d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.150673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebd79a-657c-442a-b748-caf45f14c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.187239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:11.232067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4aebd79a-657c-442a-b748-caf45f14c44d None None] MFA Rules not processed for user `5cdf82dd7b714a26a2c4f396ca0b20be`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:55:11.233306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aebd79a-657c-442a-b748-caf45f14c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:11.307713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 591/1181] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 18 15:55:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:55:11.315367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:11.317148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:11.368892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:11.422062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43076b44-ce39-4c30-aa67-4b2a684db799 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:11.494463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:11.495055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.495323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.495583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.497180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:11.595412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:11.596851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:11.600313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:11.615419 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 591/1182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:55:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:55:11.660911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff265-6867-4347-a707-a75b0e780279 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.661337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff265-6867-4347-a707-a75b0e780279 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.661502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaff265-6867-4347-a707-a75b0e780279 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.662768 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 592/1183] 10.222.0.78 () {52 vars in 830 bytes} [Tue Oct 18 15:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:55:11.666565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:11.667803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:11.766863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee3ca-92c1-44bf-8144-6c8c97201ae3 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:11.857737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:11.858381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.858528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.858789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] PATH_INFO: `/v3/users/88e058575014472c8f7556c6c2158ba6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:11.871918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e058575014472c8f7556c6c2158ba6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:11.872927 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:55:11.872927 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 15:55:11.872927 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 15:55:11.874160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:11.883565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:11.940166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e058575014472c8f7556c6c2158ba6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:11.940709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e058575014472c8f7556c6c2158ba6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:11.954589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e058575014472c8f7556c6c2158ba6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:11.955073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e058575014472c8f7556c6c2158ba6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:11.965088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e058575014472c8f7556c6c2158ba6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:11.993998 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 592/1184] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 15:55:11 2022] DELETE /identity/v3/users/88e058575014472c8f7556c6c2158ba6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:55:11.998433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:11.998705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:11.998970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:12.058960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:55:12.060137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:12.135430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:12.148663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 593/1185] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 15:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:55:12.158492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:12.159778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:12.260700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e965d5-70ad-46d2-bb5c-41873c7dccb6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:12.312687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:12.332810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:12.333435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:12.334315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:12.334315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:12.335638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:12.447665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:12.449090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946b3a6-7b93-4dcf-accd-44565a85a5e5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:12.468706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 593/1186] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:55:12.860593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:55:12.860593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:55:12.872631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2625-fd8d-4991-8f31-34caebf9c9b6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:55:12.984510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:55:12.985103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:55:12.988337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:55:12.988337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] PATH_INFO: `/v3/projects/cbf1f4225a744336a2a41e1c41789da1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:55:13.000372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf1f4225a744336a2a41e1c41789da1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:55:13.001432 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 15:55:13.001432 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 15:55:13.001432 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 15:55:13.002628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:55:13.060224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf1f4225a744336a2a41e1c41789da1', 'request_id': 'req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:13.073336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf1f4225a744336a2a41e1c41789da1', 'request_id': 'req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:13.079645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf1f4225a744336a2a41e1c41789da1', 'request_id': 'req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:13.105828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] The token cache is being invalidate because project cbf1f4225a744336a2a41e1c41789da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 15:55:13.106116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:13.106626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5727ebcf-af44-4ba9-93ee-1407b0ffbe6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 15:55:13.107971 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 594/1187] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 15:55:12 2022] DELETE /identity/v3/projects/cbf1f4225a744336a2a41e1c41789da1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 15:55:22.466473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=62 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:55:23.103485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:38.472873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92dcf-4f57-40aa-8bef-a62a395700d0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:38.473440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92dcf-4f57-40aa-8bef-a62a395700d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:38.473548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92dcf-4f57-40aa-8bef-a62a395700d0 None None] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:38.474788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 594/1188] 10.222.0.45 () {54 vars in 925 bytes} [Tue Oct 18 15:58:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:58:38.482792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742d36-4dfd-434c-94db-5dbd3121c870 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:38.483254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742d36-4dfd-434c-94db-5dbd3121c870 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:38.483372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742d36-4dfd-434c-94db-5dbd3121c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:38.564078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3742d36-4dfd-434c-94db-5dbd3121c870 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:58:38.565309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3742d36-4dfd-434c-94db-5dbd3121c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:58:38.679071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 595/1189] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 18 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:58:38.984746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083684-9aa4-4f3a-b04f-724e16f692a2 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:38.985040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083684-9aa4-4f3a-b04f-724e16f692a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:38.985308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083684-9aa4-4f3a-b04f-724e16f692a2 None None] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:38.986561 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 595/1190] 10.222.0.39 () {54 vars in 925 bytes} [Tue Oct 18 15:58:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 15:58:38.993776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2bc6-2faf-480b-bde3-dfe1e7eadbf4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:38.994087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2bc6-2faf-480b-bde3-dfe1e7eadbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:38.994363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d2bc6-2faf-480b-bde3-dfe1e7eadbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:39.015963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-239d2bc6-2faf-480b-bde3-dfe1e7eadbf4 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:58:39.017197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-239d2bc6-2faf-480b-bde3-dfe1e7eadbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:58:39.025819 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 596/1191] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Oct 18 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:58:47.268763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ef17-6e02-43b5-8d56-70299e493abd None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.269328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ef17-6e02-43b5-8d56-70299e493abd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.269328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ef17-6e02-43b5-8d56-70299e493abd None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.270797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 596/1192] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 15:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:58:47.275799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a41e-fb3f-40ea-9aa0-c6b718e183c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.276296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a41e-fb3f-40ea-9aa0-c6b718e183c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.276415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831a41e-fb3f-40ea-9aa0-c6b718e183c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.297488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2831a41e-fb3f-40ea-9aa0-c6b718e183c1 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:58:47.298792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2831a41e-fb3f-40ea-9aa0-c6b718e183c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:58:47.308273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 597/1193] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:58:47.316062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ef17-6e02-43b5-8d56-70299e493abd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:58:47.331394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ef17-6e02-43b5-8d56-70299e493abd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:58:47.336344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:58:47.336951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.337261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.337529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.347580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:58:47.349327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0c7af-1a65-456b-84c1-c559a2220467 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:58:47.361541 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 597/1194] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:58:47.370034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba579-1284-4842-bf8f-2162638a329a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.370363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba579-1284-4842-bf8f-2162638a329a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.370629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba579-1284-4842-bf8f-2162638a329a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.371984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 598/1195] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 15:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:58:47.377686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd64c-09cf-4415-893a-cf8461abf511 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.377972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd64c-09cf-4415-893a-cf8461abf511 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.378240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acd64c-09cf-4415-893a-cf8461abf511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.399650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b2acd64c-09cf-4415-893a-cf8461abf511 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:58:47.400831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2acd64c-09cf-4415-893a-cf8461abf511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:58:47.410339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 598/1196] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:58:47.417896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba579-1284-4842-bf8f-2162638a329a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:58:47.432253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba579-1284-4842-bf8f-2162638a329a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:58:47.438438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:58:47.439017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:58:47.439289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:58:47.439555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:58:47.448918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:58:47.451364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e7808-5c40-48cb-9c44-c0764d51fc6d service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:58:47.460949 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 599/1197] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:58:57.394034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:58:57.456755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:00.828754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:00.829322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:00.829322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:00.830573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 599/1198] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:59:00.835499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837672-5ebb-4217-949a-5b29d60c56a4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:00.835901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837672-5ebb-4217-949a-5b29d60c56a4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:00.836042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837672-5ebb-4217-949a-5b29d60c56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:00.894590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28837672-5ebb-4217-949a-5b29d60c56a4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:59:00.895781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28837672-5ebb-4217-949a-5b29d60c56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:00.970709 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 600/1199] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 15:59:01.123683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:59:01.125549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:01.225924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead0f6b-a4e4-4e48-a019-c40c5d61285c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:59:01.232155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:59:01.232751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:01.233057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:01.233334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:01.241297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:59:01.242885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250baa97-a2e4-42c1-a66c-b8939f7c2f0a service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:59:01.252228 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 600/1200] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:59:02.345139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b65c1-13e3-41e4-95e4-a30d189e7dd5 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:02.345720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b65c1-13e3-41e4-95e4-a30d189e7dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:02.345720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b65c1-13e3-41e4-95e4-a30d189e7dd5 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:02.347004 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 601/1201] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 15:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:59:02.353183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321371-f08d-42c9-b842-b5124a817e3d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:02.353610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321371-f08d-42c9-b842-b5124a817e3d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:02.353711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321371-f08d-42c9-b842-b5124a817e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:02.374473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b5321371-f08d-42c9-b842-b5124a817e3d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:59:02.375693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5321371-f08d-42c9-b842-b5124a817e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:02.384745 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 601/1202] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:59:02.536949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b65c1-13e3-41e4-95e4-a30d189e7dd5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:59:02.551637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b65c1-13e3-41e4-95e4-a30d189e7dd5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:59:02.556877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:59:02.557491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:02.557771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:02.558048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:02.565912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:59:02.567456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4571ca5-d875-40df-8cd5-e375144521ba service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:59:02.576597 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 602/1203] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:59:06.437316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:06.437852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:06.437852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:06.439430 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 602/1204] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:59:06.446550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636076-ab45-4fe2-859e-23ffeef7f03a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:06.447047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636076-ab45-4fe2-859e-23ffeef7f03a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:06.447150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a636076-ab45-4fe2-859e-23ffeef7f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:06.469123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6a636076-ab45-4fe2-859e-23ffeef7f03a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:59:06.470343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a636076-ab45-4fe2-859e-23ffeef7f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:06.478292 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 603/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:59:06.775739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:59:06.777514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:06.853713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c882226-fa55-401d-940c-ad69f4e815d8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:59:06.857943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:59:06.858540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:06.858812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:06.859084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:06.867662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:59:06.869114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b874f7-a46d-4ac3-af72-48b2a7f0598e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:59:06.879248 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 603/1206] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:59:09.073282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cc7a-9a62-4a42-821c-fcfe57e79a4d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:09.073842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cc7a-9a62-4a42-821c-fcfe57e79a4d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:09.073842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cc7a-9a62-4a42-821c-fcfe57e79a4d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:09.075227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 604/1207] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 15:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:59:09.081261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061901-4db3-4e12-9b2e-eb2f2d63b628 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:09.081695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061901-4db3-4e12-9b2e-eb2f2d63b628 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:09.081791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6061901-4db3-4e12-9b2e-eb2f2d63b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:09.102660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b6061901-4db3-4e12-9b2e-eb2f2d63b628 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:59:09.103861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b6061901-4db3-4e12-9b2e-eb2f2d63b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:09.112246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 604/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 15:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 15:59:09.395080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cc7a-9a62-4a42-821c-fcfe57e79a4d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 15:59:09.406302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cc7a-9a62-4a42-821c-fcfe57e79a4d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 15:59:09.409749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 15:59:09.410335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:09.410610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:09.410878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:09.419886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 15:59:09.421328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0152a-282e-4e49-87b1-76e09a58087c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 15:59:09.430564 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 605/1209] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 15:59:19.097898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:19.426457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=65 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 15:59:58.064759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd90cf-9996-46f0-aee2-35563ab79d8c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:58.065407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd90cf-9996-46f0-aee2-35563ab79d8c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:58.065407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd90cf-9996-46f0-aee2-35563ab79d8c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:58.066648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 605/1210] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 15:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 15:59:58.071621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817732e3-1070-47e2-b75f-3f9811c47128 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 15:59:58.072051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817732e3-1070-47e2-b75f-3f9811c47128 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 15:59:58.072162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817732e3-1070-47e2-b75f-3f9811c47128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 15:59:58.091915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-817732e3-1070-47e2-b75f-3f9811c47128 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 15:59:58.093157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-817732e3-1070-47e2-b75f-3f9811c47128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 15:59:58.101633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 606/1211] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:00:08.086788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:30.387377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.388490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.388983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.410472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.411794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.427629 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 606/1212] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.439194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc685-2771-4583-aaea-4be068c35695 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.439788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc685-2771-4583-aaea-4be068c35695 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.439927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc685-2771-4583-aaea-4be068c35695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.465559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-874bc685-2771-4583-aaea-4be068c35695 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.466973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-874bc685-2771-4583-aaea-4be068c35695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.479982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 607/1213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.485493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:30.497623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacee78-6613-4309-a717-8e6ff53e6ec4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:30.510658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:30.511313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.511587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.511857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.512880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:30.513207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:30.514228 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:00:30.514228 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:00:30.514228 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:00:30.515102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:30.533887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 607/1214] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:30.542417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc685-2771-4583-aaea-4be068c35695 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:30.556938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc685-2771-4583-aaea-4be068c35695 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:30.568372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:30.569049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.569332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.569601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.570274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:30.571349 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:00:30.571349 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:00:30.571349 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:00:30.573329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c0a7-78fa-4b37-84dd-5e807e04af8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:30.638233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 608/1215] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:30.642425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:30.658798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ef90-fc6f-40d3-9074-ffc066b4832d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:30.721846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf433-1654-40d2-9879-0c3af0293259 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.722420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf433-1654-40d2-9879-0c3af0293259 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.722711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdf433-1654-40d2-9879-0c3af0293259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.755103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:30.755734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.756007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.756272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.756923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:30.758303 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:00:30.758303 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:00:30.758303 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:00:30.759508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:30.765507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-69fdf433-1654-40d2-9879-0c3af0293259 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.766734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69fdf433-1654-40d2-9879-0c3af0293259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.786032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 609/1216] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.787420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6b37-127f-4528-9360-e367bf4f1f05 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.787708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6b37-127f-4528-9360-e367bf4f1f05 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.787982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e6b37-127f-4528-9360-e367bf4f1f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.810953 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 608/1217] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:30.816686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:30.827154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-960e6b37-127f-4528-9360-e367bf4f1f05 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.829829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-960e6b37-127f-4528-9360-e367bf4f1f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.832860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d886c5-fc1c-49d8-8503-a242a4e882f9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:30.843274 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 610/1218] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.844554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a83b1-2ec8-4f4b-821c-b6c4652d7328 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.844836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a83b1-2ec8-4f4b-821c-b6c4652d7328 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.845154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a83b1-2ec8-4f4b-821c-b6c4652d7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.847967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:30.848636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.848914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.849220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.849961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:30.851868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54916-bc23-45e2-bf3a-4cb2cd51a69d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:30.873207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 609/1219] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:30.874623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.874912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.875181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.883826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7a6a83b1-2ec8-4f4b-821c-b6c4652d7328 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.885364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7a6a83b1-2ec8-4f4b-821c-b6c4652d7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.899147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 611/1220] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.900839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370035-8162-47f7-8893-497ef1dbc695 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.901153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370035-8162-47f7-8893-497ef1dbc695 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.901510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16370035-8162-47f7-8893-497ef1dbc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.910092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.911313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.936856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-16370035-8162-47f7-8893-497ef1dbc695 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.939838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 610/1221] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.940894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:30.942483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16370035-8162-47f7-8893-497ef1dbc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.962381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 612/1222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:30.965282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce52ae-094e-418d-b6be-68284a8c33ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:30.966143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113f4-45f4-4e8b-a24d-9200eb8d4ca0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.966399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113f4-45f4-4e8b-a24d-9200eb8d4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.966676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732113f4-45f4-4e8b-a24d-9200eb8d4ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.971402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:30.972387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:30.972878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:30.973399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:30.974253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:30.976461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:30.988319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-732113f4-45f4-4e8b-a24d-9200eb8d4ca0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:30.989523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-732113f4-45f4-4e8b-a24d-9200eb8d4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:30.995172 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 611/1223] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:30.996840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.006413 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 613/1224] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.008186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.008682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.009185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.015196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c39ea-264a-4484-9112-08e2e56c9b9f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.020881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.022491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.022773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.023043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.023689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.023987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.026169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae4a2e-c2b9-47e6-a2b9-b358e3cff38d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.040759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 612/1225] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.042319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.043320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.043756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.043914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.044343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.058175 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 614/1226] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.059197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.066483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.068179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.072079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7c49f-7e05-436d-8382-d89fa1a5e037 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.078076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.078793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.079068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.079336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.079980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.080276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.081039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 613/1227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.081865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.082159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41d00-952b-4ebd-98a7-68a11667daa2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.092131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeed677-b8cc-4684-b629-5feebed146db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.097155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.097798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.098081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.098350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] PATH_INFO: `/v3/projects/18119767251943a6adb74f84e5259397/users/a1f06f3bd8b54af68897ccb1a3212de4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.099366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 615/1228] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.100628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d073-56cd-4df6-a898-5d398573333b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.100912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d073-56cd-4df6-a898-5d398573333b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.101267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d073-56cd-4df6-a898-5d398573333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.121317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18119767251943a6adb74f84e5259397, user_id=a1f06f3bd8b54af68897ccb1a3212de4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.122389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-30f9d073-56cd-4df6-a898-5d398573333b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.123707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-30f9d073-56cd-4df6-a898-5d398573333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.123944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.132033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 616/1229] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.133315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295d-23c8-46e8-be93-c8af1226a4b5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.133590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295d-23c8-46e8-be93-c8af1226a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.133865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295d-23c8-46e8-be93-c8af1226a4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.139099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 614/1230] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:31 2022] PUT /identity/v3/projects/18119767251943a6adb74f84e5259397/users/a1f06f3bd8b54af68897ccb1a3212de4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:31.140187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.153846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6e04295d-23c8-46e8-be93-c8af1226a4b5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.154949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e04295d-23c8-46e8-be93-c8af1226a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.200841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:31.205103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb157a-b43f-41ec-b16d-1590738d7c14 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.211203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.211808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.212083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.212354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.213172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.214588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 617/1231] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.215227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850cbc9-dec8-4629-870f-89c6b5253072 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.215858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.216140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.216407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.236898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.238228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.247516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 615/1232] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.247516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.247516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.247516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.247961 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 618/1233] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.248875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.259960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371774d6-a60f-4523-8525-cfab89decd89 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.267477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.268684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.312154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:31.319076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.320052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.320559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.320834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.321537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.321843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.323517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.330500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 616/1234] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.331232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.336366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 619/1235] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.337359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.340515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142558-ecb5-4359-9d23-1902dd7f9660 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.346898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.347476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245bcd-2a8f-459e-9878-9b47138b694f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.347591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.347817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.348087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.348707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.350620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edbeef-9ff1-4ded-aff7-84d97ab75241 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.352164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.352752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.353062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.353853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.354531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.354827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.356669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74029b9c-5f70-46c1-9d08-679488900789 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.368844 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 620/1236] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.370941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d286e7-d13b-451f-b4d4-23ddafeed71c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.371224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d286e7-d13b-451f-b4d4-23ddafeed71c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.371540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d286e7-d13b-451f-b4d4-23ddafeed71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.389025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 617/1237] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.389025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.389025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.389025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.403496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d1d286e7-d13b-451f-b4d4-23ddafeed71c None None] MFA Rules not processed for user `a1f06f3bd8b54af68897ccb1a3212de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.404769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1d286e7-d13b-451f-b4d4-23ddafeed71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.409886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.411183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.481741 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 618/1238] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.481962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 621/1239] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.482400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.482484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.482484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.482484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.492218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5042e-5f83-420c-b956-d83e8c4d15d3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.497805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.498409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.498685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.498952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.499581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.501171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:31.501517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.502369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:31.510221 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 622/1240] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:31.511061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.526259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0a5eb-a3ac-4d3e-8e56-2d7d2f073716 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.526551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 619/1241] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.527485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.534057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.534744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.534923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.535193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.535847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.536147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.537363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0769c7-7433-4873-87c1-98ff62db76e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.537838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.542510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.543222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.543549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.543888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.544576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.546524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.550126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 623/1242] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.550909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.561039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3500d-0e7f-4898-b2e9-651ef3f3cef3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.565544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.566129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.566406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.566675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.567308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.569200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.582481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 620/1243] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.583316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.605522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 624/1244] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.605522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.610899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:31.648154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6ebcb-78ce-428d-b805-6fe26785253f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.668015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238f16-701e-47cf-ab42-d5c33be39e22 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.672557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.673193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.673472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.673743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.674392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.674692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.676265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.688137 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 625/1245] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.688913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.698991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5de3c-ddb0-4f0c-b151-16835b4c6f79 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.703580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.704162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.704493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.704767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.705418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.707304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.712545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.713799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.714329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.714607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.715238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.717176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.737566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:31.743590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 621/1246] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.745260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.748901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 626/1247] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.749830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.755724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d645a4-f631-4d1b-94ad-77c839d09e42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.813807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04c50-9938-464a-b9fe-b31d972134bb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.816882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.817492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.817769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.818040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.818385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.818678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:31.818980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.819082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.819257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.819530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.820170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.820579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.821781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.832279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 627/1248] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:31.840865 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 622/1249] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:31.841072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.841181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.844483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec1bfd-ff08-41a5-a59e-45894f7be85c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.845543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1566-ffd5-4d1a-a0d3-e1e2af4df97b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.849054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.849644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.849921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.850169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.850466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.850766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.851043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.851145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.851312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.851970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.852937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.854203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.876011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 623/1250] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.876855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.883986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 628/1251] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.883986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.887313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7e9e7-dd9c-41c7-8b0e-2bbe54ceda1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.919611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:31.948333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703505d-2b58-4a62-bd40-079b4c12c36e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:31.949910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.950525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.950801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.951093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.951705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.953426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:31.953746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.954065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:31.954347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:31.954632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:31.955415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:31.957971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:31.979477 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 624/1252] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.979477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.989070 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 629/1253] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:31.989777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:31.990204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26879-a246-49e6-919e-a71ee0adfc61 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.048882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.049535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.049816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.050085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.050194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.050789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.052356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.054273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219e10-57b0-4715-91e9-b97be6d3f00f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.060392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.061029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.061470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.061741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.062375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.065818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 625/1254] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.065818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.066071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.075716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306d7f8-ec66-415d-adec-79d0fdcd3528 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.080986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.081604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.081901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.082196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.082956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.084535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.091728 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 630/1255] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:31 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:32.091728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.098688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 626/1256] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.100204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.102492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de182e-198c-4646-9288-1733fea3a8c8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.107932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.108540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.108819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.109126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.109764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.111695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.111828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730e1de-c604-454e-8d21-3fe09a31c912 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.116636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.117666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.118044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.118385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.119092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.120768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.135319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 627/1257] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.135319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.142582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 631/1258] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:32.143448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.143867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dabd4-3292-4d62-83d5-b2af51f46f39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.203625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.204145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.204437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.204695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.205355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.207273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.207736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf6ccd-c16a-45a1-ad6f-bd3298ff5297 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.212498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.213286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.213665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.214035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.214775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.216471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.227314 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 632/1259] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.228165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.232864 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 628/1260] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:32.232864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.238550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5c53-6159-4757-b26d-558daea41861 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.242347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc642-ec9a-4614-9631-e61158f50d70 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.243116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.243689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.244550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.244807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.245607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.247710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.247991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.248638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.249062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.249382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.250078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.251673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.265405 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 629/1261] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.266225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.270821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 633/1262] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/users => generated 299 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:32.271685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.278042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9fc3-363d-4e23-9e3d-c33c027d2c60 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.282837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71f6f-8bb3-4537-9934-f037f34a2f0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.283001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.283451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.283732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.284002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.284639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.286314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.287364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.288167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.288799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.289115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] PATH_INFO: `/v3/projects/3186583a0e8b4896951188873665b6c4/users/aad76b56775442b39f520050248f6f03/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.297825 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 630/1263] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.301588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.305705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3186583a0e8b4896951188873665b6c4, user_id=aad76b56775442b39f520050248f6f03, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.308893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.309439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9814c0-c771-4014-a314-724f7d4033fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.314213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.314803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.315073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.315342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.315970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.317575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.318902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.324389 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 634/1264] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:32 2022] PUT /identity/v3/projects/3186583a0e8b4896951188873665b6c4/users/aad76b56775442b39f520050248f6f03/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:32.326179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.332866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 631/1265] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.333833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.343732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494431f2-23c4-426c-8a56-9d13a29d6d81 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.399826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2da33-27fe-456c-8f89-0ba91548e273 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.405381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.405992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.406273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.406544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.407180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.407620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.408239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.408618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.408889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.409124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.409571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.411127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.424081 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 632/1266] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.424081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.431163 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 635/1267] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:32.432223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d837-79bc-40ea-840b-b7d210bd025e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.432880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.436957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.437686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.437958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.438222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.438975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.440546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.442592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0b23e-8614-4e0b-b05a-f23777eb060e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.448316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.448966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.449274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.449540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] PATH_INFO: `/v3/projects/187142db0e8645c6a31350392a6b5d33/users/8820c273919741fa8a16b0486dabb283/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.451721 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 633/1268] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.452320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.455826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.462180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f51c43-cc11-4e91-8146-5d706d9bdec3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.467136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.467735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.468062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.468289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.468930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.470590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.471101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187142db0e8645c6a31350392a6b5d33, user_id=8820c273919741fa8a16b0486dabb283, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.473729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.481721 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 634/1269] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.482578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.490150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 636/1270] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:32 2022] PUT /identity/v3/projects/187142db0e8645c6a31350392a6b5d33/users/8820c273919741fa8a16b0486dabb283/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:32.492724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ddfd5-1045-4d41-aab4-19ca530ef022 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.497906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.552878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.553640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.553867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.554130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] PATH_INFO: `/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c/users/636c5971cdaa45148670fbc55415a290/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.563719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e09ae-8d4c-4df7-82a5-6ab85625bf59 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.568373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.569049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.569325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.569589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] PATH_INFO: `/v3/projects/1dcb9023ecb24b37b0473fda93a98753/users/e461c8b3309147d8b63c734508763dea/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.569871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdd9e6a66be4085b1e55398dc9ed56c, user_id=636c5971cdaa45148670fbc55415a290, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.572549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dab3c-6766-4efe-a9fe-f19b185f9c3d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.585046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcb9023ecb24b37b0473fda93a98753, user_id=e461c8b3309147d8b63c734508763dea, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.585890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 635/1271] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:32 2022] PUT /identity/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c/users/636c5971cdaa45148670fbc55415a290/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:32.588054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.590557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.590762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.591045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.602786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 637/1272] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:32 2022] PUT /identity/v3/projects/1dcb9023ecb24b37b0473fda93a98753/users/e461c8b3309147d8b63c734508763dea/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:32.604236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.623526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] MFA Rules not processed for user `aad76b56775442b39f520050248f6f03`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:32.624953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:32.669401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.672568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeface17-6cf8-4c4b-8dbc-291f8e50b38c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.677507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.678164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.678434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.678699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] PATH_INFO: `/v3/projects/06acce18eb064040a95fb5c282c07109/users/2afa642202234799a50a8460a3b6d36c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.693634 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 636/1273] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:32.694465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.695515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=06acce18eb064040a95fb5c282c07109, user_id=2afa642202234799a50a8460a3b6d36c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.698274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.706497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d60fe-620c-4a59-a4f2-549f9f5b5369 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.711658 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 638/1274] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:32 2022] PUT /identity/v3/projects/06acce18eb064040a95fb5c282c07109/users/2afa642202234799a50a8460a3b6d36c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:32.712461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.764328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.764947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.765190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:32.765345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.765583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.766213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.767829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.778238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcb6c6-f7eb-4bbf-98c3-fe35a5c70fae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.781841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 637/1275] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.781841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.782970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.783584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.783862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.784133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.784777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.786487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f784d-0b97-4c39-a042-f768f953b4b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.789109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fcb30-3e71-4af8-a6f5-31107086b347 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.794691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.795268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.795544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.796008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.796643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.797519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 639/1276] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.798320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.798734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.798999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.799274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.810519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 638/1277] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.811652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.821144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bbd3a-6804-4bd9-80ca-d8e44b8b9e50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.825724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.826330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.826592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.826862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.827481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.829074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cd5b4-7301-4381-99cc-88c7531af2c1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:32.829493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] MFA Rules not processed for user `8820c273919741fa8a16b0486dabb283`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:32.830706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:32.839279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 639/1278] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:32.840535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173da3e-87b1-4ce6-842a-c481e3fe5767 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.840811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173da3e-87b1-4ce6-842a-c481e3fe5767 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.841102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173da3e-87b1-4ce6-842a-c481e3fe5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.869816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0173da3e-87b1-4ce6-842a-c481e3fe5767 None None] MFA Rules not processed for user `e461c8b3309147d8b63c734508763dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:32.871011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0173da3e-87b1-4ce6-842a-c481e3fe5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:32.902615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 640/1279] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:32.903459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.936521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 640/1280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:32.941418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.941702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.941979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.960767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:32.961955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c26b-5dda-4c95-a201-cd4c4dd90199 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.962081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:32.966099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.966695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.966966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.967229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.970628 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 641/1281] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:32.971403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:32.981752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df757a4e-b541-4915-a27d-3ad139a01c21 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:32.986438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:32.987033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:32.987303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:32.987568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:32.988202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:32.989827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.003651 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 642/1282] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:33.003651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.026405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1855-d4a0-4f81-ab72-80beeb22722a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.032745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.033752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.034262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.034842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] PATH_INFO: `/v3/projects/0acfb4c9e04743d2a597d1c4ec387266/users/83ef7e6d488c48be89cb71ff6858d444/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.048819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.050409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.053192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acfb4c9e04743d2a597d1c4ec387266, user_id=83ef7e6d488c48be89cb71ff6858d444, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.055905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.059584 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 641/1283] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:33.062171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.074171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae34dea-f583-40ec-9a18-04209a82cbcb service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.077071 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 643/1284] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:33 2022] PUT /identity/v3/projects/0acfb4c9e04743d2a597d1c4ec387266/users/83ef7e6d488c48be89cb71ff6858d444/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:33.078495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.087256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.106580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.138040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.138704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.138983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.139252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] PATH_INFO: `/v3/projects/174f2eeb6cc948ec8e086efad11449a1/users/76287c8ded5f4077bd8c2817b14fb03f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.152818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa72f-599d-4002-8553-7dddeef85fd7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.156620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174f2eeb6cc948ec8e086efad11449a1, user_id=76287c8ded5f4077bd8c2817b14fb03f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.157806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.158606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.158887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.159175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] PATH_INFO: `/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c/users/636c5971cdaa45148670fbc55415a290/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.159967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.161073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbdd9e6a66be4085b1e55398dc9ed56c, user_id=636c5971cdaa45148670fbc55415a290, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.163678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.184409 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 644/1285] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:33 2022] PUT /identity/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c/users/636c5971cdaa45148670fbc55415a290/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:33.184631 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 642/1286] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:33 2022] PUT /identity/v3/projects/174f2eeb6cc948ec8e086efad11449a1/users/76287c8ded5f4077bd8c2817b14fb03f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:33.184722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.184810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.254331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155ac84-700b-4f6d-a36b-68b793e0b547 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.254937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b027bf-ad6d-46ed-a77b-7bfd63c1aede admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.259100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.259803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.260029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.260155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.260531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.260839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.261192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.261306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.261558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.262252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.263091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.264573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.297643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 643/1287] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:33.297643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.300593 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 645/1288] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:33.301426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.360947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de462625-eb05-428c-ae46-6bd4bb58949b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.378748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6447d-7e45-4e4b-baf6-e4f3e15e74aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.384048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.385443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.385762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.386445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] PATH_INFO: `/v3/projects/35bcd64af5b44a13bc5a13c8898363f3/users/88fcdce2833843d5b267c355dd1387a4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.404482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bcd64af5b44a13bc5a13c8898363f3, user_id=88fcdce2833843d5b267c355dd1387a4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.407151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2bfce-6822-4da8-9243-e3dd89c9ec09 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.414707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.415421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.415696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.415993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.421088 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 646/1289] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:33 2022] PUT /identity/v3/projects/35bcd64af5b44a13bc5a13c8898363f3/users/88fcdce2833843d5b267c355dd1387a4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:33.422714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f0ad-0923-4a92-8a0a-dbd2f828990d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.423546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f0ad-0923-4a92-8a0a-dbd2f828990d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.423917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8f0ad-0923-4a92-8a0a-dbd2f828990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.425357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.426771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c7a8b-5f6d-4f24-8d56-dd7d6975d12a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.431100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.438014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.441175 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 644/1290] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:33.442592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.442883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.443203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.455281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7ee8f0ad-0923-4a92-8a0a-dbd2f828990d None None] MFA Rules not processed for user `83ef7e6d488c48be89cb71ff6858d444`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:33.456575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ee8f0ad-0923-4a92-8a0a-dbd2f828990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.475668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] MFA Rules not processed for user `636c5971cdaa45148670fbc55415a290`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:33.476905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.540508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 647/1291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:33.540508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.540508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.540508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.562652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 645/1292] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:33.563635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.582531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] MFA Rules not processed for user `76287c8ded5f4077bd8c2817b14fb03f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:33.584076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.657466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d946b-a97c-4c35-8c49-3419216a49f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.663626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.664352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.664700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.664970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.665631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.668450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.678147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 648/1293] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:33.678948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.691552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38245b27-b17a-4d84-8733-d0b5a8bf9de5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.698531 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 646/1294] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:33.698531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.699855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.700648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.701056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.701768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.702240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.704631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd029321-72e0-435e-ac41-7fa0b58fdea5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.708929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2636af-9a0e-4de1-a371-606d833fc5be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.714573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.715214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.715489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.715877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] PATH_INFO: `/v3/users/aad76b56775442b39f520050248f6f03` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.717163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad76b56775442b39f520050248f6f03)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.718170 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:00:33.718170 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:00:33.718170 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:00:33.719710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:33.731704 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 649/1295] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:33.732969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a105d4-0a14-4015-ae64-947af267f12a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.733290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a105d4-0a14-4015-ae64-947af267f12a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.733565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a105d4-0a14-4015-ae64-947af267f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.769317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c0a105d4-0a14-4015-ae64-947af267f12a None None] MFA Rules not processed for user `88fcdce2833843d5b267c355dd1387a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:33.770670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0a105d4-0a14-4015-ae64-947af267f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.793949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad76b56775442b39f520050248f6f03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:33.803012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad76b56775442b39f520050248f6f03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:33.804453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad76b56775442b39f520050248f6f03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:33.820225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad76b56775442b39f520050248f6f03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:33.821193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad76b56775442b39f520050248f6f03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:33.831365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.845904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:33.859893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 647/1296] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:33 2022] DELETE /identity/v3/users/aad76b56775442b39f520050248f6f03 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:33.859893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.861655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.863652 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 650/1297] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:33.865257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.865655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.866022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.873791 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 651/1298] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 16:00:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:33.874766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:33.876742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:33.971774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19094c8-5e7e-4bb1-a398-476a5278b3b0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:33.978185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:33.978895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:33.979171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:33.979435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:33.980310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:33.984555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.029297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 652/1299] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.030175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.032684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.079309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598f0f-6f93-4ed6-aaed-dc67dc4e3147 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.109754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc903c-53c2-4980-a3f8-d78a9dbaa21b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.114494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.115091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.115364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.115694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.117045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.117887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.130327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 653/1300] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.131350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.133305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.143958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.144788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.145145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.145412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.146057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.148388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175cc7-7c3f-4565-9e2c-4c2904f73449 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.149071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a042cf-86ad-42c7-9a83-826b9ad77f6c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.154380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.154985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.155263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.155561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.156242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.157866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.171198 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 654/1301] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.172103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.176123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.187418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 648/1302] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:33 2022] POST /identity/v3/projects => generated 381 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.189132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68025-3f6d-44f1-8842-e5dc781c84ce None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.189560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68025-3f6d-44f1-8842-e5dc781c84ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.189828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a68025-3f6d-44f1-8842-e5dc781c84ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.196171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3058c-53a9-48b1-9a85-3b4edae7ffb4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.210367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-03a68025-3f6d-44f1-8842-e5dc781c84ce None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:34.211662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03a68025-3f6d-44f1-8842-e5dc781c84ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.278138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.278965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.279556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.279949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.281124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.283451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.299551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 649/1303] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:34.301109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.302194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.302525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.303405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:34.320576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 655/1304] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.321942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.360186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:34.380652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:34.383396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.406711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efa77e-62cb-4c0e-90a1-6f827c7e0906 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.416875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.417535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.417919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.418196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.418826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.423948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.458413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 656/1305] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/users => generated 306 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.459301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.471486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a9a5e-bf90-4fbc-84a2-81554eba59d4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.472288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 650/1306] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:34.477065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.477890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.478241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.479137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] PATH_INFO: `/v3/projects/f74c6ac9c279486581ce5ab68fb589a3/users/3a57004b7ab8434fa8a6516ce5d44ff0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.482883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.497507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0bbf6-3352-4eab-b61f-02644be343f7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.498982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74c6ac9c279486581ce5ab68fb589a3, user_id=3a57004b7ab8434fa8a6516ce5d44ff0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.501989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.502882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.504077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.504077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.504387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] PATH_INFO: `/v3/projects/eedcd670e5b4403081b32b8c79fec62a/users/9b5e11548f6b44a2a202c8ff7d8d5705/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.523023 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 657/1307] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:34 2022] PUT /identity/v3/projects/f74c6ac9c279486581ce5ab68fb589a3/users/3a57004b7ab8434fa8a6516ce5d44ff0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:34.523023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.528544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedcd670e5b4403081b32b8c79fec62a, user_id=9b5e11548f6b44a2a202c8ff7d8d5705, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.531548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.550261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 651/1308] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:34 2022] PUT /identity/v3/projects/eedcd670e5b4403081b32b8c79fec62a/users/9b5e11548f6b44a2a202c8ff7d8d5705/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:34.551913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.613527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8799-33d9-4c63-b2ec-82b7a37b052d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.646316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e215fd-fccd-46b8-acaa-04aa451559dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.653712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.654398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.654675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.654946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.655588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.657544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.686516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 652/1309] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.687899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.690811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.694502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.695801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.696166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.697057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.698332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.702026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.716342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:34.734518 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 658/1310] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:34 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:34.735995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.751845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5e6e2-fa9f-49bd-816b-005f1ac8fb2c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.759483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.761586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.762070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.762429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.763338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.765880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.769827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131989-78ba-4a92-aa32-a35a0d3d2dd5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.775851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.776478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.776810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.777121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.783612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 659/1311] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.783612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.794120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.796812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.812531 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 653/1312] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:34.813811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.821481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:34.829210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e662a5-9b91-4d33-8c74-216fec6c5dd3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.838624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.839393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.839680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.839952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.840828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.842558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.863273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 654/1313] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.863273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.879511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228fe88-dab1-452f-9fe1-484360e4ccbf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.886171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.886845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.887130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.887400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.888050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.890947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fba2f1-3be0-42fd-8e9f-3da193978b59 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.891252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.902451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.902451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.902451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.902451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.903972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:34.918872 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 655/1314] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.920767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.944692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f8290-3aa6-4e38-9746-6a712b3ce5d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:34.953084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:34.953881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:34.954080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:34.954590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:34.955248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:34.957476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:34.985384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 656/1315] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:34.986619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:34.996473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496567-f9a1-40aa-8ecf-a1ddd1a80269 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.001444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.002142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.002414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.002683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.003330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.003751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.004980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.006147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.016733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 657/1316] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:35.017579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.020004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 660/1317] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:35.021220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.031622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af4269-c136-4b08-b30c-fbbf7fe88a90 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.039667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.040335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.040615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.042306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] PATH_INFO: `/v3/projects/b8f13773b92f4486a72ff866f2d03373/users/14a286ff6df64de9a3ec05c669d7abfc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.043555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337f19-b2c0-4faf-88bb-7fa9eb996b89 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.055208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.057620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.057951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.058239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] PATH_INFO: `/v3/projects/f74c6ac9c279486581ce5ab68fb589a3/users/3a57004b7ab8434fa8a6516ce5d44ff0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.064732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74c6ac9c279486581ce5ab68fb589a3, user_id=3a57004b7ab8434fa8a6516ce5d44ff0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.070116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.083326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f13773b92f4486a72ff866f2d03373, user_id=14a286ff6df64de9a3ec05c669d7abfc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.087391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.096278 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 661/1318] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/f74c6ac9c279486581ce5ab68fb589a3/users/3a57004b7ab8434fa8a6516ce5d44ff0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.097649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.113947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 658/1319] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/b8f13773b92f4486a72ff866f2d03373/users/14a286ff6df64de9a3ec05c669d7abfc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.115083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.202782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf1f43-d43f-4ed6-9a67-edc295f873d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.217532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.218270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.218556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.218825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] PATH_INFO: `/v3/projects/a99ba76a8a824d47b17acc86da0bb442/users/e748487c36b44c3eb53ae310fe2ec4d4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.252436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e3d-d2f0-47ad-8e49-a058c889b8aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.264951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99ba76a8a824d47b17acc86da0bb442, user_id=e748487c36b44c3eb53ae310fe2ec4d4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.266161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.267070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.267446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.267865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] PATH_INFO: `/v3/projects/eedcd670e5b4403081b32b8c79fec62a/users/9b5e11548f6b44a2a202c8ff7d8d5705/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.270331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.270658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedcd670e5b4403081b32b8c79fec62a, user_id=9b5e11548f6b44a2a202c8ff7d8d5705, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.279036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e264c92-11ad-4dd9-af8d-d61fa2f6debd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.294811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 659/1320] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/a99ba76a8a824d47b17acc86da0bb442/users/e748487c36b44c3eb53ae310fe2ec4d4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.295789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.297785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.324210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 662/1321] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/eedcd670e5b4403081b32b8c79fec62a/users/9b5e11548f6b44a2a202c8ff7d8d5705/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.325397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.325679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.325943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.392941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] MFA Rules not processed for user `3a57004b7ab8434fa8a6516ce5d44ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:35.395869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:35.408688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa546f-8051-400d-8aab-21d38de23f88 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.466757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:35.556220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 663/1322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:35.557951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.573420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.574837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.575228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.575612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] PATH_INFO: `/v3/projects/3497bbaf33fb49b79a91061b4a705616/users/ef05fd3b89554d36b76fb1ba7aa025aa/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.595501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2767f88-e056-47e4-b53a-d1bf053503a7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.609760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.610591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.611033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.611163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3497bbaf33fb49b79a91061b4a705616, user_id=ef05fd3b89554d36b76fb1ba7aa025aa, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.611619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.612425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.614789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.638711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7341bb5-f248-462f-a69c-9a765c2a4e76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.650924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 664/1323] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:35.655539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.658771 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 660/1324] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/3497bbaf33fb49b79a91061b4a705616/users/ef05fd3b89554d36b76fb1ba7aa025aa/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.660306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.660594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.660866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.696448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dafb-1c0c-4d6f-9874-beab023bc232 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.708633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] MFA Rules not processed for user `9b5e11548f6b44a2a202c8ff7d8d5705`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:35.710314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:35.803150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 661/1325] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:35.803150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.834701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.836337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.837183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.838026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.838925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.840740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.861550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 665/1326] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:35.868892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.884437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0adc3-4360-48f4-8a8b-5ef3da834fae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:35.891218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:35.892809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:35.893381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:35.893886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] PATH_INFO: `/v3/projects/b8f13773b92f4486a72ff866f2d03373/users/14a286ff6df64de9a3ec05c669d7abfc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:35.896836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f13773b92f4486a72ff866f2d03373, user_id=14a286ff6df64de9a3ec05c669d7abfc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:35.901052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:35.914966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 666/1327] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:35 2022] PUT /identity/v3/projects/b8f13773b92f4486a72ff866f2d03373/users/14a286ff6df64de9a3ec05c669d7abfc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:35.915792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:35.965948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e7158-d05f-4128-aecd-9db286d67f82 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.023742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:36.026881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:36.031360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff759-8e76-4763-a2d6-750f83f5c089 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.040622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.041863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.042454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.042766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.043502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:36.045298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:36.061039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 667/1328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:36.061039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:36.064160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.077449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.078069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.078341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.079557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.085476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a09677-6417-45d1-853c-034385780e0b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.094987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.095770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.096047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.096327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] PATH_INFO: `/v3/projects/3186583a0e8b4896951188873665b6c4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.097595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3186583a0e8b4896951188873665b6c4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:36.098811 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:00:36.098811 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:00:36.098811 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:00:36.100397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:36.171628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:36.173742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:36.180143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3186583a0e8b4896951188873665b6c4', 'request_id': 'req-1a80a3e9-89eb-4848-abae-dd86ecf0f551'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:36.189589 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 662/1329] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:36.189909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3186583a0e8b4896951188873665b6c4', 'request_id': 'req-1a80a3e9-89eb-4848-abae-dd86ecf0f551'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:36.190474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:36.205773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58246c80-4703-41a2-8112-fa9f83e7b982 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.210682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3186583a0e8b4896951188873665b6c4', 'request_id': 'req-1a80a3e9-89eb-4848-abae-dd86ecf0f551'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:36.224614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] The token cache is being invalidate because project 3186583a0e8b4896951188873665b6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:36.224896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:36.225780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a80a3e9-89eb-4848-abae-dd86ecf0f551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:36.228950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 668/1330] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:36 2022] DELETE /identity/v3/projects/3186583a0e8b4896951188873665b6c4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:36.231609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e372c6-8e13-4353-b927-a604ff048678 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.231943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e372c6-8e13-4353-b927-a604ff048678 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.232316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e372c6-8e13-4353-b927-a604ff048678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.297462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a8e372c6-8e13-4353-b927-a604ff048678 None None] MFA Rules not processed for user `14a286ff6df64de9a3ec05c669d7abfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.298916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8e372c6-8e13-4353-b927-a604ff048678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.340758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.341565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.344553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.344880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] PATH_INFO: `/v3/projects/a99ba76a8a824d47b17acc86da0bb442/users/e748487c36b44c3eb53ae310fe2ec4d4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.348544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99ba76a8a824d47b17acc86da0bb442, user_id=e748487c36b44c3eb53ae310fe2ec4d4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:36.351662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090678a3-0ddd-4312-a253-97758f11f7f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:36.391337 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 663/1331] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:36 2022] PUT /identity/v3/projects/a99ba76a8a824d47b17acc86da0bb442/users/e748487c36b44c3eb53ae310fe2ec4d4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:36.393125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.393496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.393866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.402598 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 664/1332] 10.222.0.78 () {54 vars in 961 bytes} [Tue Oct 18 16:00:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:36.405556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:36.407346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.475451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 669/1333] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.477137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7587c-f82e-4a13-8508-51bc205d01a1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.477425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7587c-f82e-4a13-8508-51bc205d01a1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.477704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7587c-f82e-4a13-8508-51bc205d01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.568647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-16c7587c-f82e-4a13-8508-51bc205d01a1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.568647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16c7587c-f82e-4a13-8508-51bc205d01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.581592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad7983-5b14-48e3-b5e9-a08764d09fd6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.589255 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 670/1334] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.600018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.600440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33e5b-facb-4a55-86c4-2cf9d1a84483 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.601041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33e5b-facb-4a55-86c4-2cf9d1a84483 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.601323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.601542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33e5b-facb-4a55-86c4-2cf9d1a84483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.601918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.602592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] PATH_INFO: `/v3/projects/3497bbaf33fb49b79a91061b4a705616/users/ef05fd3b89554d36b76fb1ba7aa025aa/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.605564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3497bbaf33fb49b79a91061b4a705616, user_id=ef05fd3b89554d36b76fb1ba7aa025aa, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:36.609284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48beb04a-eeb1-43b7-84b1-30199898109b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:36.613670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:36.633883 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 665/1335] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:36 2022] PUT /identity/v3/projects/3497bbaf33fb49b79a91061b4a705616/users/ef05fd3b89554d36b76fb1ba7aa025aa/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:36.635270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25d9f-6537-4b56-ab1d-91010424c104 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.635549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25d9f-6537-4b56-ab1d-91010424c104 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.635814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d25d9f-6537-4b56-ab1d-91010424c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.667367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61a33e5b-facb-4a55-86c4-2cf9d1a84483 None None] MFA Rules not processed for user `e748487c36b44c3eb53ae310fe2ec4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.668630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61a33e5b-facb-4a55-86c4-2cf9d1a84483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.674688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-84d25d9f-6537-4b56-ab1d-91010424c104 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.676486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84d25d9f-6537-4b56-ab1d-91010424c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.763053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:36.797632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 666/1336] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.798913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.799196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.799514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.816226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 671/1337] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.817986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.818472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.818936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.828969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.831433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.861103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] MFA Rules not processed for user `ef05fd3b89554d36b76fb1ba7aa025aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:36.863665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.915313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 667/1338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.920461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:36.922823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:36.949467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68999-904f-4361-8a09-ffb4cf8efec5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:36.960116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:36.960854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:36.961193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:36.961466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:36.976145 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 672/1339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:36.976906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.006211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca41c5-1f42-4ba9-a1e2-f92573bfba82 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.018400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.018878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.019164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.019433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.025698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:37.044539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.046481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.059889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 668/1340] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:37.072555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.100527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d62f32-5891-4993-8583-4fe479ffa6c0 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.108480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.109521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.109963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.110573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.111372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:37.111990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.113837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.135005 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 669/1341] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:37.139988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.166254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febe56-1aab-4b51-9f90-88d8343a000e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.170646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.172297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.178506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.179356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.179865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.181016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.182608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.184952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.188101 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 673/1342] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:37.191726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:37.239294 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 670/1343] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:37 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:00:37.244850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.270840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebf0a-4743-419f-90da-e94a3e22f2ac service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.284149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.421452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:37.434748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.435499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.435847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.436190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.436908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.439202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.455608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b539c-d877-4ed4-8d92-ffbc26bbaea5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.465631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.466591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.468248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.468677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.481509 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 674/1344] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:37 2022] POST /identity/v3/users => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:37.487686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.512655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca181-d367-4162-a15e-dbc6b38c2e32 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.519980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.520702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.521083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.521585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.523460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:37.562547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.564199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.577319 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 671/1345] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:37.578225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.591303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d0a8-fd72-4cdb-a0aa-aca90de3bb1f service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.597422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.598032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.598305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.598570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.599208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.605354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.608030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.614189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.622068 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 675/1346] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:37.637663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 672/1347] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:37.639111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.651232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.656465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a46523-e42c-4b0c-b148-f5ad13a72d2d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.670427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14948ba-8488-4cf3-9da6-4016ad7001b2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.676243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.676883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.677652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.677936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.678594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.680542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.683967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.686275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.688296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.688757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] PATH_INFO: `/v3/users/83ef7e6d488c48be89cb71ff6858d444` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.693207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ef7e6d488c48be89cb71ff6858d444)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.700203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.712096 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 676/1348] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:37.717546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.741292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387ac9-1284-40a2-a9eb-0d04bc637a34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.764815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:37.765723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.766011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.766411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] PATH_INFO: `/v3/projects/351470dfeabd4647b5a3ed904652535f/users/e04062574cab47d4bd97e3704b6d272c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.793169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351470dfeabd4647b5a3ed904652535f, user_id=e04062574cab47d4bd97e3704b6d272c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:37.796791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:37.813048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ef7e6d488c48be89cb71ff6858d444'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:37.818660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 677/1349] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:37 2022] PUT /identity/v3/projects/351470dfeabd4647b5a3ed904652535f/users/e04062574cab47d4bd97e3704b6d272c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:00:37.819576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:37.833502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:37.836862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ef7e6d488c48be89cb71ff6858d444'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:37.838406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ef7e6d488c48be89cb71ff6858d444'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:37.848703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:37.852524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ef7e6d488c48be89cb71ff6858d444'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:37.858276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40edacb9-3450-419c-b0ce-5389022f6a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ef7e6d488c48be89cb71ff6858d444'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:37.896379 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 673/1350] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:37 2022] DELETE /identity/v3/users/83ef7e6d488c48be89cb71ff6858d444 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:37.897743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e549-11a3-47a8-bb20-c2f211ecf9a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:37.898025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e549-11a3-47a8-bb20-c2f211ecf9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:37.898293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e549-11a3-47a8-bb20-c2f211ecf9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:37.962145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997251-b37b-48d1-a753-877026508a37 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:37.997793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d862e549-11a3-47a8-bb20-c2f211ecf9a3 None None] MFA Rules not processed for user `e04062574cab47d4bd97e3704b6d272c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:37.999038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d862e549-11a3-47a8-bb20-c2f211ecf9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.041941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:38.051406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.052354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.052734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.054282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] PATH_INFO: `/v3/users/88fcdce2833843d5b267c355dd1387a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.055958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fcdce2833843d5b267c355dd1387a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.059640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.126503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 674/1351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:38.128084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d527-a423-449a-89ec-283a50c3852a None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.128340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d527-a423-449a-89ec-283a50c3852a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.128613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37d527-a423-449a-89ec-283a50c3852a None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.135406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 675/1352] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:38.136708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.137051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.140466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.164133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:38.165224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fcdce2833843d5b267c355dd1387a4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:38.165944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fcdce2833843d5b267c355dd1387a4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:38.166206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.176171 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 676/1353] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:38.177225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.178814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.179903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fcdce2833843d5b267c355dd1387a4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:38.180453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fcdce2833843d5b267c355dd1387a4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:38.199078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f418f091-cdf0-4072-8483-7efe309c7ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fcdce2833843d5b267c355dd1387a4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:38.204719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525d37f-d539-447b-bd93-10b54ce9e696 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.213136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.214357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.214809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.216381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.217346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.219941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.233233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 678/1354] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:37 2022] DELETE /identity/v3/users/88fcdce2833843d5b267c355dd1387a4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:38.234514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143627-0de7-4982-a12e-e80910f3e453 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.234793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143627-0de7-4982-a12e-e80910f3e453 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.235063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e143627-0de7-4982-a12e-e80910f3e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.278326 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 677/1355] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:38 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:38.280352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.285549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8e143627-0de7-4982-a12e-e80910f3e453 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:38.285665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.286476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e143627-0de7-4982-a12e-e80910f3e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.390208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a2535-0f60-45cb-820f-51aaadc7c3f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.394173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.394932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.395376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.395769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.397777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.398592 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 679/1356] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:38.401132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.401517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.401839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.443803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:38.445812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.474701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:38.496663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.499171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.513645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 678/1357] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:38.514754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.517991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.533257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddf722-180f-4f15-b6e8-b1ec852aff0e service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.541256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.542136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.542519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.543522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.544443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.547419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.585654 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 679/1358] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:38 2022] POST /identity/v3/users => generated 307 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:38.588129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.591733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.623743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5c6b-36b3-42c7-96a0-42991a4fde1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.632064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.632896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.633312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.633688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.653528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.655976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.662788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 680/1359] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:38.664837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.670651 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 680/1360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:38.672492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.683020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.687030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9deb4-02c5-44a8-b1b4-f29c83572c65 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.693851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.695858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.696377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.696860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.698015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.701413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.744397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 681/1361] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:38.745615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.748940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:38.769729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:38.778948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb5f05-761a-4e41-a5e0-ca0aa1604645 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.783610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.784483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.785625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.786105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.803845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.806562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.823392 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 682/1362] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:38.825576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.840341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8d8f-0c13-4539-a2cd-b9064a118e06 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:38.847649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:38.848765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:38.849356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:38.849874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] PATH_INFO: `/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc/users/44281e3c9f48493baf5dd9bb02afc211/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:38.892395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dbd2f7c07547fd8edaa5ba700cabcc, user_id=44281e3c9f48493baf5dd9bb02afc211, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:38.896797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:38.916018 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 683/1363] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:38 2022] PUT /identity/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc/users/44281e3c9f48493baf5dd9bb02afc211/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:38.920400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:38.971650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177100ef-9a89-4ccb-b755-1d1d0ddd9844 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.129648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a231d-83ac-4fa4-9262-1a8e1fecc6f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.138404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.139248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.139678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.140080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.141011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:39.143212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:39.148849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.150696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.154382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.154710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.160909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.162892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 684/1364] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:39.167827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:39.196148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015acccd-fdf5-4832-9ff5-c01d31579688 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.213840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.214741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.214845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.215094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] PATH_INFO: `/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc/users/44281e3c9f48493baf5dd9bb02afc211/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.220841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dbd2f7c07547fd8edaa5ba700cabcc, user_id=44281e3c9f48493baf5dd9bb02afc211, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:39.227563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dc3ce-9770-4816-a8b5-a9ec87609af5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:39.256547 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 685/1365] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:39 2022] PUT /identity/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc/users/44281e3c9f48493baf5dd9bb02afc211/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:39.274037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.274037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.274037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.288923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:39.291247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:39.318212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 681/1366] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:39.319596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:39.320744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.329145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] MFA Rules not processed for user `44281e3c9f48493baf5dd9bb02afc211`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:39.331273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.346398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b85c9-0557-4a3c-9c05-3f9609decf67 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.444335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:39.498685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:39.531610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.532346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.532530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.532808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] PATH_INFO: `/v3/users/a1f06f3bd8b54af68897ccb1a3212de4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.534322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f06f3bd8b54af68897ccb1a3212de4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:39.536269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:39.554169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 686/1367] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:39.556589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:39.562826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.655047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275935f-2519-40cf-aa9a-354f7057771a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.658524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f06f3bd8b54af68897ccb1a3212de4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.659267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f06f3bd8b54af68897ccb1a3212de4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.661320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.661675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.662032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.662337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] PATH_INFO: `/v3/projects/0acfb4c9e04743d2a597d1c4ec387266` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.664227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acfb4c9e04743d2a597d1c4ec387266)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:39.667588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:39.672441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f06f3bd8b54af68897ccb1a3212de4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.673288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f06f3bd8b54af68897ccb1a3212de4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.683669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f06f3bd8b54af68897ccb1a3212de4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.756536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acfb4c9e04743d2a597d1c4ec387266', 'request_id': 'req-c376a130-ed93-4a6b-aae4-cbe5340ef286'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.766865 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 682/1368] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:39 2022] DELETE /identity/v3/users/a1f06f3bd8b54af68897ccb1a3212de4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:39.767936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:39.768204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acfb4c9e04743d2a597d1c4ec387266', 'request_id': 'req-c376a130-ed93-4a6b-aae4-cbe5340ef286'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.770967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.776379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acfb4c9e04743d2a597d1c4ec387266', 'request_id': 'req-c376a130-ed93-4a6b-aae4-cbe5340ef286'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.811419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] The token cache is being invalidate because project 0acfb4c9e04743d2a597d1c4ec387266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:39.811721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.812438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:39.821249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 687/1369] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:39 2022] DELETE /identity/v3/projects/0acfb4c9e04743d2a597d1c4ec387266 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:39.822896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:39.825648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.895363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340ec2-4d7c-4413-9d60-35a9993e1594 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:39.903871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:39.904935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:39.905296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:39.905739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:39.908917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:39.919900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a130-ed93-4a6b-aae4-cbe5340ef286 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:40.000538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.003077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67347e-0fef-4af4-bf76-cf46e61b4875 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.012054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:40.031040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:40.031597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.032093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.032367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] PATH_INFO: `/v3/projects/35bcd64af5b44a13bc5a13c8898363f3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.033368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 683/1370] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:39 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:40.034941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.035224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.035496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.039411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bcd64af5b44a13bc5a13c8898363f3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.042603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.068436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:40.078938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:40.080722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.101186 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 684/1371] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:40.102511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:40.105544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.121476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b384f-2ec4-4e81-91e9-ca638b7aa972 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:40.148395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bcd64af5b44a13bc5a13c8898363f3', 'request_id': 'req-2965ce94-a620-4258-b8b7-62629ac18634'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.156456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bcd64af5b44a13bc5a13c8898363f3', 'request_id': 'req-2965ce94-a620-4258-b8b7-62629ac18634'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.163395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bcd64af5b44a13bc5a13c8898363f3', 'request_id': 'req-2965ce94-a620-4258-b8b7-62629ac18634'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.178772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] The token cache is being invalidate because project 35bcd64af5b44a13bc5a13c8898363f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:40.179205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.182331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2965ce94-a620-4258-b8b7-62629ac18634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.187284 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 688/1372] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:39 2022] DELETE /identity/v3/projects/35bcd64af5b44a13bc5a13c8898363f3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:40.188810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.189212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.189572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.221131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:40.221860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.222219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.222564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] PATH_INFO: `/v3/users/ef05fd3b89554d36b76fb1ba7aa025aa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.224047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef05fd3b89554d36b76fb1ba7aa025aa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.226231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.230243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] MFA Rules not processed for user `8820c273919741fa8a16b0486dabb283`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:40.233964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.314530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef05fd3b89554d36b76fb1ba7aa025aa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.316479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef05fd3b89554d36b76fb1ba7aa025aa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.345048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef05fd3b89554d36b76fb1ba7aa025aa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.347026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef05fd3b89554d36b76fb1ba7aa025aa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.359446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef05fd3b89554d36b76fb1ba7aa025aa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.374202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 689/1373] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:40.374202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:40.374202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.401935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 685/1374] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:40 2022] DELETE /identity/v3/users/ef05fd3b89554d36b76fb1ba7aa025aa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:40.402731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:40.404109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.503262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93392-3227-49ef-91e7-0d3eb8e7638c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:40.512933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:40.512933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.517291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.517780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.522667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.534131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5425d-f8f0-401f-882a-8640b1c4d797 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:40.558973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:40.620513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:40.646925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.649553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.668225 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 686/1375] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:40.669782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:40.673029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.692359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8612170-2339-4766-91bc-2d2036120c38 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:40.701831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:40.703250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.703530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.703800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] PATH_INFO: `/v3/users/e748487c36b44c3eb53ae310fe2ec4d4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.704977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e748487c36b44c3eb53ae310fe2ec4d4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.707580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.719503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:40.720135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.720411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.720678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.725104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.845972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e748487c36b44c3eb53ae310fe2ec4d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.847144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e748487c36b44c3eb53ae310fe2ec4d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.857676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e748487c36b44c3eb53ae310fe2ec4d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.860133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e748487c36b44c3eb53ae310fe2ec4d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.875793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5efd8489-f418-46ca-9c38-4723a786439a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e748487c36b44c3eb53ae310fe2ec4d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:40.892159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:40.894661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:40.927635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 690/1376] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:40.930249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:40.934843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:40.953246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 687/1377] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:40 2022] DELETE /identity/v3/users/e748487c36b44c3eb53ae310fe2ec4d4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:40.953780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:40.954067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:40.954342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:40.981761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5325c-ca87-405f-be57-4aef1a9d7ede service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:41.035172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] MFA Rules not processed for user `2afa642202234799a50a8460a3b6d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:41.036383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.224705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906f93-56be-4f71-957c-340595b499ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:41.225812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906f93-56be-4f71-957c-340595b499ae service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.226281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906f93-56be-4f71-957c-340595b499ae service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.226722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906f93-56be-4f71-957c-340595b499ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.234518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24906f93-56be-4f71-957c-340595b499ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.258933 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 688/1378] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:41.264473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:41.268672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.372976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:41.404272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24906f93-56be-4f71-957c-340595b499ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:41.407644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24906f93-56be-4f71-957c-340595b499ae service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:41.421811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 691/1379] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:41.423865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906f93-56be-4f71-957c-340595b499ae service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:41.425397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24906f93-56be-4f71-957c-340595b499ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.475770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be500b01-74da-480b-a478-8cbcdefa8411 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:41.479793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:41.486302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:41.487667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.487946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.488662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.492703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:41.495833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:41.606778 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 689/1380] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:41 2022] POST /identity/v3/projects => generated 403 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:41.607850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:41.613456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.633420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906f93-56be-4f71-957c-340595b499ae service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:41.745038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:41.745038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.745038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.745038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] PATH_INFO: `/v3/projects/3497bbaf33fb49b79a91061b4a705616` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.745624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3497bbaf33fb49b79a91061b4a705616)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:41.745624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:41.745778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01592c-395a-43e5-b079-0dbb766fd4ee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:41.745778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:41.745778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.746311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.746311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] PATH_INFO: `/v3/projects/18119767251943a6adb74f84e5259397` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.747574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18119767251943a6adb74f84e5259397)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:41.750098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:41.815950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18119767251943a6adb74f84e5259397', 'request_id': 'req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.824777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18119767251943a6adb74f84e5259397', 'request_id': 'req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.844687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3497bbaf33fb49b79a91061b4a705616', 'request_id': 'req-c0e1184c-0c9a-4994-b228-0c22fa833ae8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.845454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18119767251943a6adb74f84e5259397', 'request_id': 'req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.860452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3497bbaf33fb49b79a91061b4a705616', 'request_id': 'req-c0e1184c-0c9a-4994-b228-0c22fa833ae8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.860605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] The token cache is being invalidate because project 18119767251943a6adb74f84e5259397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:41.860884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.861590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2f55823e-7b80-4a1e-a9ea-7ebd8e99d9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.863246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 690/1381] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:41 2022] DELETE /identity/v3/projects/18119767251943a6adb74f84e5259397 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:41.866312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.866312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.866312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.866627 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 691/1382] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:41.867258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:41.870060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.871512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3497bbaf33fb49b79a91061b4a705616', 'request_id': 'req-c0e1184c-0c9a-4994-b228-0c22fa833ae8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.895577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] The token cache is being invalidate because project 3497bbaf33fb49b79a91061b4a705616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:41.896144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.896655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:41.906651 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 692/1383] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:41 2022] DELETE /identity/v3/projects/3497bbaf33fb49b79a91061b4a705616 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:41.906651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:41.908139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:41.954336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:41.970463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:41.989708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1184c-0c9a-4994-b228-0c22fa833ae8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:41.995082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:41.995869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:41.996363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:41.996639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] PATH_INFO: `/v3/projects/a99ba76a8a824d47b17acc86da0bb442` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:41.998503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99ba76a8a824d47b17acc86da0bb442)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.000944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.002707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41efb0-8d11-49e9-934e-0df7a8b576f8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.007516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.008107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.008462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.008735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.010028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.012708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.049173 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 692/1384] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:41 2022] POST /identity/v3/users => generated 308 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:42.050081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.052241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.068720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99ba76a8a824d47b17acc86da0bb442', 'request_id': 'req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.072664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf30d8-6c99-45d9-ad3b-f67b87bd17a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.093764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99ba76a8a824d47b17acc86da0bb442', 'request_id': 'req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.108863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99ba76a8a824d47b17acc86da0bb442', 'request_id': 'req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.125279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] The token cache is being invalidate because project a99ba76a8a824d47b17acc86da0bb442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:42.125574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.126288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.128286 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 693/1385] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:41 2022] DELETE /identity/v3/projects/a99ba76a8a824d47b17acc86da0bb442 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:42.128934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.130282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.141686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.143090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.143502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.143909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] PATH_INFO: `/v3/users/e04062574cab47d4bd97e3704b6d272c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.146611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04062574cab47d4bd97e3704b6d272c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.148693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.207533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6ba5b-5910-417d-a00e-5b43abd1e9c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.212257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.213747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.214198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.214488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] PATH_INFO: `/v3/users/636c5971cdaa45148670fbc55415a290` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.216848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636c5971cdaa45148670fbc55415a290)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.222170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.232142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04062574cab47d4bd97e3704b6d272c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.233438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04062574cab47d4bd97e3704b6d272c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.245488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04062574cab47d4bd97e3704b6d272c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.246516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04062574cab47d4bd97e3704b6d272c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.256576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09429d6-50e8-4b75-a21a-1649778016ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04062574cab47d4bd97e3704b6d272c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.283324 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 693/1386] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:42 2022] DELETE /identity/v3/users/e04062574cab47d4bd97e3704b6d272c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:42.284591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.284878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.285200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.289127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636c5971cdaa45148670fbc55415a290'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.298231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636c5971cdaa45148670fbc55415a290'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.299030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636c5971cdaa45148670fbc55415a290'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.307332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636c5971cdaa45148670fbc55415a290'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.308478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec0490a9-397b-4504-beb9-9a15980f6941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636c5971cdaa45148670fbc55415a290'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.309721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.311404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.329153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 694/1387] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:42 2022] DELETE /identity/v3/users/636c5971cdaa45148670fbc55415a290 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:42.333886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c402-3aff-42bd-9fee-8628ad911f5e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.334167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c402-3aff-42bd-9fee-8628ad911f5e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.334436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c402-3aff-42bd-9fee-8628ad911f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.344591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:42.367624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5728c402-3aff-42bd-9fee-8628ad911f5e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.369218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5728c402-3aff-42bd-9fee-8628ad911f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.370651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:42.411967 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 694/1388] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.414219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.416119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.456919 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 695/1389] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.458708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.459180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.459579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.498566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.500479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.511586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 696/1390] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.512660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.514212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.532806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7db373-6bc9-49dc-8141-e188c3a3b7cd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.540239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.540371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb1419-06ba-4ea6-9a3b-b06200f3b5c2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.541734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.542075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.542409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] PATH_INFO: `/v3/users/e461c8b3309147d8b63c734508763dea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.543690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e461c8b3309147d8b63c734508763dea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.546128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.551757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.552496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.552646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.552913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.553587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.555170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5b9e-2d2e-42de-84ff-492aa4687915 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.576265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 695/1391] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:42.581934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.582238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.582677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.610593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.612435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.624667 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 696/1392] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.625567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.626906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.633102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e461c8b3309147d8b63c734508763dea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.651893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e461c8b3309147d8b63c734508763dea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.652850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e461c8b3309147d8b63c734508763dea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.663567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e461c8b3309147d8b63c734508763dea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.664428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03f93dfb-58f1-432f-b45f-4f29a7426e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e461c8b3309147d8b63c734508763dea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:42.693117 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 697/1393] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:42 2022] DELETE /identity/v3/users/e461c8b3309147d8b63c734508763dea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:42.694817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbed2f-920f-4590-a23d-a8d791faf2ee None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.695927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbed2f-920f-4590-a23d-a8d791faf2ee None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.696246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbed2f-920f-4590-a23d-a8d791faf2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.722939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fcdbed2f-920f-4590-a23d-a8d791faf2ee None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.724368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcdbed2f-920f-4590-a23d-a8d791faf2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.754741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c05187-1bc8-45fc-ac7a-2253e8f82d03 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.811961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.812707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.813113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.813478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.818719 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 698/1394] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.818866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.818963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.818963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.818963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.849764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:42.857457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.860671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.881648 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 699/1395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:42.889184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.894968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.903857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:42.909932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e77d85-9412-4c35-be62-e599f42d5d04 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:42.917024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:42.917837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.919173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.919614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] PATH_INFO: `/v3/projects/68ecb18282074deea9baeabd0495ae68/users/06effc1273fb4008a44d94a9810fecb1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.921920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.924013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.937698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ecb18282074deea9baeabd0495ae68, user_id=06effc1273fb4008a44d94a9810fecb1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:42.938303 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 697/1396] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:42.939438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:42.940966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957172-a73e-46ca-9df9-e1ae2168fa45 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:42.941327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:42.963429 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 700/1397] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:42 2022] PUT /identity/v3/projects/68ecb18282074deea9baeabd0495ae68/users/06effc1273fb4008a44d94a9810fecb1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:42.965150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:42.965503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:42.965843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:42.991399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:42.992678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.095947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 701/1398] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:43.101894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.104233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.118022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160597-974c-4efc-962e-e15f769ea857 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.125324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.125987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.126261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.126528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] PATH_INFO: `/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.128304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbdd9e6a66be4085b1e55398dc9ed56c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.130674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.192418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b8ce4-f769-4660-a2a6-bf8bcfaa2095 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.213573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbdd9e6a66be4085b1e55398dc9ed56c', 'request_id': 'req-97e443d8-a738-4e6f-8596-e7c8e794fb23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:43.222823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbdd9e6a66be4085b1e55398dc9ed56c', 'request_id': 'req-97e443d8-a738-4e6f-8596-e7c8e794fb23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:43.231365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbdd9e6a66be4085b1e55398dc9ed56c', 'request_id': 'req-97e443d8-a738-4e6f-8596-e7c8e794fb23'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:43.252148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] The token cache is being invalidate because project cbdd9e6a66be4085b1e55398dc9ed56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:43.253295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:43.254373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:43.265356 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 702/1399] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:43 2022] DELETE /identity/v3/projects/cbdd9e6a66be4085b1e55398dc9ed56c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:43.267673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.271310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.339241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.339994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.340436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.340838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.349803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.376764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e443d8-a738-4e6f-8596-e7c8e794fb23 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.383398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.384193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.384642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.384917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.385696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:43.386292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.391921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.392968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:43.410733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 703/1400] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:43.412637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.415173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.431154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282675b3-65d7-4561-a488-0f4379c5d0a1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.436337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.437275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.437661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.438021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.438777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:43.439861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.441719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.443055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.445567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.461716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 704/1401] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:43.461904 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 698/1402] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:43.461991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.462069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.462158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.463194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.479766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34611b8a-f881-4acb-abfc-9002e7de7bed admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.480233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af43c0-cc6a-4109-a30f-d67371f594f8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.484931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.485521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.485664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.485838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.486108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.486489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.486932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.487295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.488047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.488325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.489871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af542d-7a6c-4ffb-a870-ddbbd22d1254 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.506839 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 705/1403] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:43.507004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.507092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.507092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.507092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.507305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.515128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:43.523180 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 699/1404] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:43.524411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.533398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:43.535112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.537227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2a4f-521d-4610-bc83-44343bda79b4 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.553600 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 706/1405] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:43.553600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.553887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.553887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.553887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.553887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.554586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.557918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.573359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ea66-6f6c-4e83-a3ba-8df0ae090ce6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.591817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.594060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.596907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.597285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.598146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.600280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c211d7-bc62-4aa4-bc5d-d31f6f8b6b3b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.608559 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 700/1406] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:43.609793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.669731 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 707/1407] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:43.669731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.669731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.669731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.699536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:43.701333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:43.792208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db8083-6d21-4e4a-b3bf-cb42735a206a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.817998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 708/1408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:43.818845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.838727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf309fb0-dc27-4f3b-8843-ca6756fae27c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.853898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.854742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.855058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.855528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.856441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.858420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.890440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:43.892013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:43.892474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:43.893189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] PATH_INFO: `/v3/projects/68ecb18282074deea9baeabd0495ae68/users/06effc1273fb4008a44d94a9810fecb1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:43.897243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ecb18282074deea9baeabd0495ae68, user_id=06effc1273fb4008a44d94a9810fecb1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:43.900541 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 709/1409] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/users => generated 295 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:43.901424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:43.906687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:43.922118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952c5d9-af2c-41f6-9ba4-bd39f0bbb750 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:43.938098 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 701/1410] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:43 2022] PUT /identity/v3/projects/68ecb18282074deea9baeabd0495ae68/users/06effc1273fb4008a44d94a9810fecb1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:43.938098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.070790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.071521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.072492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.072492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.073265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.075704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42d84-8895-49fe-9eee-139f52fb93db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.100838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72440a-9d4a-4f91-8735-a872a561b687 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.116122 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 710/1411] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:43 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:44.117820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48d3b-2a06-4a8b-910d-30ea8466fc08 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.118154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48d3b-2a06-4a8b-910d-30ea8466fc08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.118436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a48d3b-2a06-4a8b-910d-30ea8466fc08 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.121117 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 711/1412] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:44.121890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a48d3b-2a06-4a8b-910d-30ea8466fc08 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.122973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.123721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.124092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.124457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.125764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:44.126204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.128169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.142259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a48d3b-2a06-4a8b-910d-30ea8466fc08 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.149672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.151522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.155289 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 702/1413] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:44.155289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.155289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.157459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.158042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.161507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.165248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.181489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 712/1414] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:44.182920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.184925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:44.187151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.201706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:44.215875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867058a-b540-4ba5-9c7e-4c011794d2b4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.227086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.229142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.231389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.232191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] PATH_INFO: `/v3/projects/1dcb9023ecb24b37b0473fda93a98753` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.234404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcb9023ecb24b37b0473fda93a98753)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.238535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.312310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2e14d-8674-4587-849a-0c99d20d1a56 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.327453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcb9023ecb24b37b0473fda93a98753', 'request_id': 'req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.335119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcb9023ecb24b37b0473fda93a98753', 'request_id': 'req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.343707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcb9023ecb24b37b0473fda93a98753', 'request_id': 'req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.361842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] The token cache is being invalidate because project 1dcb9023ecb24b37b0473fda93a98753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:44.362689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.363391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.365467 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 713/1415] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:44 2022] DELETE /identity/v3/projects/1dcb9023ecb24b37b0473fda93a98753 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:44.366426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.367946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.415141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.415819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.417916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.418788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.422112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.437703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.439459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b915-d5ea-4219-a5cc-c1f00bc55454 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.452623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 703/1416] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:44.455149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.455435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.455866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.458211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f319785-85a8-4ec0-8bfe-f9c9ac59b52b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.465186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.466075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.466629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.467086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.467927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.469842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.481187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:44.482409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.489145 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 714/1417] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:44.490009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.495368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.513378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5daa-515e-4400-a21f-df2c4398440e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.530828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.532834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.537888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.538424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.539429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.542334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.613305 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 715/1418] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:44 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:44.614422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.616138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.710830 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 704/1419] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:44.712101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.719320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.727171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516351-209d-4874-9634-7c269adb7c86 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.735958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.736654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.737020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.737317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.738420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.740496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.743281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:44.752949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20541f-6665-46a9-8c0f-b8f22c3d79d8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.765250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 716/1420] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:44.765250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.765445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.766118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.766391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.766550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.766861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] PATH_INFO: `/v3/projects/351470dfeabd4647b5a3ed904652535f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.771766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=351470dfeabd4647b5a3ed904652535f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.774292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.784906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8107cf-976c-4949-bfa7-adcd55573826 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:44.792385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:44.793186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:44.793698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:44.794737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] PATH_INFO: `/v3/users/3a57004b7ab8434fa8a6516ce5d44ff0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:44.796036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a57004b7ab8434fa8a6516ce5d44ff0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:44.798942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:44.854317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:44.876342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a57004b7ab8434fa8a6516ce5d44ff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.877112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351470dfeabd4647b5a3ed904652535f', 'request_id': 'req-fe5640b5-7d35-4847-b5a5-1f376b70aedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.889584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a57004b7ab8434fa8a6516ce5d44ff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.891546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a57004b7ab8434fa8a6516ce5d44ff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.901457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351470dfeabd4647b5a3ed904652535f', 'request_id': 'req-fe5640b5-7d35-4847-b5a5-1f376b70aedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.906522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a57004b7ab8434fa8a6516ce5d44ff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.907398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a57004b7ab8434fa8a6516ce5d44ff0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.926066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351470dfeabd4647b5a3ed904652535f', 'request_id': 'req-fe5640b5-7d35-4847-b5a5-1f376b70aedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.942741 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 717/1421] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:44 2022] DELETE /identity/v3/users/3a57004b7ab8434fa8a6516ce5d44ff0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:44.943802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.945317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:44.971435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] The token cache is being invalidate because project 351470dfeabd4647b5a3ed904652535f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:44.971740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.973407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:44.977584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 705/1422] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:44 2022] DELETE /identity/v3/projects/351470dfeabd4647b5a3ed904652535f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:44.980196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:44.984902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.062702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce40b2-9ee6-4258-a141-47d24875e8ee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.074624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.075788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.076614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.077676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.079778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.084368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.103059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 718/1423] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:45.111268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:45.115022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.154566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5640b5-7d35-4847-b5a5-1f376b70aedf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.167204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13730-233d-436e-96bd-556206647020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.168118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13730-233d-436e-96bd-556206647020 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.168578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13730-233d-436e-96bd-556206647020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.168861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de13730-233d-436e-96bd-556206647020 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.169570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13730-233d-436e-96bd-556206647020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.172393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de13730-233d-436e-96bd-556206647020 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.224117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed70be3-d12b-4b5e-8c28-67582ce46d87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.232198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.232949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.233367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.233834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.236077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.260162 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 706/1424] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:44 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:45.261480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13730-233d-436e-96bd-556206647020 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:45.267492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6de13730-233d-436e-96bd-556206647020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.275144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:45.295356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de13730-233d-436e-96bd-556206647020 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.323746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.325817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.327457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.327884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] PATH_INFO: `/v3/projects/db104ba093c34a81b677c769995db538/users/f01c86c8f32c4035a71dd59fc55eccdc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.365460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db104ba093c34a81b677c769995db538, user_id=f01c86c8f32c4035a71dd59fc55eccdc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.372242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.404887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 707/1425] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:45 2022] PUT /identity/v3/projects/db104ba093c34a81b677c769995db538/users/f01c86c8f32c4035a71dd59fc55eccdc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:45.404887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:45.408040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.421394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.423050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.442313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 719/1426] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:45.443345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:45.445454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.461161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528a48-2176-43ac-8055-f33b6ac24e98 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.543557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977ba1c-b2b5-4036-b19e-7560509e70c7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.551367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.551947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.552222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.552485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] PATH_INFO: `/v3/users/44281e3c9f48493baf5dd9bb02afc211` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.558043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44281e3c9f48493baf5dd9bb02afc211)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.560155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.596748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:45.597539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.597711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.598578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] PATH_INFO: `/v3/projects/d3e0c80c01cc491aa1db6d6a2eff787a/users/092316ddaf1c495da92e72a34fa94c6c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.641542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e0c80c01cc491aa1db6d6a2eff787a, user_id=092316ddaf1c495da92e72a34fa94c6c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:45.645840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:45.651063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:45.672944 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 720/1427] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:45 2022] PUT /identity/v3/projects/d3e0c80c01cc491aa1db6d6a2eff787a/users/092316ddaf1c495da92e72a34fa94c6c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:45.673814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:45.719344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44281e3c9f48493baf5dd9bb02afc211'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:45.721164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44281e3c9f48493baf5dd9bb02afc211'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:45.737857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44281e3c9f48493baf5dd9bb02afc211'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:45.739026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44281e3c9f48493baf5dd9bb02afc211'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:45.748394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-58ba48f5-3207-4391-9930-83e72c73a15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44281e3c9f48493baf5dd9bb02afc211'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:45.788500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 708/1428] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:45 2022] DELETE /identity/v3/users/44281e3c9f48493baf5dd9bb02afc211 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:45.802854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:45.803070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:45.804490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:45.864913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72301c05-c1a3-4c18-b249-661dca705913 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:45.907546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] MFA Rules not processed for user `f01c86c8f32c4035a71dd59fc55eccdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:45.911353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:45.938327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:46.008906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.009649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.009879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.010148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.012540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.014197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7fa6d-f5c7-4c67-8909-4927559da59c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.045344 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 721/1429] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:46.047955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.049348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.049629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.112575 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 709/1430] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:46.113693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.117239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.132101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] MFA Rules not processed for user `092316ddaf1c495da92e72a34fa94c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:46.133748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.145185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f07b1-23a7-4236-ba7e-fdf330f95322 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.162088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.162904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.163178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.163451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] PATH_INFO: `/v3/projects/f74c6ac9c279486581ce5ab68fb589a3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.166416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74c6ac9c279486581ce5ab68fb589a3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.169232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.283702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74c6ac9c279486581ce5ab68fb589a3', 'request_id': 'req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.296252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74c6ac9c279486581ce5ab68fb589a3', 'request_id': 'req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.302837 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 722/1431] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:46.304209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.311321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.311930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74c6ac9c279486581ce5ab68fb589a3', 'request_id': 'req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.331253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9946c-abe7-4883-a28e-ae8bd5936896 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.341388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] The token cache is being invalidate because project f74c6ac9c279486581ce5ab68fb589a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:46.341878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.342794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.346605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 710/1432] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:46 2022] DELETE /identity/v3/projects/f74c6ac9c279486581ce5ab68fb589a3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:46.347792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.354348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.410287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:46.453943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.455260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.455540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.455859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.466352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.475431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.511036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a79c4d-55e9-46a2-b09d-93dfbea1e3bc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.517414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.517888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.518193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.518464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.519160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.520178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 723/1433] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:46.521117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.521225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba364-4205-4745-b9ec-a01edd2a4d8f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.524984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.545566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c1c29-8550-444f-bffc-b2a7d6c000d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.550451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.550959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.551234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.551582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.552128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.554417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.592725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 711/1434] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:46.594551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20098594-5860-4494-993c-88237f806285 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.594857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20098594-5860-4494-993c-88237f806285 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.595358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20098594-5860-4494-993c-88237f806285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.611794 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 724/1435] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:46.611794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.617985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.627037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20098594-5860-4494-993c-88237f806285 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:46.628550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20098594-5860-4494-993c-88237f806285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.689242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:46.721405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a4276-cc47-45f6-a109-4bebeb34026f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.730233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 712/1436] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:46.731484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20098594-5860-4494-993c-88237f806285 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.737724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.738382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.738660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.738930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] PATH_INFO: `/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.741011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20098594-5860-4494-993c-88237f806285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:46.744700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29dbd2f7c07547fd8edaa5ba700cabcc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.746935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.757186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20098594-5860-4494-993c-88237f806285 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:46.768731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:46.769584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:46.770275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:46.771330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] PATH_INFO: `/v3/projects/4281dd9af260409c8efb3f01eae3d49e/users/b8618f022ab44d36a8d8c2e822072c03/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:46.795454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4281dd9af260409c8efb3f01eae3d49e, user_id=b8618f022ab44d36a8d8c2e822072c03, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:46.799425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:46.825587 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 713/1437] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:46 2022] PUT /identity/v3/projects/4281dd9af260409c8efb3f01eae3d49e/users/b8618f022ab44d36a8d8c2e822072c03/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:46.827563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.838161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29dbd2f7c07547fd8edaa5ba700cabcc', 'request_id': 'req-6862a62f-a9ae-46d2-855d-ef0a86829894'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.861027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29dbd2f7c07547fd8edaa5ba700cabcc', 'request_id': 'req-6862a62f-a9ae-46d2-855d-ef0a86829894'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.880341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29dbd2f7c07547fd8edaa5ba700cabcc', 'request_id': 'req-6862a62f-a9ae-46d2-855d-ef0a86829894'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.917879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] The token cache is being invalidate because project 29dbd2f7c07547fd8edaa5ba700cabcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:46.918446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.920039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:46.923442 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 725/1438] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:46 2022] DELETE /identity/v3/projects/29dbd2f7c07547fd8edaa5ba700cabcc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:46.924645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:46.930874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.006870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797b2c7-f802-4b75-adcb-2d4a637168db admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.021949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.022751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.023184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.023650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.024852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.029718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42738aa-f51e-45be-9c34-49b01474829c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.109341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 714/1439] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/users => generated 300 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:47.110968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c0e14-91f9-46a7-b059-3dd7a122e535 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.111248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c0e14-91f9-46a7-b059-3dd7a122e535 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.111544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c0e14-91f9-46a7-b059-3dd7a122e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.142214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c62c0e14-91f9-46a7-b059-3dd7a122e535 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:47.145234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a62f-a9ae-46d2-855d-ef0a86829894 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.151737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c62c0e14-91f9-46a7-b059-3dd7a122e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.163638 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 715/1440] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:47.166657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.167148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.167607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.168566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.169258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.169581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.169852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.171115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.174565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ecb1-ee42-41c3-9a17-f73615177fe8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.177518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:47.240230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] MFA Rules not processed for user `b8618f022ab44d36a8d8c2e822072c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:47.249522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.259740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 726/1441] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:46 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:47.263589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.263904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.264174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.316516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:47.321271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.350135 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 727/1442] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:47.351271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.352702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.375054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b59b3-f6aa-46f5-bf8e-b683877fa29e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.400882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.400882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.400882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.400882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.401801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.401801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.406873 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 716/1443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:47.407923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.418464 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 728/1444] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:47.419914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.428366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04d35f-06ef-45a8-bd66-7c84cba0797e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.434285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846eafe-71b9-41af-a84a-156806dcaa40 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.435559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.436293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.436688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.437094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.437860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:47.438311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.439190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.440175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113ef38-4dcd-4ad1-8ef1-b503c868ce49 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.440515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.440858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.441257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.442619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.444877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.456624 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 717/1445] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:47.458666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.459088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.460313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.460431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 729/1446] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:47.460762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.466190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.484889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:47.485430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c447-601d-482c-b719-4f9c9d9bf080 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.486378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:47.491850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.493019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.493352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.493893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.494863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.498381 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 718/1447] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:47.498381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.498566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.508256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cab5e5-344a-4e90-9673-c43cea994fd2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.513034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.513754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.514038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.514308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] PATH_INFO: `/v3/projects/4786529b79604001b63927fa21b25908/users/35cd83eb603e464fbb8a54ea8e7562cc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.528679 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 730/1448] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:47.529739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.533630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4786529b79604001b63927fa21b25908, user_id=35cd83eb603e464fbb8a54ea8e7562cc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.536526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.542988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:47.559056 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 719/1449] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:47 2022] PUT /identity/v3/projects/4786529b79604001b63927fa21b25908/users/35cd83eb603e464fbb8a54ea8e7562cc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:47.559056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.613068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ca7f-98b7-4622-a64c-0297a323cc96 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.675748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53badb-5a76-47d4-aa8e-d194334e754f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.680787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.682518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.682972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.683547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] PATH_INFO: `/v3/projects/f487f8d07f87473582e45342fdfcf055/users/a73c0c5ebf41418ebf24bbcbcb93bc12/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.687914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.689287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.689672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.690044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.691229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.698025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.703811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f487f8d07f87473582e45342fdfcf055, user_id=a73c0c5ebf41418ebf24bbcbcb93bc12, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.706967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.727059 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 720/1450] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:47 2022] PUT /identity/v3/projects/f487f8d07f87473582e45342fdfcf055/users/a73c0c5ebf41418ebf24bbcbcb93bc12/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:47.727942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.747765 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 731/1451] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/projects => generated 393 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:47.748805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.790905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:47.837924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2033c1-2c9b-4568-bdaf-7baf8a47bc9a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.857885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81210442-f47b-4847-a58d-8d23b5f89b3a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.862899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.863739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.864327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.864697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.865504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.867530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.904348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 732/1452] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:47.904348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.915606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bf73a-cda7-4e70-b968-db399cf79478 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.921819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.923025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.923404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.923777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.924841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.927002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b217552-4f88-46af-8d15-19641503d931 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.937162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.938031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.938452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.938877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.939853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:47.940159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.941808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:47.950348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 733/1453] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:47.952118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.952529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.952920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.965099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 721/1454] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:47.966473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:47.979269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83609d8-c994-47a6-8b07-409ba8dc3bc3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:47.987158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:47.988485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:47.988971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:47.989730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:47.991756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:47.992962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:47.994858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.014209 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 722/1455] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:48.015186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.030305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed75c4c-041e-48bc-b921-64766ceaf4c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.035628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.036325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.036668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.037052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.037918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.040215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.042074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:48.043691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:48.075464 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 723/1456] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:48 2022] POST /identity/v3/users => generated 297 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:48.076160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.090805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac83dbf-a941-43b8-ab57-81fc8d05d24b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.107219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.107842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.108112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.108378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.109216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.110825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.130539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 724/1457] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:48.136290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.147697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf400fc3-762f-422e-8e3c-32b127b6c7f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.157407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 734/1458] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:48.159619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.163847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.164518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.164788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.165076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] PATH_INFO: `/v3/projects/4786529b79604001b63927fa21b25908/users/35cd83eb603e464fbb8a54ea8e7562cc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.185467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4786529b79604001b63927fa21b25908, user_id=35cd83eb603e464fbb8a54ea8e7562cc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.193950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.200466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db540724-7f7f-4d0c-aa43-6b3a885f005d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.224889 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 725/1459] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:48 2022] PUT /identity/v3/projects/4786529b79604001b63927fa21b25908/users/35cd83eb603e464fbb8a54ea8e7562cc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:48.226008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.300607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7ce0-c94f-4f49-bce7-168330f5b4a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.306695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.307687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.308090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.308544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] PATH_INFO: `/v3/projects/f487f8d07f87473582e45342fdfcf055/users/a73c0c5ebf41418ebf24bbcbcb93bc12/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.311073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f487f8d07f87473582e45342fdfcf055, user_id=a73c0c5ebf41418ebf24bbcbcb93bc12, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.314247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.324466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.325129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.325407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.325675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.326469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.328432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.329431 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 726/1460] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:48 2022] PUT /identity/v3/projects/f487f8d07f87473582e45342fdfcf055/users/a73c0c5ebf41418ebf24bbcbcb93bc12/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:48.330735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.368013 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 735/1461] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:48 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:48.369276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.389077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:48.460683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96441cd7-5213-4594-a6cb-cdc35dc4bb52 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.467181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.468264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.468669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.469316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] PATH_INFO: `/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b/users/0dc6b384194d4f908d5144390c025883/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.489323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21eee9fc424166bcf6556cbdb10c2b, user_id=0dc6b384194d4f908d5144390c025883, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.492146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a4554-312a-4d2a-b4b9-2cc4c9bbfbd9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.502466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:48.511817 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 736/1462] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:48 2022] PUT /identity/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b/users/0dc6b384194d4f908d5144390c025883/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:48.518439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b3f-37f6-4cae-9812-897f1e45d04a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.518857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b3f-37f6-4cae-9812-897f1e45d04a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.519379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832b3f-37f6-4cae-9812-897f1e45d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.555281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ac832b3f-37f6-4cae-9812-897f1e45d04a None None] MFA Rules not processed for user `35cd83eb603e464fbb8a54ea8e7562cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:48.557193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac832b3f-37f6-4cae-9812-897f1e45d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:48.582981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f513c8-314f-479c-a6ba-04695518395d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.779680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.780628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.780948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.781204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.781861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.798239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.800107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 737/1463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:48.801258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.801537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.801804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.825762 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 727/1464] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:48.833272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.856353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae040c0f-ce90-4cf2-bc73-aa199c2bbe16 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:48.871192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:48.871828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:48.872102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:48.872367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:48.873037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:48.873948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] MFA Rules not processed for user `a73c0c5ebf41418ebf24bbcbcb93bc12`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:48.875610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:48.880297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:48.922829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 728/1465] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:48 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:48.923704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:48.932568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:49.052040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 738/1466] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:49.052040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.074618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6ffe-0b86-4fe1-a626-b1aca9db67c5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.087289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.090057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.090356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.090671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.092635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.097709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6fd2e-3610-4577-9671-7e7cca395249 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.122039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 739/1467] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:49.123448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.123733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.124001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.166082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f7b2-9f68-45c0-8d3b-dd257b786059 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.177697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.178330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.178601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.178865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.183965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] MFA Rules not processed for user `f01c86c8f32c4035a71dd59fc55eccdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:49.191152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:49.246211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:49.330423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.334264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.350866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 740/1468] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:49.350866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.360218 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 729/1469] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:00:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:49.361182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.367342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:49.377253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0433d0b-4ec2-4482-a8fa-505631534fb2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.385918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa84f4-7f41-4b05-ba5e-b049fe19d0f0 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.387114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.391367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.391969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.392247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.392514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.393194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.394802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.405809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.406286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.406834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.407717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.410702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 730/1470] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:49.412702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.414450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.456368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 741/1471] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:49.458235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01330-b408-47ea-9282-97cc00660b11 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.459851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.472539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.473254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.473515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.473783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.474429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:49.476549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.478599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f58f8-2a51-4b8e-b340-8fbd13490f4a tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.482921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a843a-8441-42f1-b73a-3d9af2956354 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.493481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.494236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.494520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.494792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] PATH_INFO: `/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b/users/0dc6b384194d4f908d5144390c025883/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.500047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21eee9fc424166bcf6556cbdb10c2b, user_id=0dc6b384194d4f908d5144390c025883, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.504105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.508157 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 731/1472] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:49.509808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.509964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.512026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.532735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 742/1473] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:49 2022] PUT /identity/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b/users/0dc6b384194d4f908d5144390c025883/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:49.533697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.538981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:49.622884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:49.624125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:49.737887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 732/1474] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 18 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:49.744461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:49.762579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fbe9-8b22-4fbe-8c7c-601753065ec4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.781614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.782256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.782528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.782797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.785119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:49.954693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28c14-652e-4633-b6ed-66142fdb05c7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:49.978407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:49.979498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:49.979613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.979967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:49.980419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:49.981380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:49.983036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:49.985706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:50.003486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 743/1475] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:50.004373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:50.021960 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 733/1476] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:50.026938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:50.043707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b52b-a3d4-4f46-b66a-20ae6d8c45f9 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:50.073841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:50.074596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.074877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.075151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3/users/049fbb88af0e4d568e51b9561cd68ce3/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.147528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cc40dd8b5648ac9a919227f3ade7d3, user_id=049fbb88af0e4d568e51b9561cd68ce3, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:50.151211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119e9c2-e3a5-4ad0-87c2-58296494f2e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:50.163196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:50.227814 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 744/1477] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:50 2022] PUT /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3/users/049fbb88af0e4d568e51b9561cd68ce3/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:50.236054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.236054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.236054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.293581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15127-be50-4ed4-a27d-818b4e42b121 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:50.325567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] MFA Rules not processed for user `0dc6b384194d4f908d5144390c025883`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:50.326807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:50.453709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:50.454466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.454753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.455025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.455662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:50.456107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:50.457853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:50.523426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 734/1478] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:50 2022] POST /identity/v3/projects => generated 369 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:50.526174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:50.530353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:50.552170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 745/1479] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:50.553154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:50.733756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b41cdd-e38c-44df-9c05-ffd1d5787ff9 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:50.734469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b34059-468f-456a-9a42-87f5162c6be1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:50.743481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:50.746413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.747722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.749621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.771028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:50.772605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94ba80-34ee-433e-8958-e9f40551ec61 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:50.805590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 735/1480] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:50.808098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.808379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.808647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.885309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:50.885959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:50.889369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] MFA Rules not processed for user `049fbb88af0e4d568e51b9561cd68ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:50.890488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:50.892262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:50.892587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] PATH_INFO: `/v3/projects/b64e9a5c2c73424fa01c3e9727c9e274/users/bc3023497ee3438bb259d5a1ea2fb925/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:50.959257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64e9a5c2c73424fa01c3e9727c9e274, user_id=bc3023497ee3438bb259d5a1ea2fb925, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:50.972187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:51.027841 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 746/1481] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:50 2022] PUT /identity/v3/projects/b64e9a5c2c73424fa01c3e9727c9e274/users/bc3023497ee3438bb259d5a1ea2fb925/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:51.030077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:51.141371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:51.219372 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 736/1482] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:51.221567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:51.241557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:51.296362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bcb68-9f2e-4a4c-9c52-d7854340f954 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:51.323903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:51.324733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:51.327496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:51.327861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:51.331689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:51.332054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:51.333995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf84e2-dfce-4ce5-bd7f-062237639645 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:51.370638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:51.382785 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 747/1483] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:51.384935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:51.385247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:51.385519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:51.486204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f37a74-140f-4895-a1d4-32e4b0311195 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:51.528853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] MFA Rules not processed for user `bc3023497ee3438bb259d5a1ea2fb925`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:51.532713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:51.671361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:51.672611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:51.673235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:51.673655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:51.817901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 748/1484] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:51.818874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:51.902093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:51.909691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:51.956409 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 737/1485] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:51.958199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:52.021100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:52.091578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffefaae-0188-480b-a1be-95eab5c8731c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:52.114712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:52.115366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:52.115643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:52.115910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:52.120983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:52.131130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:52.142137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01818e21-e323-46d3-9d53-9b8bba03b222 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:52.157676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:52.159387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:52.160032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:52.160519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:52.161464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:52.163996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:52.258556 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 749/1486] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:51 2022] POST /identity/v3/projects => generated 395 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:52.273752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 738/1487] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:51 2022] POST /identity/v3/projects => generated 391 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:52.273752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:52.275398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:52.493790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b727442-0629-47e6-a81e-379c9a383264 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:52.501503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:52.502398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:52.502854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:52.503359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:52.519873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97c8f-0ba3-48c2-b634-52c106321f1b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:52.564386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:52.565149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:52.565426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:52.565701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:52.619169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:52.671205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:52.676453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:52.738987 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 739/1488] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:52.739982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:52.843507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:52.856270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:52.892638 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 750/1489] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:52.893908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:52.931313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:52.969118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4c869-1cdf-4559-914f-987aa9b476af service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:52.989173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:52.991911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:52.992188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:52.992459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:52.993202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:52.995661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805ccf6-a19c-4643-9f5e-adbccfcd1df4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.049654 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 740/1490] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:52 2022] POST /identity/v3/users => generated 304 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:53.051331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d151-704d-4bfa-95f3-8ff34988429a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.052550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d151-704d-4bfa-95f3-8ff34988429a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.052979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d151-704d-4bfa-95f3-8ff34988429a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.070071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa4d6-e65a-40af-af91-a40c36551e88 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.072040 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 741/1491] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:53 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:53.077317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.077654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.078010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.078448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.078853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.079239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.079884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.084542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.088199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.131617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 751/1492] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:52 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:53.131617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.153996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d065d-18bc-4036-a8e7-529f7bdf2abc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.169399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.170025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.170293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.170573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.171222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.172875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.184451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] MFA Rules not processed for user `06effc1273fb4008a44d94a9810fecb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:53.185731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:53.197508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 752/1493] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:53.199310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:53.221595 n-d-858383-14 devstack@keystone.service[81776]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 18 16:00:53.222176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.249175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af331001-f7ca-4d71-b1eb-4a1d0220cac9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.269717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.271181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.271615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.272767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects/f26f305d7cb646179f07685f8f4dbacd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.277214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:get_project(project_id=f26f305d7cb646179f07685f8f4dbacd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.280273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.294005 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 753/1494] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/projects/f26f305d7cb646179f07685f8f4dbacd => generated 369 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:53.300859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.340875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ba070-57aa-439a-8971-6244c248aba3 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.354859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.355480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.357669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.357959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.361395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.367989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.386116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 742/1495] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:53.387264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.417641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f763697-e13b-46f3-bac4-23a07e5fb653 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.419852 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 754/1496] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:53.422559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.437441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540f38-d4b8-488b-8958-46d0f93bd116 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.442114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.442800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.443080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.443347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.443461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] PATH_INFO: `/v3/projects/9f08b61f8d954d6998b05bbf69699b14/users/508f19b24ec147ce86627a6baea66f32/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.444092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.444515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.444793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] PATH_INFO: `/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c/users/6e9cc69c55ae4b95886a629549038c58/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.468351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1d8fbd9f694d24b94a904756c4c95c, user_id=6e9cc69c55ae4b95886a629549038c58, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.471628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.499868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f08b61f8d954d6998b05bbf69699b14, user_id=508f19b24ec147ce86627a6baea66f32, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.503700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 755/1497] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:53 2022] PUT /identity/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c/users/6e9cc69c55ae4b95886a629549038c58/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:53.508253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.512026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.536944 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 743/1498] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:53 2022] PUT /identity/v3/projects/9f08b61f8d954d6998b05bbf69699b14/users/508f19b24ec147ce86627a6baea66f32/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:53.537959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.640566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:53.675326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1dd5-51c9-48cd-b427-301b4f5bbd54 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.744287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5e8e-033e-4f54-9478-fd260242e3e1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.756801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.757789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.758248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.759343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.766264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:53.836743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.838149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.838647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.839133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.840825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.844588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.866513 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 756/1499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:53.867680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.886657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:53.887180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b9439-2ce8-4760-8050-b3b31eba5e8a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:53.900482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:53.902504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:53.903392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:53.903859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:53.905320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.914778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.971147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 757/1500] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:53.971147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:53.975778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:53.980087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:53.992032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ef1c-91d9-4aa6-9be6-2f4baabe744a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:54.002273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:54.003232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.004730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.005229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] PATH_INFO: `/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c/users/6e9cc69c55ae4b95886a629549038c58/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.010108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1d8fbd9f694d24b94a904756c4c95c, user_id=6e9cc69c55ae4b95886a629549038c58, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:54.013888 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 744/1501] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:53 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:54.014783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:54.015719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4785-70a3-4d97-9470-c3e451e0c779 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:54.030749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cf14c-45fd-4c2d-a295-66987a0905bb service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:54.055716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 758/1502] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:53 2022] PUT /identity/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c/users/6e9cc69c55ae4b95886a629549038c58/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:54.057470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.057754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.058030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.144385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] MFA Rules not processed for user `6e9cc69c55ae4b95886a629549038c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:54.144730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:54.145442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.145717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.145998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] PATH_INFO: `/v3/projects/9f08b61f8d954d6998b05bbf69699b14/users/508f19b24ec147ce86627a6baea66f32/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.153154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:54.155484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f08b61f8d954d6998b05bbf69699b14, user_id=508f19b24ec147ce86627a6baea66f32, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:54.158918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889f953-5227-41a6-9413-2190a813feaa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:54.232130 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 745/1503] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:54 2022] PUT /identity/v3/projects/9f08b61f8d954d6998b05bbf69699b14/users/508f19b24ec147ce86627a6baea66f32/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:54.233709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5072355-ab9a-4355-8853-b0fd8bccef3a None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.233995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5072355-ab9a-4355-8853-b0fd8bccef3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.234344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5072355-ab9a-4355-8853-b0fd8bccef3a None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.237584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 746/1504] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:54.239002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1dbb9-33ff-4ae3-a880-e69026016390 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.239284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1dbb9-33ff-4ae3-a880-e69026016390 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.239603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1dbb9-33ff-4ae3-a880-e69026016390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.307791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a0a1dbb9-33ff-4ae3-a880-e69026016390 None None] MFA Rules not processed for user `508f19b24ec147ce86627a6baea66f32`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:54.308758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0a1dbb9-33ff-4ae3-a880-e69026016390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:54.422690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 759/1505] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:54.424245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:54.459962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 747/1506] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:54.466116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa6e8-73eb-4b81-9cc4-b42b638beb3e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.466497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa6e8-73eb-4b81-9cc4-b42b638beb3e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.466871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fa6e8-73eb-4b81-9cc4-b42b638beb3e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.469604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 748/1507] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:00:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:54.471911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fa6e8-73eb-4b81-9cc4-b42b638beb3e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:54.544445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:54.614908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:54.615134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:54.655547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fa6e8-73eb-4b81-9cc4-b42b638beb3e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:54.666048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:54.666835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.667216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.667875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.669834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:54.674613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bf921-a74e-441d-8b2c-ea0d3e197900 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:54.751510 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 749/1508] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:00:54 2022] POST /identity/v3/projects => generated 395 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:54.755295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.757348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.760145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.810774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:54.815787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:54.841546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a098cb-bac3-4694-958d-96a7b5ac5bf3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:54.979226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:54.980031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:54.980416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:54.981050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects/f26f305d7cb646179f07685f8f4dbacd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:54.984802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:get_project(project_id=f26f305d7cb646179f07685f8f4dbacd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:54.990508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:54.993899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 750/1509] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:00:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:54.995023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.008811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9eb90-2935-420d-93ae-b5f30a1f9e78 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.009019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 760/1510] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:54 2022] GET /identity/v3/projects/f26f305d7cb646179f07685f8f4dbacd => generated 369 bytes in 585 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:55.010826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.026751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.028013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.040977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.040977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.214560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.219530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a898e-d1d7-4dd9-95bb-c3605a0d0dad service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.237921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463401-2e9f-43ff-b575-9e5e3ab797f0 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.249548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 751/1511] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:55.252458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.253349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.253438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.253510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.253735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.253839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.253910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.254576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.256485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.311285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:55.314634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:55.327070 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 761/1512] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:55 2022] POST /identity/v3/users => generated 298 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:55.328005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.344250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc186b-4f52-4476-aa1e-147e2591a7f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.350575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.351486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.351861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.352232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.353076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:55.353390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.355348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.373200 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 762/1513] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:55.374145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.392047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b587c-c2d6-4cae-9bda-7e653c5a627d tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.400788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.401835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.402119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.402392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.409453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:55.414617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.417529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.435496 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 763/1514] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:55.437655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.462294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 752/1515] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:55.463598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.467882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0b10a-d326-43dc-912b-6c10c72b1c52 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.481904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.483168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.483686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.484015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] PATH_INFO: `/v3/users/bc3023497ee3438bb259d5a1ea2fb925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.485321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3023497ee3438bb259d5a1ea2fb925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.485522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ee3cf-bf24-4e0f-bc62-c44069f58a2a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.490902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.501988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.502748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.503032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.503300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.503953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.509842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.515430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:55.539657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 753/1516] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:55.541560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.569346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e9347-4245-4f53-b76d-2e452eb906ad admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.583103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.584921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.585231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.585915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.586568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.589970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.609899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3023497ee3438bb259d5a1ea2fb925'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:55.630148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3023497ee3438bb259d5a1ea2fb925'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:55.633247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3023497ee3438bb259d5a1ea2fb925'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:55.642003 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 754/1517] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:00:55 2022] POST /identity/v3/users => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:00:55.643000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.670173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3023497ee3438bb259d5a1ea2fb925'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:55.674712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3023497ee3438bb259d5a1ea2fb925'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:55.706582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 764/1518] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:55 2022] DELETE /identity/v3/users/bc3023497ee3438bb259d5a1ea2fb925 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:55.707647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.710069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:55.843587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b87b4-fe4a-4049-907c-eea0214c241c tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.900922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d5bf3-6571-4c2d-ae89-aa8dc163fe69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:55.907818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:55.908926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:55.909663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:55.910413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:55.912052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:55.920581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:55.939575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 765/1519] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:00:55.940953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:55.947285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.022152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:56.022816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.023098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.023720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.030177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.131092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104dc50-9e2b-4be2-b222-c79972bab5d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:56.137850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:56.138814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.139310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.140427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.141395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:00:56.142062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:56.143956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04373b19-cfbf-4071-a94e-2d32c8ff31da tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:56.148947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:56.173593 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 766/1520] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:56.175629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104903f-2d64-44af-9143-1227c934815d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.176365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104903f-2d64-44af-9143-1227c934815d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.177021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104903f-2d64-44af-9143-1227c934815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.199099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:56.202080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:56.214802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c104903f-2d64-44af-9143-1227c934815d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:56.217991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c104903f-2d64-44af-9143-1227c934815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.229191 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 755/1521] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:00:56.230089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:56.235251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 767/1522] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:56.258123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1540d-dac2-491b-b125-8394701596fc service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:56.259318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.259613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.259889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.262345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 768/1523] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:56.266925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:56.267727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.268041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.268299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] PATH_INFO: `/v3/projects/d77cdbac5fb64f5cb281b0f497325117/users/d36a88d32a7b421d85ae870f256d4114/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.278918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:56.281225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.304325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77cdbac5fb64f5cb281b0f497325117, user_id=d36a88d32a7b421d85ae870f256d4114, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:56.310471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:56.330799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:56.352216 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 756/1524] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:00:56 2022] PUT /identity/v3/projects/d77cdbac5fb64f5cb281b0f497325117/users/d36a88d32a7b421d85ae870f256d4114/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:56.362155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:56.363786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.493352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42c2c-7bdf-45db-8b77-58c73e0b7ee6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:56.502324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:56.503054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.503350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.504322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.513042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:56.540890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb438dd-4ba0-41a2-ad7b-7119ddccac43 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:56.661911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:56.666598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5eea1-4a2a-42d0-b378-10942edac384 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:56.690115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:56.691154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.693730 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 757/1525] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:56.694287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.694944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects/f26f305d7cb646179f07685f8f4dbacd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.697929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:get_project(project_id=f26f305d7cb646179f07685f8f4dbacd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:56.698274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e70b-e161-47f7-8cfb-633f406ec8fa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:56.698686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e70b-e161-47f7-8cfb-633f406ec8fa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:56.699135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5e70b-e161-47f7-8cfb-633f406ec8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:56.701697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:56.710186 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 769/1526] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:56 2022] GET /identity/v3/projects/f26f305d7cb646179f07685f8f4dbacd => generated 369 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:00:56.776232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-99e5e70b-e161-47f7-8cfb-633f406ec8fa None None] MFA Rules not processed for user `d36a88d32a7b421d85ae870f256d4114`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:56.778518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99e5e70b-e161-47f7-8cfb-633f406ec8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:56.949471 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 758/1527] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:57.275847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:57.278482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:57.540810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2398d3-347d-4f26-bb21-2903f389cdc8 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:57.557573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:57.558269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:57.558546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:57.558816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:57.559573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:57.560015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:57.560673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:57.562160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:57.632965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:57.639908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:57.642237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:57.656360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 759/1528] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Oct 18 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:00:57.711669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:57.726090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8692-3452-4258-ad8f-3888c6a94e0c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:57.737197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:57.739389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:57.739583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:57.739980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:57.762231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:57.771367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e934c2-c955-40d2-bbe0-2499f626ae8c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:57.775538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:57.777194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:57.798548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 760/1529] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:57.845011 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 770/1530] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:57.935480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7cb9b-2915-454d-874a-ec5a07da88ae None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:57.935762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7cb9b-2915-454d-874a-ec5a07da88ae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:57.936034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7cb9b-2915-454d-874a-ec5a07da88ae None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:57.947555 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 761/1531] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:57.957145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:57.976612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.010083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687094f-828d-4333-b77b-1a42f480ed12 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.028390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.029337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.034056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.034666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects/f26f305d7cb646179f07685f8f4dbacd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.038624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:get_project(project_id=f26f305d7cb646179f07685f8f4dbacd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.045503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:58.050320 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 771/1532] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:57 2022] GET /identity/v3/projects/f26f305d7cb646179f07685f8f4dbacd => generated 369 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:58.052669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945c52-b7e8-4abe-b5ac-f0528d8d2344 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.053601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945c52-b7e8-4abe-b5ac-f0528d8d2344 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.054017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945c52-b7e8-4abe-b5ac-f0528d8d2344 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.055830 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 762/1533] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:58.063400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:58.083985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.103621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bb6f-11b3-47ec-8fa2-af5c9a6a4a45 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.113411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.114515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.114654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.114934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.116857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.121315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7fcdf-a1f7-4ba0-824d-2cf2bebfdead tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:58.131945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945c52-b7e8-4abe-b5ac-f0528d8d2344 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.148332 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 772/1534] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:58 2022] GET /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 393 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:58.168581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945c52-b7e8-4abe-b5ac-f0528d8d2344 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.178188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.179721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.179721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.179721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/users/0c9dc767929c497ba108fbe1838376dc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.217632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c9dc767929c497ba108fbe1838376dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.219648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:58.223041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:58.238128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.238414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.238688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.240291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 773/1535] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:58.248353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:58.279904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.300491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1fcb-256a-4118-8b91-8bd8108452c4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.315837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.316879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.317199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.317733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.320536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.329395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:58.337439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9dc767929c497ba108fbe1838376dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.349368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 774/1536] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:58 2022] GET /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 393 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:58.350290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.351379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9dc767929c497ba108fbe1838376dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.358473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:58.380408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9dc767929c497ba108fbe1838376dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.384073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9dc767929c497ba108fbe1838376dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.406036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c180-5c05-4884-9e31-4cf432573483 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.409861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9dc767929c497ba108fbe1838376dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.424127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.424902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.425791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.426066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] PATH_INFO: `/v3/users/b8618f022ab44d36a8d8c2e822072c03` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.428771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8618f022ab44d36a8d8c2e822072c03)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.434998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:58.468719 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 763/1537] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:58 2022] DELETE /identity/v3/users/0c9dc767929c497ba108fbe1838376dc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:58.468719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:58.468719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:58.575812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8618f022ab44d36a8d8c2e822072c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.590297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8618f022ab44d36a8d8c2e822072c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.590964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8618f022ab44d36a8d8c2e822072c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.607246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8618f022ab44d36a8d8c2e822072c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.612543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-850a41ab-f661-4fd4-b689-264160917ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8618f022ab44d36a8d8c2e822072c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:58.669193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 775/1538] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:58 2022] DELETE /identity/v3/users/b8618f022ab44d36a8d8c2e822072c03 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:58.670566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df4d3-8ce0-40d2-8642-314f57d4fba8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.671000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df4d3-8ce0-40d2-8642-314f57d4fba8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.671282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df4d3-8ce0-40d2-8642-314f57d4fba8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.675652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 776/1539] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:00:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:00:58.676857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.677170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.677583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.726889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625d9ed-8e33-4eb9-94b7-8034498589ed tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:58.728891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:00:58.736519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:58.939879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 777/1540] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:00:58.941849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:00:58.943730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:58.952585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:58.969583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73c0c5ebf41418ebf24bbcbcb93bc12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f487f8d07f87473582e45342fdfcf055', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:58.974471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:58.980030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:58.981769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] PATH_INFO: `/v3/projects/f26f305d7cb646179f07685f8f4dbacd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:58.984683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f26f305d7cb646179f07685f8f4dbacd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:58.990848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:59.160241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:59.164481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:59.167384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:59.211447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26f305d7cb646179f07685f8f4dbacd', 'request_id': 'req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.241063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26f305d7cb646179f07685f8f4dbacd', 'request_id': 'req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.259360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26f305d7cb646179f07685f8f4dbacd', 'request_id': 'req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.294829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c7df0-bf37-4641-b9ef-a804ebc51cb2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:59.300641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] The token cache is being invalidate because project f26f305d7cb646179f07685f8f4dbacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:59.301048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.304453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.313289 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 764/1541] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:58 2022] DELETE /identity/v3/projects/f26f305d7cb646179f07685f8f4dbacd => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:59.314172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:59.318664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:59.487570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77a3d-ee9f-4ebf-a820-1b7d0e387c13 tempest-QuotasAdminTestV236-403275969 tempest-QuotasAdminTestV236-403275969-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:59.492640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:59.493725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:59.493927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:59.494120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] PATH_INFO: `/v3/projects/b64e9a5c2c73424fa01c3e9727c9e274` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:59.495828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64e9a5c2c73424fa01c3e9727c9e274)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:59.498300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:59.560195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:59.561497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:59.561957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:59.562236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:59.564343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:59.568243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:59.590181 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 778/1542] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:00:58 2022] GET /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 393 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:00:59.591564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:59.608919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64e9a5c2c73424fa01c3e9727c9e274', 'request_id': 'req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.620510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:59.627331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64e9a5c2c73424fa01c3e9727c9e274', 'request_id': 'req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.640593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64e9a5c2c73424fa01c3e9727c9e274', 'request_id': 'req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.656001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] The token cache is being invalidate because project b64e9a5c2c73424fa01c3e9727c9e274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:00:59.656401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.657210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.660001 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 765/1543] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:00:59 2022] DELETE /identity/v3/projects/b64e9a5c2c73424fa01c3e9727c9e274 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:00:59.666080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:59.668365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:59.732289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:59.743929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e863-9036-4183-8758-4e47082aeb4f tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:59.749902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:00:59.771063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ab569-2bdf-4b6a-89d5-c91ee87ee00b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:00:59.784021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:59.784700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:59.785318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:59.785591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] PATH_INFO: `/v3/users/092316ddaf1c495da92e72a34fa94c6c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:59.786919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092316ddaf1c495da92e72a34fa94c6c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:59.789057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:59.895351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092316ddaf1c495da92e72a34fa94c6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.896189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092316ddaf1c495da92e72a34fa94c6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.917229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:00:59.917368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092316ddaf1c495da92e72a34fa94c6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.918228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:00:59.918693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:00:59.918824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092316ddaf1c495da92e72a34fa94c6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.919371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:00:59.922049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:00:59.959539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:00:59.961880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:00:59.964942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75c052e4-f544-47c1-9692-19936383e346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092316ddaf1c495da92e72a34fa94c6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:00:59.985520 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 779/1544] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:00:59.986538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:00:59.988395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.007794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9607f9-9255-4792-a1b6-91684aa2fd01 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:00.015392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:00.016248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.016616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.017841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] PATH_INFO: `/v3/users/6e9cc69c55ae4b95886a629549038c58` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.019659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9cc69c55ae4b95886a629549038c58)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:00.022579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:00.024833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 766/1545] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:59 2022] DELETE /identity/v3/users/092316ddaf1c495da92e72a34fa94c6c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:00.029402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.029725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.030072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.080266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:00.084316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.114478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9cc69c55ae4b95886a629549038c58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:00.137255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9cc69c55ae4b95886a629549038c58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:00.137255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9cc69c55ae4b95886a629549038c58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:00.152523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9cc69c55ae4b95886a629549038c58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:00.154427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9cc69c55ae4b95886a629549038c58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:00.215398 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 780/1546] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:00:59 2022] DELETE /identity/v3/users/6e9cc69c55ae4b95886a629549038c58 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:00.218311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:00.223059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.280895 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 767/1547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:00.371545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7459c-4708-4fe6-a192-c2177e3d340d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:00.380566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:00.381337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.381620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.384619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:00.386337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.390542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.401329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.444189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:00.533824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73f149-cf70-414a-ac4c-2c9414c2e89d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:00.540262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:00.542165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4679-af6a-4cfa-aae8-cae35a3074a5 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:00.561710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:00.568024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 781/1548] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:00.639355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:00.640160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.640508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.640838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.701812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f8c17-6f16-44cd-9c2b-cf8d7e6a8247 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.703473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f8c17-6f16-44cd-9c2b-cf8d7e6a8247 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.704303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f8c17-6f16-44cd-9c2b-cf8d7e6a8247 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.707651 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 782/1549] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:01:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:00.789066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:00.790685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:00.791044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:00.793082 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 783/1550] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:00.800875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:00.846290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:00.855177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:00.881246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:00.882793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35311241-828c-45ee-a9f9-1a98a976d0c7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:00.925845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 768/1551] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:01.035781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823f95c-da7b-4161-89b3-8b46ee4aa5f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:01.045741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:01.046412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.046697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.046978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.049742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:01.052379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc61bc4-d27a-4bfb-9496-7c1dcf09e3ff tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:01.056691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 784/1552] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:00 2022] GET /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 393 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:01.138898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.138898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.139198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.183697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:01.185300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:01.194518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.194870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.195148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.196935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 785/1553] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:01.207135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 769/1554] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:01.209080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:01.243954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:01.275834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea36a-e097-48e9-86a8-d5832e0d71e0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:01.297657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:01.298047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.298322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.298601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.321985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:01.327097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5480e-3699-42df-9786-7e5326a53720 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:01.337702 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 786/1555] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:01 2022] GET /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 393 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:01.395958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:01.413405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86b013-b952-4138-811d-d96414e4e02d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:01.433755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:01.434440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.434719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.435047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.477435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:01.479544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863f4f-3d88-4b19-84b2-32c0ee35e675 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:01.517501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 770/1556] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:01.891058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.891969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.892264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.959315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] MFA Rules not processed for user `2afa642202234799a50a8460a3b6d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:01.960875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:01.990559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:01.990559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:01.990559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:01.991668 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 771/1557] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:01.999050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:02.034698 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 18 16:01:02.035264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:02.056128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae5528-b773-443c-a7ba-5836069f6497 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:02.061446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '508f19b24ec147ce86627a6baea66f32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f08b61f8d954d6998b05bbf69699b14', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:02.062731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:02.063015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:02.063288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] PATH_INFO: `/v3/projects/d77cdbac5fb64f5cb281b0f497325117` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:02.064467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorizing `identity:get_project(project_id=d77cdbac5fb64f5cb281b0f497325117)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:02.068397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:02.097509 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 772/1558] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:01 2022] GET /identity/v3/projects/d77cdbac5fb64f5cb281b0f497325117 => generated 395 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:02.098493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:02.106297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:02.179292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514f99-351e-4394-829e-e4ad95be3d57 tempest-FlavorsAccessNegativeTestJSON-1111105867 tempest-FlavorsAccessNegativeTestJSON-1111105867-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:02.195410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:02.196881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:02.199407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:02.200612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] PATH_INFO: `/v3/projects/4281dd9af260409c8efb3f01eae3d49e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:02.205909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4281dd9af260409c8efb3f01eae3d49e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:02.210073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:02.262743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 787/1559] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:02.264246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:02.268785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:02.311353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9145494-6db6-40c0-8d53-50a75e7567c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:02.366212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4281dd9af260409c8efb3f01eae3d49e', 'request_id': 'req-024ad4df-952a-4420-a4df-f4b4038c3122'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.382436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4281dd9af260409c8efb3f01eae3d49e', 'request_id': 'req-024ad4df-952a-4420-a4df-f4b4038c3122'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.433919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4281dd9af260409c8efb3f01eae3d49e', 'request_id': 'req-024ad4df-952a-4420-a4df-f4b4038c3122'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.485490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] The token cache is being invalidate because project 4281dd9af260409c8efb3f01eae3d49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:02.487475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.489802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.498771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:02.500941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 773/1560] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:02 2022] DELETE /identity/v3/projects/4281dd9af260409c8efb3f01eae3d49e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:02.504287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:02.507317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:02.521032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:02.522175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:02.522806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:02.523291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] PATH_INFO: `/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:02.525321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1d8fbd9f694d24b94a904756c4c95c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:02.528882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:02.621866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ad4df-952a-4420-a4df-f4b4038c3122 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:02.670083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1d8fbd9f694d24b94a904756c4c95c', 'request_id': 'req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.688318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1d8fbd9f694d24b94a904756c4c95c', 'request_id': 'req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.708472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1d8fbd9f694d24b94a904756c4c95c', 'request_id': 'req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.729436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:02.750517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] The token cache is being invalidate because project fd1d8fbd9f694d24b94a904756c4c95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:02.752426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.758513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:02.768069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 788/1561] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:02 2022] DELETE /identity/v3/projects/fd1d8fbd9f694d24b94a904756c4c95c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:02.771151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:02.777623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:02.865860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:02.866595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:02.866966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:02.867362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] PATH_INFO: `/v3/users/049fbb88af0e4d568e51b9561cd68ce3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:02.874027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049fbb88af0e4d568e51b9561cd68ce3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:02.876561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:02.970383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d62b41-8fcc-40b4-932b-33a53b9f9b6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:02.994925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:02.997712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:02.999239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:02.999699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] PATH_INFO: `/v3/users/0dc6b384194d4f908d5144390c025883` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.006656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc6b384194d4f908d5144390c025883)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:03.017062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:03.027523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049fbb88af0e4d568e51b9561cd68ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.028282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049fbb88af0e4d568e51b9561cd68ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.043495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049fbb88af0e4d568e51b9561cd68ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.044648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049fbb88af0e4d568e51b9561cd68ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.062174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049fbb88af0e4d568e51b9561cd68ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.090220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 774/1562] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:02 2022] DELETE /identity/v3/users/049fbb88af0e4d568e51b9561cd68ce3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:03.091183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:03.093118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.131285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc6b384194d4f908d5144390c025883'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.154856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc6b384194d4f908d5144390c025883'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.155968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc6b384194d4f908d5144390c025883'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.169277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc6b384194d4f908d5144390c025883'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.170445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8172afbe-2769-4514-a865-f8a17824be01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc6b384194d4f908d5144390c025883'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.193216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:03.207665 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 789/1563] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:02 2022] DELETE /identity/v3/users/0dc6b384194d4f908d5144390c025883 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:03.207665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcf2f-d1ae-4b7e-8fb1-117278bb170b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.207665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcf2f-d1ae-4b7e-8fb1-117278bb170b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.207988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdcf2f-d1ae-4b7e-8fb1-117278bb170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.236343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6ecdcf2f-d1ae-4b7e-8fb1-117278bb170b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:03.238444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ecdcf2f-d1ae-4b7e-8fb1-117278bb170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.287490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44339a9d-be6f-4df8-86d2-e0eb5f9b4ce0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:03.317059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 790/1564] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:03.318624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdc49-31f0-446b-bf47-539d79b8ca9e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.318948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdc49-31f0-446b-bf47-539d79b8ca9e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.319222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdc49-31f0-446b-bf47-539d79b8ca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.341568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-189fdc49-31f0-446b-bf47-539d79b8ca9e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:03.342549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-189fdc49-31f0-446b-bf47-539d79b8ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.354581 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 791/1565] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:03.356309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.356585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.356858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.378827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:03.380031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.400927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 792/1566] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:03.402356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:03.413237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ee42-603e-479e-b91e-d24a4e8a63db None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:03.418724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:03.419388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.419657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.420026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.420858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:03.421218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:03.423154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:03.440530 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 793/1567] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:03.441662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:03.441783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:03.455828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b714d36-5d2b-4601-a9b1-5fe65d69aef5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:03.457144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:03.458368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.458699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.458989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] PATH_INFO: `/v3/projects/d3e0c80c01cc491aa1db6d6a2eff787a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.460283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:03.460952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.461465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.462331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.462978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:03.464854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e0c80c01cc491aa1db6d6a2eff787a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:03.464974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:03.467004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:03.504072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 794/1568] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:03 2022] POST /identity/v3/projects => generated 361 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:03.507497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:03.602206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e0c80c01cc491aa1db6d6a2eff787a', 'request_id': 'req-5c0879c5-1c0d-48db-801d-4ad03db7e6de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.620834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e0c80c01cc491aa1db6d6a2eff787a', 'request_id': 'req-5c0879c5-1c0d-48db-801d-4ad03db7e6de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.640138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e0c80c01cc491aa1db6d6a2eff787a', 'request_id': 'req-5c0879c5-1c0d-48db-801d-4ad03db7e6de'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.671185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] The token cache is being invalidate because project d3e0c80c01cc491aa1db6d6a2eff787a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:03.672091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.674585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:03.677032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 775/1569] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:03 2022] DELETE /identity/v3/projects/d3e0c80c01cc491aa1db6d6a2eff787a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:03.678203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:03.681984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.756256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0af0f4-b6ac-45d2-a720-6dc5f2380d05 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:03.850865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0879c5-1c0d-48db-801d-4ad03db7e6de admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:03.855499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:03.856376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.856651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.857169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.861172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:03.948079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:03.948720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:03.949035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:03.949630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:03.954806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:03.956884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:03.993195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:04.035851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 795/1570] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:03 2022] POST /identity/v3/users => generated 281 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:04.035851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.043826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.052878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.056044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.068445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa39ba4-ec3d-4874-ac43-6a6aedf886c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.081029 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 776/1571] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:04.082171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.082345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.082805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.083198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.083365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] PATH_INFO: `/v3/users/a73c0c5ebf41418ebf24bbcbcb93bc12` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.084001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.084895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73c0c5ebf41418ebf24bbcbcb93bc12)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.087305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.108771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36689d-6c08-4b05-aa8c-2c535111017f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.117733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.122001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.122913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.124176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] PATH_INFO: `/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.126615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d21eee9fc424166bcf6556cbdb10c2b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.130644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.179986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73c0c5ebf41418ebf24bbcbcb93bc12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.197682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73c0c5ebf41418ebf24bbcbcb93bc12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.199068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73c0c5ebf41418ebf24bbcbcb93bc12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.223727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73c0c5ebf41418ebf24bbcbcb93bc12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.224922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73c0c5ebf41418ebf24bbcbcb93bc12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.231167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:04.265940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d21eee9fc424166bcf6556cbdb10c2b', 'request_id': 'req-4b33859d-4f25-4dfe-996e-7879b90d5cc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.272334 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 796/1572] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:04 2022] DELETE /identity/v3/users/a73c0c5ebf41418ebf24bbcbcb93bc12 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:04.274236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.277339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.281497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d21eee9fc424166bcf6556cbdb10c2b', 'request_id': 'req-4b33859d-4f25-4dfe-996e-7879b90d5cc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.294402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d21eee9fc424166bcf6556cbdb10c2b', 'request_id': 'req-4b33859d-4f25-4dfe-996e-7879b90d5cc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.316225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] The token cache is being invalidate because project 6d21eee9fc424166bcf6556cbdb10c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:04.316648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.323170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4b33859d-4f25-4dfe-996e-7879b90d5cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:04.329493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 777/1573] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:04 2022] DELETE /identity/v3/projects/6d21eee9fc424166bcf6556cbdb10c2b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:04.333548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e724a-b377-40a8-825d-58df61ba9b95 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.334074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e724a-b377-40a8-825d-58df61ba9b95 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.334524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e724a-b377-40a8-825d-58df61ba9b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.374972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-723e724a-b377-40a8-825d-58df61ba9b95 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:04.376470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-723e724a-b377-40a8-825d-58df61ba9b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.386343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68041a94-1d6e-4ced-ae4d-67d972f5c760 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.394467 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 778/1574] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:04.401431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.401856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.402233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.403563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.404200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.404549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.404985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.405669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.407269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.435490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 797/1575] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:04.439885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.443137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.457797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:04.459777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.476024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 779/1576] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:04.479789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.482212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74b70a-6bce-4e04-a0c9-d44dff2044e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.494266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.497098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.498686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.499724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.500571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.505762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efc1b2-acca-4d5b-8823-a6757ee6685b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.506184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.527929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.528559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.528914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.529123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.529779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:04.530079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.537223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.539099 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 798/1577] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:04.540963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.555178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdb0ec-240a-40e8-9558-6b1804cdefc8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.562005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.562915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.563196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.563547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] PATH_INFO: `/v3/projects/df48e6d3b6f44c90ae47a3c2ce30d977/users/b3c31abeb7044a6fa7f1b6a7ee06b15f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.563909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 780/1578] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:04.568174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.589424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b2d3-da1d-45af-8edd-0b80e3e52f42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.598323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.599234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.599740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.600185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.601089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.604470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.645394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df48e6d3b6f44c90ae47a3c2ce30d977, user_id=b3c31abeb7044a6fa7f1b6a7ee06b15f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.656909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 781/1579] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:04 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:04.658661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.658782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e00916-105c-400b-9a88-6c6f18f2e994 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:04.694876 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 799/1580] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:04 2022] PUT /identity/v3/projects/df48e6d3b6f44c90ae47a3c2ce30d977/users/b3c31abeb7044a6fa7f1b6a7ee06b15f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:04.708492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.708779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.709081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.753934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] MFA Rules not processed for user `b3c31abeb7044a6fa7f1b6a7ee06b15f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:04.755577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.768384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:04.793629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666cf2-ae66-4743-89dc-e620851209a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:04.922435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 800/1581] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:04.923851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:04.928219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:04.968347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:04.972116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:04.972409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:04.974739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:04.975400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:04.984698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.034352 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 782/1582] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:04 2022] POST /identity/v3/users => generated 288 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:05.034352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.046800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c063d23-3cbf-44ef-be35-1cf01e721611 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.051971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.052723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.053147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.053745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.055872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.065730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.077580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:05.092624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc717-a9f0-4cc3-b73a-a08804194115 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.108842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.110521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.110783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.111152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] PATH_INFO: `/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.113283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cc40dd8b5648ac9a919227f3ade7d3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.116654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.122482 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 783/1583] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:05 2022] POST /identity/v3/projects => generated 359 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:05.122482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.126413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.244159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cc40dd8b5648ac9a919227f3ade7d3', 'request_id': 'req-3a5e419f-d12c-453a-83ac-ac587792095b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.260661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cc40dd8b5648ac9a919227f3ade7d3', 'request_id': 'req-3a5e419f-d12c-453a-83ac-ac587792095b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.274516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92425581-f541-41c5-997c-6da405b8dff0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.277192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cc40dd8b5648ac9a919227f3ade7d3', 'request_id': 'req-3a5e419f-d12c-453a-83ac-ac587792095b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.354113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] The token cache is being invalidate because project 23cc40dd8b5648ac9a919227f3ade7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:05.354850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.358415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.368313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 801/1584] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:04 2022] DELETE /identity/v3/projects/23cc40dd8b5648ac9a919227f3ade7d3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:05.373586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.378707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.421889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.423035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.423473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.423749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] PATH_INFO: `/v3/projects/f487f8d07f87473582e45342fdfcf055` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.425174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f487f8d07f87473582e45342fdfcf055)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.428035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.484145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:05.491550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f487f8d07f87473582e45342fdfcf055', 'request_id': 'req-f472f03e-9c1a-4f37-b442-691dce4fb739'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.502830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f487f8d07f87473582e45342fdfcf055', 'request_id': 'req-f472f03e-9c1a-4f37-b442-691dce4fb739'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.518449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f487f8d07f87473582e45342fdfcf055', 'request_id': 'req-f472f03e-9c1a-4f37-b442-691dce4fb739'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.524112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e419f-d12c-453a-83ac-ac587792095b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.545161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] The token cache is being invalidate because project f487f8d07f87473582e45342fdfcf055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:05.547206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.548506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.551536 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 784/1585] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:05 2022] DELETE /identity/v3/projects/f487f8d07f87473582e45342fdfcf055 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:05.552329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.561444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.616023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:05.647828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.648544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.649742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.650370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.651054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.652887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.670148 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 802/1586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:05.670148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.670407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.688573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21863382-1622-42bf-abb5-6243f4e86d85 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.693958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.694660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.694941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.695435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] PATH_INFO: `/v3/users/508f19b24ec147ce86627a6baea66f32` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.696459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] RBAC: Authorizing `identity:delete_user(user_id=508f19b24ec147ce86627a6baea66f32)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.698794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.720344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472f03e-9c1a-4f37-b442-691dce4fb739 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:05.732675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:05.733444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.733752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.734043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.734725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:05.737101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28276bc0-9b9a-4a6d-b362-cd4ec81cc145 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:05.763026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508f19b24ec147ce86627a6baea66f32'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.772538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508f19b24ec147ce86627a6baea66f32'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.773210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508f19b24ec147ce86627a6baea66f32'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.787015 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 785/1587] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:05 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:05.789183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508f19b24ec147ce86627a6baea66f32'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.789397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:05.790699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:05.791414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:05.791575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508f19b24ec147ce86627a6baea66f32'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:05.825268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:05.827876 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 803/1588] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:05 2022] DELETE /identity/v3/users/508f19b24ec147ce86627a6baea66f32 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:05.829422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.830611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.837206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:05.977102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 786/1589] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:05.980384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:05.982942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:06.005679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:06.012213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5639e54-84f0-438d-bd51-5314ce3f005b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.020400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02634e-89c0-4d34-a223-28945c836ecb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.029284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.029948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.030227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.030462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.031142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.032841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b17f87-b3fe-46ff-94c9-8d33d9030924 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.037349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.037981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.038262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.038530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.040577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.042358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.069754 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 804/1590] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:06.071769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.072075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.072343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.081596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 787/1591] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:06.081596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.112195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607768dd-5970-4838-809c-0cb96b46e0da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.133964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.134983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.135273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.135479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] PATH_INFO: `/v3/projects/df5b58d2bc744081ad6e6446e582573e/users/4e59b5b4dea347b6a72e68a987ed92fc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.136155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:06.137598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:06.164022 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 805/1592] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:06.164022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.177911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5b58d2bc744081ad6e6446e582573e, user_id=4e59b5b4dea347b6a72e68a987ed92fc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.181375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.189274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b90998-86c2-4995-b3c7-0b5539bb62b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.201063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.202147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.203877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 788/1593] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:06 2022] PUT /identity/v3/projects/df5b58d2bc744081ad6e6446e582573e/users/4e59b5b4dea347b6a72e68a987ed92fc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:06.204946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.209903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.210499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] PATH_INFO: `/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a/users/8442f792e75240c5ba5bdc1d348d6722/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.286989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93ba70b267e4dd8b4d2e1d0ecb03f4a, user_id=8442f792e75240c5ba5bdc1d348d6722, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.290822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de701-aeca-4d1d-825b-2841768c6b57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.337509 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 806/1594] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:06 2022] PUT /identity/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a/users/8442f792e75240c5ba5bdc1d348d6722/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:06.347422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.347606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.347817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.378139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163eb28-7152-44a0-952c-a93c6874d212 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.403404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:06.474827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.476355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.477949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.478794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.479718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:06.481411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.482431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] MFA Rules not processed for user `4e59b5b4dea347b6a72e68a987ed92fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:06.484543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:06.489426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.520751 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 789/1595] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:06.522228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.546608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3eea0-9d5d-4736-b326-9b18316e9cc3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.557296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.558396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.558878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.559388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.560364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.562989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.592437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 790/1596] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:06.593536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.595759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:06.613846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d005-71a5-4b1b-92ef-b30e825beead admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.621097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.621946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.622272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.622591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] PATH_INFO: `/v3/projects/9f08b61f8d954d6998b05bbf69699b14` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.623857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f08b61f8d954d6998b05bbf69699b14)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:06.626434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:06.841452 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 807/1597] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:06.842321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.851845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f08b61f8d954d6998b05bbf69699b14', 'request_id': 'req-9984fb3b-b498-4e35-8ea8-a5a4d6230674'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:06.869494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02340f-69b4-4f72-a4df-a14d353a8c24 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:06.870297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f08b61f8d954d6998b05bbf69699b14', 'request_id': 'req-9984fb3b-b498-4e35-8ea8-a5a4d6230674'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:06.881025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f08b61f8d954d6998b05bbf69699b14', 'request_id': 'req-9984fb3b-b498-4e35-8ea8-a5a4d6230674'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:06.917430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] The token cache is being invalidate because project 9f08b61f8d954d6998b05bbf69699b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:06.917704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:06.921426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:06.923729 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 791/1598] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:06 2022] DELETE /identity/v3/projects/9f08b61f8d954d6998b05bbf69699b14 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:06.924589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:06.926778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:06.993878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:06.994759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:06.995051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:06.995325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:06.995994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:07.000116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:07.048391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 808/1599] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:06 2022] POST /identity/v3/projects => generated 407 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:07.051054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:07.056426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.067987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984fb3b-b498-4e35-8ea8-a5a4d6230674 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:07.133435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:07.187645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:07.203200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:07.203886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:07.204168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:07.204440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] PATH_INFO: `/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a/users/8442f792e75240c5ba5bdc1d348d6722/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:07.206674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93ba70b267e4dd8b4d2e1d0ecb03f4a, user_id=8442f792e75240c5ba5bdc1d348d6722, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:07.209305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:07.222471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d856f83-7c7e-4d85-bd0f-42d97acc9347 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:07.229907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 792/1600] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:06 2022] PUT /identity/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a/users/8442f792e75240c5ba5bdc1d348d6722/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:07.231103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:07.233583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.334769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:07.335874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:07.337095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:07.338226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:07.340893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:07.344969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:07.397042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed17c-e58e-43b8-a58e-874e538efcb3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:07.405961 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 809/1601] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:07 2022] POST /identity/v3/projects => generated 375 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:07.406907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:07.413032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.545036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c74ea7-8fcf-4d03-a93e-5f0e68015db8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:07.549333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:07.551232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:07.552021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:07.553337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] PATH_INFO: `/v3/users/d36a88d32a7b421d85ae870f256d4114` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:07.553462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:07.554156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:07.554563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:07.554828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:07.556478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:07.557568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36a88d32a7b421d85ae870f256d4114)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:07.559294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1969a-0feb-4b79-8fbd-0d58e3af34a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:07.563228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:07.605511 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 810/1602] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:07 2022] POST /identity/v3/users => generated 304 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:07.607080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:07.609349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:07.609630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:07.679013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] MFA Rules not processed for user `8442f792e75240c5ba5bdc1d348d6722`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:07.680802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.694418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36a88d32a7b421d85ae870f256d4114'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:07.701091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36a88d32a7b421d85ae870f256d4114'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:07.715737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36a88d32a7b421d85ae870f256d4114'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:07.718392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36a88d32a7b421d85ae870f256d4114'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:07.733980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36a88d32a7b421d85ae870f256d4114'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:07.756326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:07.767859 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 793/1603] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:07 2022] DELETE /identity/v3/users/d36a88d32a7b421d85ae870f256d4114 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:07.769448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:07.788919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.807110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:07.850012 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 811/1604] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:07.851261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:07.865301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:07.906017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66eb5-7d62-4f59-b18f-4365ee6d334c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.011365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66f8c-3284-45de-8d16-624834840658 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.027133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.027904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.028379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.028747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.029657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.034059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.056712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.056948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.057247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.057524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.058195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.064462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.091155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 812/1605] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:08.092209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.094045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.099148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 794/1606] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:07 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:08.099148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.116631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf9cc-50c9-419f-89e9-953a8eff7404 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.134109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.134823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.135055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.135252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.136025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.137835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.176239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 795/1607] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:08.178166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.204272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98377f-248e-4382-b0bb-4284e2150df2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.216457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.218511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.220006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.220774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.224058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.227816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.266227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b02e2-6900-4e78-a375-454f09e2936c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.272800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.274462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.274585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.275043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.281762 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 796/1608] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:08.281762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.298528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939684-f817-4756-8674-42c6041817c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.303854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.304523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.304797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.305131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] PATH_INFO: `/v3/projects/f25453a7614d4e82b0f0de8b56523464/users/52abcdb67c2f4801921cb7ee81b02ac5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.325210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25453a7614d4e82b0f0de8b56523464, user_id=52abcdb67c2f4801921cb7ee81b02ac5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.329207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.367740 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 797/1609] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:08 2022] PUT /identity/v3/projects/f25453a7614d4e82b0f0de8b56523464/users/52abcdb67c2f4801921cb7ee81b02ac5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:08.369071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.370743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.438558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.442108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.462145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dd374-607f-437d-a45e-3c4bab997c67 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.467901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.468670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.469091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.469458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] PATH_INFO: `/v3/projects/d77cdbac5fb64f5cb281b0f497325117` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.471356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77cdbac5fb64f5cb281b0f497325117)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.473484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.485927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 813/1610] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:08.489447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.528248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc82b-5957-463c-9970-828b9543d921 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.531878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:08.541789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77cdbac5fb64f5cb281b0f497325117', 'request_id': 'req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:08.544700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:08.555581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77cdbac5fb64f5cb281b0f497325117', 'request_id': 'req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:08.566429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77cdbac5fb64f5cb281b0f497325117', 'request_id': 'req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:08.581716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] The token cache is being invalidate because project d77cdbac5fb64f5cb281b0f497325117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:08.582098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:08.583151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f87ca78-cbc1-4cb6-bdfb-d1087bca5097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:08.585905 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 798/1611] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:08 2022] DELETE /identity/v3/projects/d77cdbac5fb64f5cb281b0f497325117 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:08.587831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ae9f-4c95-4e47-a914-0a5c3fea5d36 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.588381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ae9f-4c95-4e47-a914-0a5c3fea5d36 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.588664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ae9f-4c95-4e47-a914-0a5c3fea5d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.602818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.603623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.603909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.604186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] PATH_INFO: `/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f/users/2b371bc3efc5413ba205fa65f933f49a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.619711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-10c6ae9f-4c95-4e47-a914-0a5c3fea5d36 None None] MFA Rules not processed for user `52abcdb67c2f4801921cb7ee81b02ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:08.620861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-10c6ae9f-4c95-4e47-a914-0a5c3fea5d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.620963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d402f8c6df574847bf609e4ae6d0ed2f, user_id=2b371bc3efc5413ba205fa65f933f49a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.623835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4e7db-24d2-49e9-912e-8e144a15b0cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.639714 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 814/1612] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:08 2022] PUT /identity/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f/users/2b371bc3efc5413ba205fa65f933f49a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:08.641078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.641489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.641825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.668705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:08.671320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.692307 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 799/1613] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:08.693672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.694170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.694536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.719435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:08.721680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.746727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 815/1614] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:08.749785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.752281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.824787 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 800/1615] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:08.825470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.826792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.840617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852538d-b667-4ed4-83e4-ed548894bc2e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.851287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.851851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.852137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.852401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.853267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.855358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bff2d8-48d3-4626-af90-2dc00ca551f4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.858243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4fbec-1c78-499d-a903-27b1b61a9a0a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.863118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.863734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.864011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.864286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.864935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.866882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.878628 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 816/1616] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:08.879801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.881593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.888294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 801/1617] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/projects => generated 407 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:08.889600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.889883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.890154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.895019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114af090-e283-4201-aa16-5dc34ce316b1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:08.910992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:08.912203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:08.952365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:08.952540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:08.965672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:08.966385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:08.966729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:08.967072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:08.975520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:08.977242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:08.984249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 802/1618] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:08.987612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.988244 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 817/1619] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:08.989560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:08.997560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb2f1-f07f-4e64-95b7-62672b85048d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.002486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.003407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.003845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400ad9-7f77-4c61-b8df-f675745ae629 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.003971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.004238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] PATH_INFO: `/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f/users/2b371bc3efc5413ba205fa65f933f49a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.006811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d402f8c6df574847bf609e4ae6d0ed2f, user_id=2b371bc3efc5413ba205fa65f933f49a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.010487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.011051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.011722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.012062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.019735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.021824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.029121 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 803/1620] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:08 2022] PUT /identity/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f/users/2b371bc3efc5413ba205fa65f933f49a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:09.030256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.037203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497639-14ab-42df-ac6f-02cb4e72c7b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.086509 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 818/1621] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:08 2022] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:09.086509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.086509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.086993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.125095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] MFA Rules not processed for user `2b371bc3efc5413ba205fa65f933f49a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:09.125781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1356457-6101-423f-8b34-43fc2e5e0e6a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.126309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.135276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.136138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.136502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.136862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.137740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:09.142348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.145823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.163219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 804/1622] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:09.164758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.177033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546bc05-3470-493c-906d-df371508f286 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.183427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.184392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.184826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.185346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.186219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.188249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.202177 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 805/1623] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:09.203233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.219700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a3777-3bd8-43a1-aa12-700bdcc5bd47 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.227872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.228495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.228772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.229481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.229709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.232214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.238397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 819/1624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:09.241207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.259819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d1473-28a2-4e05-9139-7941da457772 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.267537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.269669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.269932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.270213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] PATH_INFO: `/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058/users/fe95c4b1f55d4c4497ae3c8bf7c425b2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.279074 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 806/1625] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:09 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:09.280310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.294533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be42b0dd1fd43fc93e2f9ee8cd9a058, user_id=fe95c4b1f55d4c4497ae3c8bf7c425b2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.297265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.313615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 820/1626] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:09 2022] PUT /identity/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058/users/fe95c4b1f55d4c4497ae3c8bf7c425b2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:09.314316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.315851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.361324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b980d-f0b6-42dd-8256-abb06b192e7b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.396527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90b27-5492-43aa-a320-5d0e987e6292 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.397790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:09.409286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.410401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.410777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.411146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] PATH_INFO: `/v3/users/b3c31abeb7044a6fa7f1b6a7ee06b15f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.413095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c31abeb7044a6fa7f1b6a7ee06b15f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.418285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.434117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.434738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.435012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.435275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.435898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.438127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.463732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:09.473408 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 807/1627] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:09 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:09.476482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.479202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.485627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c31abeb7044a6fa7f1b6a7ee06b15f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:09.496870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c31abeb7044a6fa7f1b6a7ee06b15f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:09.498205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c31abeb7044a6fa7f1b6a7ee06b15f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:09.507133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c31abeb7044a6fa7f1b6a7ee06b15f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:09.508009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c31abeb7044a6fa7f1b6a7ee06b15f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:09.529462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 821/1628] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:09 2022] DELETE /identity/v3/users/b3c31abeb7044a6fa7f1b6a7ee06b15f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:09.530594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.532017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.572496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff03187-8369-46cc-9c8c-835081b85e03 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.607374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4047e-d548-443e-831b-5a8e35728b0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.614435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.615112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.615399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.615673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.616601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.618498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.629697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 822/1629] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:09.630539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.632388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.645418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d3e1-f579-4f78-8f05-a8173d7c7c77 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.645913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.646660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.646975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.647318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.649813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.651512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.652122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.652401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.652675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.653345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.654923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebb83c-6f0c-46d0-9a06-aa177bc2ce1b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.665312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 823/1630] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:09.666618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.666975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.667340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.687613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:09.690158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.702075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 824/1631] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:09.702075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.715385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f68c-d776-4e22-8218-2f509ed36a2a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.718571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:09.722131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.722597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.723351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.723730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.724006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] PATH_INFO: `/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058/users/fe95c4b1f55d4c4497ae3c8bf7c425b2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.724463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.726306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be42b0dd1fd43fc93e2f9ee8cd9a058, user_id=fe95c4b1f55d4c4497ae3c8bf7c425b2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.730385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.738674 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 808/1632] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:09.739885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.745031 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 825/1633] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:09 2022] PUT /identity/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058/users/fe95c4b1f55d4c4497ae3c8bf7c425b2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:09.745031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.751005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.752322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f09fe-5c24-4346-90f6-ee2133528642 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.825246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.825859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.826318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.826597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.827207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.828948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbd5fd-28d5-45f5-b529-8bae17a01ab7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.838334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b05188-2d5c-4640-98f3-38f35963a027 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:09.840418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 809/1634] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:09.841897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.842173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.842448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.843486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:09.844430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:09.844708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:09.845183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:09.858601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:09.859955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:09.873746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] MFA Rules not processed for user `fe95c4b1f55d4c4497ae3c8bf7c425b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:09.875009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.875224 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 826/1635] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:09.876089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.877621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:09.904697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:09.977729 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 810/1636] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:09.984565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:09.996944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0fa7a-817a-4f78-838c-c5cd55850016 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.001733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.002646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.002929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.003198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] PATH_INFO: `/v3/projects/ebba7205559442a5bb634c9d5cc18b96/users/fd5c70c0849e4a9f87faadfca71982be/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.008929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff8ef-414c-4b0b-81ef-83205cb6b5b2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.017634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.018275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.018568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.018824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.020690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.026164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebba7205559442a5bb634c9d5cc18b96, user_id=fd5c70c0849e4a9f87faadfca71982be, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.029401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.054200 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 811/1637] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:09 2022] PUT /identity/v3/projects/ebba7205559442a5bb634c9d5cc18b96/users/fd5c70c0849e4a9f87faadfca71982be/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:10.055578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.125156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.127672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de247637-0637-43d3-a7a7-6a83323613dd service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.140305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:10.144383 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 827/1638] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:10.146048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.146648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.147170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.156448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30873951-0147-4c7b-b1de-4bbf10d0b0fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.161837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.162485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.162764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.163071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] PATH_INFO: `/v3/users/52abcdb67c2f4801921cb7ee81b02ac5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.164173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52abcdb67c2f4801921cb7ee81b02ac5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.166839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.192921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] MFA Rules not processed for user `fd5c70c0849e4a9f87faadfca71982be`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:10.194676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.229943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52abcdb67c2f4801921cb7ee81b02ac5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.242380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52abcdb67c2f4801921cb7ee81b02ac5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.283847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52abcdb67c2f4801921cb7ee81b02ac5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.284599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52abcdb67c2f4801921cb7ee81b02ac5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.297774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5d9dc7d-1fdb-4ef1-8349-529381621846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52abcdb67c2f4801921cb7ee81b02ac5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.347627 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 812/1639] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:10 2022] DELETE /identity/v3/users/52abcdb67c2f4801921cb7ee81b02ac5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:10.352334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.352601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.352901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.359207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 828/1640] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:10.364002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.367240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.381813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:10.383684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.396908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232883ef-62e2-4f6f-ba34-92945fe923bc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.482341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:10.502626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.503495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.504197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.504627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.505438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.507784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.522589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 813/1641] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:10.535341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.536904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.550678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8017-c1bf-4597-a74e-2476f37e0187 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.560959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.561774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.562253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.562630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] PATH_INFO: `/v3/projects/df48e6d3b6f44c90ae47a3c2ce30d977` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.563976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df48e6d3b6f44c90ae47a3c2ce30d977)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.566964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.574486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 829/1642] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:10 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:10.575460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.577380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.630085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df48e6d3b6f44c90ae47a3c2ce30d977', 'request_id': 'req-ab665d5a-03a8-4125-8289-8187f77937f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.649236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df48e6d3b6f44c90ae47a3c2ce30d977', 'request_id': 'req-ab665d5a-03a8-4125-8289-8187f77937f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.654166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e323a7-5eb3-4c57-befc-bc58cd921a3e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.658072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df48e6d3b6f44c90ae47a3c2ce30d977', 'request_id': 'req-ab665d5a-03a8-4125-8289-8187f77937f8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.665612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:10.676320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] The token cache is being invalidate because project df48e6d3b6f44c90ae47a3c2ce30d977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:10.676611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.680963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.686019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 814/1643] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:10 2022] DELETE /identity/v3/projects/df48e6d3b6f44c90ae47a3c2ce30d977 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:10.686019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.687190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.720111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.720757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.721134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.721427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] PATH_INFO: `/v3/users/4e59b5b4dea347b6a72e68a987ed92fc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.722602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e59b5b4dea347b6a72e68a987ed92fc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.724501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.759014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab665d5a-03a8-4125-8289-8187f77937f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.764685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.765918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.766420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.766699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.768602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.776438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e59b5b4dea347b6a72e68a987ed92fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.783480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.785158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.786017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e59b5b4dea347b6a72e68a987ed92fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.786830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e59b5b4dea347b6a72e68a987ed92fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.795212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e59b5b4dea347b6a72e68a987ed92fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.795649 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 815/1644] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:10.796498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e59b5b4dea347b6a72e68a987ed92fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.796620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.797883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.809673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:10.812418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362811f-bd6b-4281-8196-a530fb6aef9f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.823252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 830/1645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:10 2022] DELETE /identity/v3/users/4e59b5b4dea347b6a72e68a987ed92fc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:10.823252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.823541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.823777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.824339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.824820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.825280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.826078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.828558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668def5-085c-4682-87c4-70d1b348d6dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.859823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 816/1646] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:10 2022] POST /identity/v3/users => generated 298 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:10.861778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.862126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.862465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.890775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:10.892195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.898781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cbc-e636-4851-9f23-ff6dc60252cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.903865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.904544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.905022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.905129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] PATH_INFO: `/v3/users/8442f792e75240c5ba5bdc1d348d6722` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.906405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8442f792e75240c5ba5bdc1d348d6722)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.910842 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 817/1647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:10.910842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.911649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.913325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.926988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc787aac-a521-4487-9282-12b3097a0c2a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:10.938891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:10.939852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:10.940304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:10.940744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:10.944467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:10.948392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:10.962948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 818/1648] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:10.965392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:10.967212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8442f792e75240c5ba5bdc1d348d6722'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.967981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:10.978891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8442f792e75240c5ba5bdc1d348d6722'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.980066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8442f792e75240c5ba5bdc1d348d6722'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.989067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8442f792e75240c5ba5bdc1d348d6722'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:10.989934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8442f792e75240c5ba5bdc1d348d6722'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.023122 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 831/1649] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:10 2022] DELETE /identity/v3/users/8442f792e75240c5ba5bdc1d348d6722 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:11.024143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.027328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.036407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e19eb-af77-44f8-b1ce-8a68da43b0a8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.101369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.102684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.103960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.103960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.107830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.197171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1936ba3-9d8d-4d54-b3f6-373464fe915b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.205233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:11.221191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.224091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.224275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.224618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] PATH_INFO: `/v3/projects/be512a5ef5c44cc4a336f17602218c61/users/8f68a812d19046d9b52fc6c9df10b6a7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.252700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be512a5ef5c44cc4a336f17602218c61, user_id=8f68a812d19046d9b52fc6c9df10b6a7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.254688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.256296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.256729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.260803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:11.278605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 819/1650] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:11.279470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.281278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.287589 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 832/1651] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:11 2022] PUT /identity/v3/projects/be512a5ef5c44cc4a336f17602218c61/users/8f68a812d19046d9b52fc6c9df10b6a7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:11.293643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.298072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e0871-8a54-4df1-9325-3498fd51fd6b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.380249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.380943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.381309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.381448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0faac3-9096-47df-953a-5a1170fd5da7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.381910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] PATH_INFO: `/v3/projects/f25453a7614d4e82b0f0de8b56523464` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.382815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25453a7614d4e82b0f0de8b56523464)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.385967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.387862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.388563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.389099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.389448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.390240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.391947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.410856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 833/1652] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:11.418167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.436913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac776df-2f7a-41c5-87ab-f659e7b68b20 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.445091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25453a7614d4e82b0f0de8b56523464', 'request_id': 'req-4dd47f8e-536c-4333-944e-462ade1fe724'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.457034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25453a7614d4e82b0f0de8b56523464', 'request_id': 'req-4dd47f8e-536c-4333-944e-462ade1fe724'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.469847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25453a7614d4e82b0f0de8b56523464', 'request_id': 'req-4dd47f8e-536c-4333-944e-462ade1fe724'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.497042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] The token cache is being invalidate because project f25453a7614d4e82b0f0de8b56523464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:11.497607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.498457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.504014 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 820/1653] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:11 2022] DELETE /identity/v3/projects/f25453a7614d4e82b0f0de8b56523464 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:11.505053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.507748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.541834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.542256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.542537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.545289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] PATH_INFO: `/v3/projects/be512a5ef5c44cc4a336f17602218c61/users/8f68a812d19046d9b52fc6c9df10b6a7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.545289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be512a5ef5c44cc4a336f17602218c61, user_id=8f68a812d19046d9b52fc6c9df10b6a7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.548549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311320e-13b8-454b-bfbf-8a4fcc235c2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.572736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 834/1654] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:11 2022] PUT /identity/v3/projects/be512a5ef5c44cc4a336f17602218c61/users/8f68a812d19046d9b52fc6c9df10b6a7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:11.574601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.574878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.575147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.615292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] MFA Rules not processed for user `8f68a812d19046d9b52fc6c9df10b6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:11.616559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.653945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd47f8e-536c-4333-944e-462ade1fe724 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:11.659903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:11.747180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:11.747935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:11.748358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:11.748724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] PATH_INFO: `/v3/users/fe95c4b1f55d4c4497ae3c8bf7c425b2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:11.750235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe95c4b1f55d4c4497ae3c8bf7c425b2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:11.752628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:11.795591 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 835/1655] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:11.822849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe95c4b1f55d4c4497ae3c8bf7c425b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.823537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe95c4b1f55d4c4497ae3c8bf7c425b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.831099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe95c4b1f55d4c4497ae3c8bf7c425b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.831789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe95c4b1f55d4c4497ae3c8bf7c425b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.840987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe95c4b1f55d4c4497ae3c8bf7c425b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:11.861394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.863208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:11.879444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:11.883417 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 821/1656] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:11 2022] DELETE /identity/v3/users/fe95c4b1f55d4c4497ae3c8bf7c425b2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:11.887250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:11.888604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.006593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331fb27-4c92-4da9-b4ed-3f638e3d0c34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.014462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.015837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.016794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.017125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] PATH_INFO: `/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.018990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93ba70b267e4dd8b4d2e1d0ecb03f4a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.021261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.052368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da439a-4523-4958-bdf6-aa73222a1a62 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.062600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:12.120530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93ba70b267e4dd8b4d2e1d0ecb03f4a', 'request_id': 'req-1e266937-9c0d-4112-91fa-52ceb3490042'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.130445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93ba70b267e4dd8b4d2e1d0ecb03f4a', 'request_id': 'req-1e266937-9c0d-4112-91fa-52ceb3490042'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.144089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93ba70b267e4dd8b4d2e1d0ecb03f4a', 'request_id': 'req-1e266937-9c0d-4112-91fa-52ceb3490042'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.165035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.165927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.166104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.166387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.168519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.175820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] The token cache is being invalidate because project f93ba70b267e4dd8b4d2e1d0ecb03f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:12.176508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.177545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.190917 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 822/1657] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:11 2022] DELETE /identity/v3/projects/f93ba70b267e4dd8b4d2e1d0ecb03f4a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:12.192020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.199174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.249453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.251187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23dac-756c-4986-b195-22e635336cf7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.265069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 836/1658] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:12.267654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.267991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.268265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.272159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e266937-9c0d-4112-91fa-52ceb3490042 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.278168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.278940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.279305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.279889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] PATH_INFO: `/v3/projects/df5b58d2bc744081ad6e6446e582573e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.283606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5b58d2bc744081ad6e6446e582573e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.283606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.302869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:12.304165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.312587 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 837/1659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:12.313677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.315221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.328613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b310ba5-5172-4831-ba0c-141918279576 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.334483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.335227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.335653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.336084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] PATH_INFO: `/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.338239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be42b0dd1fd43fc93e2f9ee8cd9a058)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.340750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.345795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5b58d2bc744081ad6e6446e582573e', 'request_id': 'req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.354375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5b58d2bc744081ad6e6446e582573e', 'request_id': 'req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.362740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5b58d2bc744081ad6e6446e582573e', 'request_id': 'req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.375338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] The token cache is being invalidate because project df5b58d2bc744081ad6e6446e582573e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:12.375704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.376590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fd74032f-3d1a-44e4-97f9-0bef1a5f4656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.378607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 823/1660] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:12 2022] DELETE /identity/v3/projects/df5b58d2bc744081ad6e6446e582573e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:12.379863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0a00-5876-421a-a8e6-5be3dffa2890 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.380140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0a00-5876-421a-a8e6-5be3dffa2890 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.380411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0a00-5876-421a-a8e6-5be3dffa2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.386022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:12.405359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be42b0dd1fd43fc93e2f9ee8cd9a058', 'request_id': 'req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.406597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-254c0a00-5876-421a-a8e6-5be3dffa2890 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:12.407912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-254c0a00-5876-421a-a8e6-5be3dffa2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.416416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be42b0dd1fd43fc93e2f9ee8cd9a058', 'request_id': 'req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.422783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be42b0dd1fd43fc93e2f9ee8cd9a058', 'request_id': 'req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.440340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] The token cache is being invalidate because project 4be42b0dd1fd43fc93e2f9ee8cd9a058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:12.440711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.441535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.445045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 838/1661] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:12 2022] DELETE /identity/v3/projects/4be42b0dd1fd43fc93e2f9ee8cd9a058 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:12.445045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.446527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.459240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:12.486091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 824/1662] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:12.487331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.487613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.487887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.507847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:12.509827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.525925 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 825/1663] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:12.525925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.530380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d79fb9-7575-46a4-bd5c-fb6dd1945c98 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.535858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.536201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a73b-91bd-4cf0-82a5-fa4e01cc8210 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.536750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.537136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.537482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] PATH_INFO: `/v3/users/2b371bc3efc5413ba205fa65f933f49a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.538686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b371bc3efc5413ba205fa65f933f49a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.540958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.541487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.542317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.542696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.543057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.543855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:12.544252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.545974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239629bd-bcd8-40f3-b62f-b98085c6f94f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.562533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 826/1664] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:12.562533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.562800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.563168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.585458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:12.588945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.599152 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 827/1665] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:12.601985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.611633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b371bc3efc5413ba205fa65f933f49a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.621356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b371bc3efc5413ba205fa65f933f49a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.621759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ac0a-28a8-4416-b6f5-6bfe62aa4a95 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.621980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b371bc3efc5413ba205fa65f933f49a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.627489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.628175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.628442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.628708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.629558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.630667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b371bc3efc5413ba205fa65f933f49a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.631443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.631648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b371bc3efc5413ba205fa65f933f49a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.650842 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 839/1666] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:12 2022] DELETE /identity/v3/users/2b371bc3efc5413ba205fa65f933f49a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:12.651925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.653296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.668834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 828/1667] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:12.668834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.671947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.704609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:12.743882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179416-29b3-4bd8-a193-3763aa1c0f70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.776268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea948fd-0b02-44ca-a9e4-abab68f22670 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.784912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.787849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.788134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.790324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] PATH_INFO: `/v3/users/fd5c70c0849e4a9f87faadfca71982be` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.792908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5c70c0849e4a9f87faadfca71982be)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.795192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.826057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.826827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.827103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.827368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.828028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:12.828324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.830101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.855038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 840/1668] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:12.855038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.856350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.871893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537f5d-b6ff-489d-9145-acadf6c8eedf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.878148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.880029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.880275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.880722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.881598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.883785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.898168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5c70c0849e4a9f87faadfca71982be'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.900452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5c70c0849e4a9f87faadfca71982be'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.917231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5c70c0849e4a9f87faadfca71982be'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.917397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 841/1669] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/users => generated 294 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:12.920661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5c70c0849e4a9f87faadfca71982be'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.921250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.924587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:12.943902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5c70c0849e4a9f87faadfca71982be'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:12.949449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d54b-8f2e-4c11-bbb8-c972f204551e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:12.956614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:12.959347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:12.959347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:12.959347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:12.959347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:12.962104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb1b72-b88d-44c0-867b-733ebae3d912 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:12.971135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 829/1670] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:12 2022] DELETE /identity/v3/users/fd5c70c0849e4a9f87faadfca71982be => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:12.974256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:12.975660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.007070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:13.019068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 842/1671] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:12 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:13.021644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.021936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.022211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.047877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:13.050019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.064000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27bee-eacf-4d80-9661-6b5bdf6a7f82 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.151293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 843/1672] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:13.154418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.162444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.163609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.163609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.163609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.164724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.166564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.170148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade856-333b-46c7-a8cf-d928d902a31a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.175036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.175650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.175926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.176203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.176821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.179674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.192369 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 830/1673] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:13.193205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.195195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.206223 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 844/1674] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:13.207128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.208935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.209288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b860e78-bfc6-4431-9512-0a060cad7952 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.214397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.215198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.215478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.215749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] PATH_INFO: `/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.216868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d402f8c6df574847bf609e4ae6d0ed2f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.219443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.243327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:13.278827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd402f8c6df574847bf609e4ae6d0ed2f', 'request_id': 'req-a8710cbf-a002-4962-aba6-7c26842908c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.282007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91e886-0172-4948-868b-2779c1270725 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.286662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd402f8c6df574847bf609e4ae6d0ed2f', 'request_id': 'req-a8710cbf-a002-4962-aba6-7c26842908c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.297035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd402f8c6df574847bf609e4ae6d0ed2f', 'request_id': 'req-a8710cbf-a002-4962-aba6-7c26842908c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.313507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] The token cache is being invalidate because project d402f8c6df574847bf609e4ae6d0ed2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:13.313817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.314904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.316687 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 831/1675] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:13 2022] DELETE /identity/v3/projects/d402f8c6df574847bf609e4ae6d0ed2f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:13.317749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.319231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.343351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.344074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.344411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.344748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.346954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.371604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:13.396009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710cbf-a002-4962-aba6-7c26842908c6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.403218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.403894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.404291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.404563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.405380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.407022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.421736 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 832/1676] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:13.422598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.425896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.432797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.434278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba69b6e-0601-4553-ad98-d1aeec25fcc5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.442907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5e38-aafe-4b42-9120-30ec421d7a07 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.447141 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 845/1677] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:13.449359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.449985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.450259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.450528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.451305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.451850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.452302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.452740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.452905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.469543 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 833/1678] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:13.470577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.476413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:13.478654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.487828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d98120-206c-4653-8718-af339a753a2b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.493105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 846/1679] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:13.495754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.497467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.499431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.500347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] PATH_INFO: `/v3/projects/8fdd3736128e418eae51f5e3de971b8b/users/db4b9bbf4c81444ca0632affdebec279/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.508638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.525384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdd3736128e418eae51f5e3de971b8b, user_id=db4b9bbf4c81444ca0632affdebec279, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.529902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e7ae2-0d74-4ecc-ab42-49a385a583e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.530683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35fb72-915f-44ee-a439-eb0db86dfb3c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.543445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.544079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.544360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.544612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.545307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.546973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.553780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 834/1680] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:13 2022] PUT /identity/v3/projects/8fdd3736128e418eae51f5e3de971b8b/users/db4b9bbf4c81444ca0632affdebec279/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:13.555833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c252f7-ced2-43ca-b6ed-5cc293ac43bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.556663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c252f7-ced2-43ca-b6ed-5cc293ac43bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.556663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c252f7-ced2-43ca-b6ed-5cc293ac43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.559700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 847/1681] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:13.566189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.583022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672bfcb-5b53-4b08-9fe2-780f783d5569 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.614618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d9c252f7-ced2-43ca-b6ed-5cc293ac43bf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:13.616039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9c252f7-ced2-43ca-b6ed-5cc293ac43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.670520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.671274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.671606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.674847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] PATH_INFO: `/v3/projects/7798e4736208411d94ec0b26fd0cc505/users/1a97d17233e745b4be33d46ac0203ed7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.696691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7798e4736208411d94ec0b26fd0cc505, user_id=1a97d17233e745b4be33d46ac0203ed7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.697956 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 835/1682] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:13.699862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.700366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.701678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.702920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.705558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:13.723711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 848/1683] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:13 2022] PUT /identity/v3/projects/7798e4736208411d94ec0b26fd0cc505/users/1a97d17233e745b4be33d46ac0203ed7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:13.725221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.744529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] MFA Rules not processed for user `db4b9bbf4c81444ca0632affdebec279`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:13.746986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.835813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5be9-181d-401b-8050-1eb987ec4704 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.841852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.842282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.842560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.842830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.843486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:13.843790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.845459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7f74c-f7f6-480e-91a9-3fd18491940f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.864308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 849/1684] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:13.864308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.864308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.864308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.870820 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 836/1685] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:13.872986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.875194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.889606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c2c07-0ddc-4996-bff0-b02d62dbd01f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:13.893686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] MFA Rules not processed for user `1a97d17233e745b4be33d46ac0203ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:13.894938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:13.895053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:13.895775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:13.896147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:13.896508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] PATH_INFO: `/v3/projects/ebba7205559442a5bb634c9d5cc18b96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:13.897747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebba7205559442a5bb634c9d5cc18b96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:13.900463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:13.952757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:13.970207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebba7205559442a5bb634c9d5cc18b96', 'request_id': 'req-6a84396c-9b72-4749-b08c-c508e5f72036'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.978761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 850/1686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:13.979645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:13.979768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebba7205559442a5bb634c9d5cc18b96', 'request_id': 'req-6a84396c-9b72-4749-b08c-c508e5f72036'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.987309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebba7205559442a5bb634c9d5cc18b96', 'request_id': 'req-6a84396c-9b72-4749-b08c-c508e5f72036'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:13.997320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca038b2-1cbb-425c-9903-a8c352b3ded0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.005818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] The token cache is being invalidate because project ebba7205559442a5bb634c9d5cc18b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:14.006114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.007331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.009467 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 837/1687] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:13 2022] DELETE /identity/v3/projects/ebba7205559442a5bb634c9d5cc18b96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:14.010058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.013140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.094199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84396c-9b72-4749-b08c-c508e5f72036 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.094705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.097854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.098535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.098871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.099268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.099704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.100033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.100309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.100720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.100940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.103411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.104066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.148284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 838/1688] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:14 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.148284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.149094 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 851/1689] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:13 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.161177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.166374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.167661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.173334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:14.313821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea39c1-8abb-4723-bd50-e2101ab54d08 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.315734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff32e7-38a2-44f6-98fc-5bf54f910ff0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.320311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.321619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.322080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.322199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.322379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] PATH_INFO: `/v3/users/8f68a812d19046d9b52fc6c9df10b6a7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.322808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.323089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.323360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.323538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f68a812d19046d9b52fc6c9df10b6a7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.324132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.325575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.326255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.362069 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 839/1690] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:14 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.363208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.399365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f68a812d19046d9b52fc6c9df10b6a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.411337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:14.416913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f68a812d19046d9b52fc6c9df10b6a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.418943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f68a812d19046d9b52fc6c9df10b6a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.434981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f68a812d19046d9b52fc6c9df10b6a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.437317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f68a812d19046d9b52fc6c9df10b6a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:14.464336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b72a2-0fc2-4a14-b97a-b1b97e1fdee4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.470415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.471066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.471340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.471710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.472239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.474843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.476746 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 852/1691] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:14 2022] DELETE /identity/v3/users/8f68a812d19046d9b52fc6c9df10b6a7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:14.481870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.483387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.505503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 840/1692] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:14 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.506261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.511410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.542333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f4d10-b89c-4ba0-85fe-3037e2d1a78e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.592725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0086070-5260-4c38-9300-67bdd1e4c885 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.607948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.609529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.609915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.610247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.610981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.613468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.641783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 853/1693] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:14 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.642792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.644535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:14.658579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b94d7-4a38-4835-a491-676d8799fbae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.663779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.664668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.665035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.665413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.666130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.668254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.672075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.672714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.672987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.673273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.674192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.676640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:14.683103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.690357 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 854/1694] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:14.691971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.709491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d55da8-cb36-4473-b18a-23886fd73f91 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.710872 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 841/1695] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:14 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:14.712763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.721246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.722234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.722676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.723118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.724720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.724843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35fa7-6ac5-4721-aec3-e2e98f6574a1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.727321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.731671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.732488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.732773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.733107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] PATH_INFO: `/v3/projects/3225542f61c44ceeac1d69f2344ace1a/users/a8f4e0ffaace4e61bb2f5bc1d977d5af/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.742745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 855/1696] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:14.742745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.754552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279723-aa9f-4146-9383-07de402610c7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.756584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3225542f61c44ceeac1d69f2344ace1a, user_id=a8f4e0ffaace4e61bb2f5bc1d977d5af, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.761347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.763636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.765441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.765894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.766483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.768396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.770450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.784386 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 856/1697] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:14.785280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.790009 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 842/1698] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:14 2022] PUT /identity/v3/projects/3225542f61c44ceeac1d69f2344ace1a/users/a8f4e0ffaace4e61bb2f5bc1d977d5af/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:14.791330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.798987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f05207-910b-42d9-9809-94e127c9e090 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.872186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.872730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.873045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.873217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89962f5-a7d7-470a-afeb-7667bd436ab6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.874036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.875140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.878240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.878365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.879150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.879512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.879955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] PATH_INFO: `/v3/projects/451baf93b6ab4bf48cf93e39df973d89/users/76a304dcccf4471aba06773a1c82bfe8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.896693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] RBAC: Authorizing `identity:create_grant(project_id=451baf93b6ab4bf48cf93e39df973d89, user_id=76a304dcccf4471aba06773a1c82bfe8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:14.897180 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 857/1699] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:14.898312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.900337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:14.910790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d67ac7-cd4b-42ab-bb40-6a0a136f2b0c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:14.921147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 843/1700] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:14 2022] PUT /identity/v3/projects/451baf93b6ab4bf48cf93e39df973d89/users/76a304dcccf4471aba06773a1c82bfe8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:14.921147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:14.950377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:14.997414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:14.998043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:14.998319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:14.998623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:14.999245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.000884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.018075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 858/1701] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:15.018075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.020945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabaafa-d335-4350-89be-816544c5542f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.029109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.030235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.031099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.031623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986/users/61dd0db9c36e46bdba9f6570379591af/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.032446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e353-5be2-4a42-82c4-ebfbb2fa80c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.048645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.049293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.049559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.049824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.050463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.052057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.053827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=923fa1b9a3e2461fa0f7fea416c5a986, user_id=61dd0db9c36e46bdba9f6570379591af, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.059595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.064799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 859/1702] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:15.065823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.081955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce3ca2-7fa3-44db-9ac8-9ef2435359d5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.085570 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 844/1703] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:14 2022] PUT /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986/users/61dd0db9c36e46bdba9f6570379591af/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:15.087012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.173456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.174459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.174804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.175136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] PATH_INFO: `/v3/projects/3225542f61c44ceeac1d69f2344ace1a/users/a8f4e0ffaace4e61bb2f5bc1d977d5af/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.177254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3225542f61c44ceeac1d69f2344ace1a, user_id=a8f4e0ffaace4e61bb2f5bc1d977d5af, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.180365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a34795-86ef-48b2-9f1e-b855b8a346b8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.183265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:15.196279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 860/1704] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:15 2022] PUT /identity/v3/projects/3225542f61c44ceeac1d69f2344ace1a/users/a8f4e0ffaace4e61bb2f5bc1d977d5af/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:15.205930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c4f3-1b7b-41af-9174-01b04fe78047 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.205930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c4f3-1b7b-41af-9174-01b04fe78047 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.205930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c4f3-1b7b-41af-9174-01b04fe78047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.244976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-62a8c4f3-1b7b-41af-9174-01b04fe78047 None None] MFA Rules not processed for user `61dd0db9c36e46bdba9f6570379591af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:15.246639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62a8c4f3-1b7b-41af-9174-01b04fe78047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.250896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05928ca5-2e69-4361-92cc-063a9d045f6c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.325023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.325712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.325986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.326259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] PATH_INFO: `/v3/projects/451baf93b6ab4bf48cf93e39df973d89/users/76a304dcccf4471aba06773a1c82bfe8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.328826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451baf93b6ab4bf48cf93e39df973d89, user_id=76a304dcccf4471aba06773a1c82bfe8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.331666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.355035 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 845/1705] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:15 2022] PUT /identity/v3/projects/451baf93b6ab4bf48cf93e39df973d89/users/76a304dcccf4471aba06773a1c82bfe8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:15.355035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.356493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.406871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 861/1706] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:15.408705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.409017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.409281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.414328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:15.466665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c5b5-e236-447e-8ee0-06dad81c1471 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.484487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] MFA Rules not processed for user `a8f4e0ffaace4e61bb2f5bc1d977d5af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:15.485526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.489343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.490108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.491189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.491189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] PATH_INFO: `/v3/projects/be512a5ef5c44cc4a336f17602218c61` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.492119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be512a5ef5c44cc4a336f17602218c61)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.494173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.563416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be512a5ef5c44cc4a336f17602218c61', 'request_id': 'req-0a978b00-b8f5-459f-8bdb-d0937ff53be4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:15.574447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be512a5ef5c44cc4a336f17602218c61', 'request_id': 'req-0a978b00-b8f5-459f-8bdb-d0937ff53be4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:15.582955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be512a5ef5c44cc4a336f17602218c61', 'request_id': 'req-0a978b00-b8f5-459f-8bdb-d0937ff53be4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:15.601103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] The token cache is being invalidate because project be512a5ef5c44cc4a336f17602218c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:15.601838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:15.602809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a978b00-b8f5-459f-8bdb-d0937ff53be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:15.606878 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 846/1707] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:15 2022] DELETE /identity/v3/projects/be512a5ef5c44cc4a336f17602218c61 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:15.608616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ffd8-dc65-49b6-b79a-ebabe06d5d03 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.609343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ffd8-dc65-49b6-b79a-ebabe06d5d03 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.609756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0ffd8-dc65-49b6-b79a-ebabe06d5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.647029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3ea0ffd8-dc65-49b6-b79a-ebabe06d5d03 None None] MFA Rules not processed for user `76a304dcccf4471aba06773a1c82bfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:15.649738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ea0ffd8-dc65-49b6-b79a-ebabe06d5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.656392 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 862/1708] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:15.657433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.659063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.680204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2463f6-2063-4406-bad1-0e88662d48a8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.771831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.772453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.773053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.773336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.774785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.783016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 847/1709] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:15.785410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad554-6ec1-4993-a845-14c9565de96d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.786054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:15.786174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad554-6ec1-4993-a845-14c9565de96d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.786837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad554-6ec1-4993-a845-14c9565de96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.809191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:15.819154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-53dad554-6ec1-4993-a845-14c9565de96d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:15.821812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53dad554-6ec1-4993-a845-14c9565de96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.828912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 863/1710] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:15.832887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 848/1711] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:15.833055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:15.841715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.841989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.842255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.868343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:15.873681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:15.924595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ec8bd-63ea-4fab-9555-9a42db9acd53 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:15.942490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:15.943488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:15.943879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:15.944159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:15.944691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:15.945179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:15.948235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.009269 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 864/1712] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:16.010425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.012290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.013618 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 849/1713] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:16.017394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.018716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.102213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a73ef-2e21-4181-97a0-2c61bfe162ae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.108784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.109633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.109905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.110170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.126258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01af6-e0f7-4c7b-8952-ac499d9a5e06 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.135091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.135789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.136191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.136531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.176896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.178822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.189653 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 865/1714] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:16.190475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.203056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20c0b-0fcc-4483-8c30-03e6a5982cb1 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.209501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.210243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.210536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.210812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.212056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.212640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.213680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.214511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.233310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 866/1715] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:16.233310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.240279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 850/1716] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:16.242081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.248671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:16.254356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331c656-6067-44c2-b685-f59f7a092dc2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.263017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.263734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.264118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.264431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.265416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:16.265554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009888-fffb-40e8-9d58-5c54751c09a6 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.266353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.268507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.279917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.280718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.281083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.281424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] PATH_INFO: `/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff/users/3ddb1acb193e4d22b664431fd2895e50/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.288350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 867/1717] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:16.293234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.313443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0de79-478e-4b2b-94ed-47dfb4975563 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.315917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf0da166cd049618bd0e00cfdfd7eff, user_id=3ddb1acb193e4d22b664431fd2895e50, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.319648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.327657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.328810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.330097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.330491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.331207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.333192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.344106 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 851/1718] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:16 2022] PUT /identity/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff/users/3ddb1acb193e4d22b664431fd2895e50/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:16.345064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.406017 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 868/1719] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:16.406017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.450952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:16.473628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f9b6c-fe67-4539-b94f-11cbccbbe4bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.498022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543afd55-0b5c-402a-bff2-4651cdd58bd1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.504388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.505069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.505349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.505617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.506408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.511040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.557717 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 869/1720] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:16 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:16.566018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.566233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.566426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.566764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.567513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.569128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.571616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.579079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.582839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 852/1721] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:16.584191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.600404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849d6cf-e611-4ab1-86d4-2d41bdd44996 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.608163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.609361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.609729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.610076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.610937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.613025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec606f1-47a2-4b4d-a953-2281c888c31d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.614003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.625744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.629318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.629736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.630471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] PATH_INFO: `/v3/users/1a97d17233e745b4be33d46ac0203ed7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.633543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a97d17233e745b4be33d46ac0203ed7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.634625 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 853/1722] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:16.635279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.639554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.662243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd93d69-428a-4bf6-97aa-da6aa4837a44 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.670011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.670701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.670963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.671235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] PATH_INFO: `/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff/users/3ddb1acb193e4d22b664431fd2895e50/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.673501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf0da166cd049618bd0e00cfdfd7eff, user_id=3ddb1acb193e4d22b664431fd2895e50, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.675995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.697163 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 854/1723] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:16 2022] PUT /identity/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff/users/3ddb1acb193e4d22b664431fd2895e50/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:16.697163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.738064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a97d17233e745b4be33d46ac0203ed7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:16.750761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a97d17233e745b4be33d46ac0203ed7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:16.751624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a97d17233e745b4be33d46ac0203ed7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:16.773210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a97d17233e745b4be33d46ac0203ed7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:16.774459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a8894c7-34e8-4ab7-af93-26ba153e0db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a97d17233e745b4be33d46ac0203ed7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:16.796945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 870/1724] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:16 2022] DELETE /identity/v3/users/1a97d17233e745b4be33d46ac0203ed7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:16.797618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b453-331a-4573-acf0-871ab334e548 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.798385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.798693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.798960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.838928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] MFA Rules not processed for user `3ddb1acb193e4d22b664431fd2895e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:16.840511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.860748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:16.879413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.880312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.880622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.881115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.881939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.884744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a67a7-19c5-402f-a489-d14cbcfe9f8e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.897345 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 855/1725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:16.899412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.899693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.899962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.925184 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 871/1726] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:16.925452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:16.925984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.926634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.927225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.942153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff6c2-c12d-4bdc-ab3e-338deba66117 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.942846 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 856/1727] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:16.944054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.945967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:16.947703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.948310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.948587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.948852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] PATH_INFO: `/v3/projects/35d74b4355864dcdb903615bc54efd65/users/5b1a3f75cdfa416c97694d6b409cfa9e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.960379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:16.965301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d74b4355864dcdb903615bc54efd65, user_id=5b1a3f75cdfa416c97694d6b409cfa9e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.965853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9b303-5086-408d-84b0-4523a6d23f56 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:16.968111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.971561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:16.972329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:16.972637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:16.972947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] PATH_INFO: `/v3/users/db4b9bbf4c81444ca0632affdebec279` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:16.974198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4b9bbf4c81444ca0632affdebec279)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:16.976205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:16.981903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 872/1728] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:16 2022] PUT /identity/v3/projects/35d74b4355864dcdb903615bc54efd65/users/5b1a3f75cdfa416c97694d6b409cfa9e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:16.982862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:16.984440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.035355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4b9bbf4c81444ca0632affdebec279'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:17.036033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4b9bbf4c81444ca0632affdebec279'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:17.044608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4b9bbf4c81444ca0632affdebec279'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:17.045357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4b9bbf4c81444ca0632affdebec279'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:17.054229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4b9bbf4c81444ca0632affdebec279'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:17.076329 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 857/1729] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:16 2022] DELETE /identity/v3/users/db4b9bbf4c81444ca0632affdebec279 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:17.076526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297be12c-76ba-4261-a759-00ffd0eb2c9f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.077947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.079558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.145572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d73d3-e9e5-49a9-9e88-8898609d3daf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.150209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.150736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.150853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.151078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.151347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.151482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.151893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.152283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.153350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.154908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.185106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:17.225388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.228121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6c51d-ad66-48a4-8ff6-72479b90ec7c service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.228968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.233424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb24cf-2638-4d69-be68-c84bfe5b2cf5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.238672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 873/1730] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:17.239748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.240026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.240289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.261092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 858/1731] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:17.262917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4099c5-fe5b-42cb-a101-83dfbfb6fec3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.263360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4099c5-fe5b-42cb-a101-83dfbfb6fec3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.263766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4099c5-fe5b-42cb-a101-83dfbfb6fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.272054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] MFA Rules not processed for user `5b1a3f75cdfa416c97694d6b409cfa9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:17.273357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.286064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ae4099c5-fe5b-42cb-a101-83dfbfb6fec3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:17.287534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae4099c5-fe5b-42cb-a101-83dfbfb6fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.296908 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 859/1732] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:17.298253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.298726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.298816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.304552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 860/1733] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:17.305541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:17.307223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.328517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.340795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f9a1c-f135-4c1b-8c49-44145ba926b7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.347118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.347922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.348526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.348526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.349800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.365133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.369876 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 861/1734] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:17.371515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.372701 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 874/1735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:17.377302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.378909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.388628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4481f-7a35-4c1a-b3ba-31647479ba1f tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.393935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.395107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.395542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.396085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.400038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094bfe-6b19-4403-a1b6-cbc297830039 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.406308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.407307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.407685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.408667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.410211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.411157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.412519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.412930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb04a8-d001-4981-aa6b-42fb3c15a6d5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.419095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:17.430679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 862/1736] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:17.434824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.435409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.435938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.437811 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 863/1737] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 16:01:17.443657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:17.449091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.461562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 875/1738] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:17 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:17.463713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.499465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.514901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60081de1-97f2-4484-90ac-06ac121ceaa7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.590606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68d1b-d636-4d6d-9fe5-136b4fdafcf9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.604593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.605408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.607118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.607633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.608035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.610886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.626284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.627023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.627389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.627672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.630417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.637095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.640631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 864/1739] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:17.649537 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 876/1740] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:17 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:17.650987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.663768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6f9b-2a48-4c1e-aaa3-70b3cf2d124b tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.671377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.672148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.672521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.673034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.673787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.676306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.693687 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 865/1741] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:17.699805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.714539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6005b0-ded0-49ed-87f0-be7abb5aebe2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.723830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.725083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.725615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.728034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] PATH_INFO: `/v3/projects/b21d626f1394465a894d31abc8bbe7f2/users/fa7f28118bd44e5795955015f2db1402/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.754949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21d626f1394465a894d31abc8bbe7f2, user_id=fa7f28118bd44e5795955015f2db1402, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.767568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d953a-b97f-4469-ad5d-fed88b04766b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.768025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.769944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.781294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:17.796720 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 877/1742] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:17 2022] PUT /identity/v3/projects/b21d626f1394465a894d31abc8bbe7f2/users/fa7f28118bd44e5795955015f2db1402/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:17.798441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.798927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.799387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.799515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38c421-aa2f-4b4a-95c5-69c4ffce02cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.827063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] MFA Rules not processed for user `61dd0db9c36e46bdba9f6570379591af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:17.828918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:17.903976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.905322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.905889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.906329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] PATH_INFO: `/v3/projects/7798e4736208411d94ec0b26fd0cc505` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.908708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7798e4736208411d94ec0b26fd0cc505)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.912009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:17.955686 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 878/1743] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:17.956832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:17.972052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18e712-d9ad-499c-892d-3ae14340c7ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:17.978546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:17.979293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:17.979574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:17.979996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:17.981100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:17.983187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642ad84-cf7e-426c-9fe8-264ef4ea99fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.003649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 879/1744] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:18.005249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86e01-844e-4fdd-bbe3-c75e3bad5c4e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.005385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7798e4736208411d94ec0b26fd0cc505', 'request_id': 'req-7d35a6fa-9024-4587-ad72-2ea5373878fa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.005863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86e01-844e-4fdd-bbe3-c75e3bad5c4e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.006268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86e01-844e-4fdd-bbe3-c75e3bad5c4e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.009030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 880/1745] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:18.009941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86e01-844e-4fdd-bbe3-c75e3bad5c4e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.015962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7798e4736208411d94ec0b26fd0cc505', 'request_id': 'req-7d35a6fa-9024-4587-ad72-2ea5373878fa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.028629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7798e4736208411d94ec0b26fd0cc505', 'request_id': 'req-7d35a6fa-9024-4587-ad72-2ea5373878fa'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.042543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] The token cache is being invalidate because project 7798e4736208411d94ec0b26fd0cc505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:18.043410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.044586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.046833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 866/1746] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:17 2022] DELETE /identity/v3/projects/7798e4736208411d94ec0b26fd0cc505 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:18.047727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.049330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.071860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:18.126092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86e01-844e-4fdd-bbe3-c75e3bad5c4e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.128204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35a6fa-9024-4587-ad72-2ea5373878fa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.132626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.133422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.133890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.134171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.134286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.134442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.134533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.134749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] PATH_INFO: `/v3/projects/8fdd3736128e418eae51f5e3de971b8b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.135871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdd3736128e418eae51f5e3de971b8b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.136223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.137835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.187067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdd3736128e418eae51f5e3de971b8b', 'request_id': 'req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.196273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdd3736128e418eae51f5e3de971b8b', 'request_id': 'req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.201527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.203171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.203983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdd3736128e418eae51f5e3de971b8b', 'request_id': 'req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.213349 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 881/1747] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:18.214060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.215340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.215897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] The token cache is being invalidate because project 8fdd3736128e418eae51f5e3de971b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:18.216186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.217189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c55bf632-8c63-4c2b-8994-1801a2a0a1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.218948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 867/1748] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:18 2022] DELETE /identity/v3/projects/8fdd3736128e418eae51f5e3de971b8b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:18.219974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.220254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.220531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.228393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f2527-9752-4bcb-89d9-7250bbd94447 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.244489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:18.245748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.254630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:18.298342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.299209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.299496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.299774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] PATH_INFO: `/v3/projects/b21d626f1394465a894d31abc8bbe7f2/users/fa7f28118bd44e5795955015f2db1402/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.305637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21d626f1394465a894d31abc8bbe7f2, user_id=fa7f28118bd44e5795955015f2db1402, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.308469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.319969 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 882/1749] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:18 2022] PUT /identity/v3/projects/b21d626f1394465a894d31abc8bbe7f2/users/fa7f28118bd44e5795955015f2db1402/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:18.321022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.322577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.362960 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 868/1750] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:01:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:18.364394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.365919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.383322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0beb3-9147-4ac5-8c82-723563f5396b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.431772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:18.441437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380b6e-cda8-4144-aaca-dfa368cfebcb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.446849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.447708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.447982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.448254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] PATH_INFO: `/v3/users/76a304dcccf4471aba06773a1c82bfe8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.449445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a304dcccf4471aba06773a1c82bfe8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.451446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.459648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.460433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.460596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.460909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] PATH_INFO: `/v3/users/a8f4e0ffaace4e61bb2f5bc1d977d5af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.462127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f4e0ffaace4e61bb2f5bc1d977d5af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.464800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.519561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a304dcccf4471aba06773a1c82bfe8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.526425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f4e0ffaace4e61bb2f5bc1d977d5af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.527491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f4e0ffaace4e61bb2f5bc1d977d5af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.533608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a304dcccf4471aba06773a1c82bfe8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.534420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a304dcccf4471aba06773a1c82bfe8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.540668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f4e0ffaace4e61bb2f5bc1d977d5af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.541587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f4e0ffaace4e61bb2f5bc1d977d5af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.544311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a304dcccf4471aba06773a1c82bfe8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.546215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5450561-89c3-4448-8742-be430d40e006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a304dcccf4471aba06773a1c82bfe8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.553599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f4e0ffaace4e61bb2f5bc1d977d5af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:18.578942 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 883/1751] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:18 2022] DELETE /identity/v3/users/76a304dcccf4471aba06773a1c82bfe8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:18.586311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcad9f-3aa2-4117-a6d4-3c84b268bd69 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.588403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcad9f-3aa2-4117-a6d4-3c84b268bd69 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.588850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcad9f-3aa2-4117-a6d4-3c84b268bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.610322 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 869/1752] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:18 2022] DELETE /identity/v3/users/a8f4e0ffaace4e61bb2f5bc1d977d5af => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:18.611314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.618274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.642227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b2bcad9f-3aa2-4117-a6d4-3c84b268bd69 None None] MFA Rules not processed for user `fa7f28118bd44e5795955015f2db1402`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:18.643753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2bcad9f-3aa2-4117-a6d4-3c84b268bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.699988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:18.755713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9a9d-022b-4334-a51e-90de867610da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:18.765067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:18.765946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.766503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.767121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.769439 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 884/1753] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:18.772618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.794506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:18.797870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:18.819088 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 870/1754] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:18.879094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7228-3824-4289-b755-01c540185b9c None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:18.879401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7228-3824-4289-b755-01c540185b9c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:18.879643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7228-3824-4289-b755-01c540185b9c None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:18.881024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 885/1755] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 16:01:18.887563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:18.889189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:18.913612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:18.917165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.014635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7228-3824-4289-b755-01c540185b9c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.016661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-833a7228-3824-4289-b755-01c540185b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.016955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:19.042363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7228-3824-4289-b755-01c540185b9c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.049288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0600b-0329-4777-b971-5a430255188a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.050461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0600b-0329-4777-b971-5a430255188a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.050741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0600b-0329-4777-b971-5a430255188a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.051022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0600b-0329-4777-b971-5a430255188a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.052842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72e36-ff63-4930-a032-42054859b635 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.061520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.061734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0600b-0329-4777-b971-5a430255188a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.062507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.062960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.063373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0600b-0329-4777-b971-5a430255188a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.063577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.065070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.067753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.070682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 871/1756] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:18 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:19.081250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 886/1757] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:19.203226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.205983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.256658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0600b-0329-4777-b971-5a430255188a service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.258200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5de0600b-0329-4777-b971-5a430255188a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.383463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183474-6635-41c9-a2f5-b16521e52aec tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.391080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.391499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.392085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.392363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] PATH_INFO: `/v3/projects/3225542f61c44ceeac1d69f2344ace1a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.394151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3225542f61c44ceeac1d69f2344ace1a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.397070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.440404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0600b-0329-4777-b971-5a430255188a service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.446489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.447634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.448284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.448568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] PATH_INFO: `/v3/projects/451baf93b6ab4bf48cf93e39df973d89` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.449755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451baf93b6ab4bf48cf93e39df973d89)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.451737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.466657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3225542f61c44ceeac1d69f2344ace1a', 'request_id': 'req-597a5f53-d560-4d99-ae13-232e74b82c5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.475532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3225542f61c44ceeac1d69f2344ace1a', 'request_id': 'req-597a5f53-d560-4d99-ae13-232e74b82c5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.484917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3225542f61c44ceeac1d69f2344ace1a', 'request_id': 'req-597a5f53-d560-4d99-ae13-232e74b82c5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.495812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] The token cache is being invalidate because project 3225542f61c44ceeac1d69f2344ace1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:19.496111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.496751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-597a5f53-d560-4d99-ae13-232e74b82c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.501032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 872/1758] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:19 2022] DELETE /identity/v3/projects/3225542f61c44ceeac1d69f2344ace1a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:19.501032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f15-ce89-4802-a9ef-4f4f97ea5a1b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.501032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f15-ce89-4802-a9ef-4f4f97ea5a1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.501032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f15-ce89-4802-a9ef-4f4f97ea5a1b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.505133 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 873/1759] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:19.507338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27ebb-35fa-468a-b412-41b826f25887 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.507985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27ebb-35fa-468a-b412-41b826f25887 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.508632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd27ebb-35fa-468a-b412-41b826f25887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.515562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451baf93b6ab4bf48cf93e39df973d89', 'request_id': 'req-a01d568b-745b-4d59-b13e-64cad946fd39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.521465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451baf93b6ab4bf48cf93e39df973d89', 'request_id': 'req-a01d568b-745b-4d59-b13e-64cad946fd39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.528396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451baf93b6ab4bf48cf93e39df973d89', 'request_id': 'req-a01d568b-745b-4d59-b13e-64cad946fd39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.538601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fcd27ebb-35fa-468a-b412-41b826f25887 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:19.540500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fcd27ebb-35fa-468a-b412-41b826f25887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.543477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] The token cache is being invalidate because project 451baf93b6ab4bf48cf93e39df973d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:19.543771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.544383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:19.546598 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 887/1760] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:19 2022] DELETE /identity/v3/projects/451baf93b6ab4bf48cf93e39df973d89 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:19.547203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:19.548464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.612740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:19.628195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 874/1761] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:19.628195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db63e-4160-49d8-83f1-0baa49b86559 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.628195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db63e-4160-49d8-83f1-0baa49b86559 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.628195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2db63e-4160-49d8-83f1-0baa49b86559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.644032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1b2db63e-4160-49d8-83f1-0baa49b86559 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:19.645382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b2db63e-4160-49d8-83f1-0baa49b86559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.650131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.651390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.653526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 875/1762] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:19.654915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b333e-89ab-45e6-b131-2418bb7ed47a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.655198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b333e-89ab-45e6-b131-2418bb7ed47a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.655469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b333e-89ab-45e6-b131-2418bb7ed47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.664585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:19.678022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef5b333e-89ab-45e6-b131-2418bb7ed47a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:19.679209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef5b333e-89ab-45e6-b131-2418bb7ed47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.687777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 876/1763] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:19.688934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.689241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.689509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.708970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:19.710170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.718667 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 877/1764] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:19.719445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.720422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d568b-745b-4d59-b13e-64cad946fd39 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.726687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.727365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.727643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.727923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.728835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf00c2-92a3-4c97-98f7-26b55a457934 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.729089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.731428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.733274 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 888/1765] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:19.733789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.734024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.734372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.734651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.735066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.735821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:19.736132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.737744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.745278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443321-f7e9-4544-a2cc-ce3bd292e0b8 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.750204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.751349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.751349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.751349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.751995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:19.752297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.753934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.754784 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 878/1766] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:19.759366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.769604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5e53-1385-4798-aef0-50dffbeb0e71 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.769736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 889/1767] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:19.774032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.775495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.776093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.776363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.776629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.777288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.779171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d78d-c6d5-4e97-b1a7-46e5956d9efb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.784312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9f59f-bc09-4fe1-89f8-6116a5e26102 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.788832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.789961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.790455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.790739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.791411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.793261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.808036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 879/1768] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:19.809550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d39f6-3838-46e5-8e3c-4e2f5956fb90 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.809833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d39f6-3838-46e5-8e3c-4e2f5956fb90 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.810250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d39f6-3838-46e5-8e3c-4e2f5956fb90 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.811793 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 880/1769] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:19.813975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d39f6-3838-46e5-8e3c-4e2f5956fb90 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.825031 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 890/1770] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:19.825031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:19.825031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:19.884695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d39f6-3838-46e5-8e3c-4e2f5956fb90 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.899424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.942962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:19.947183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.947809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.948087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.948362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.949019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.950937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.968105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93620629-3591-4adf-93f6-efda24f3a637 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.973531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.973682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 881/1771] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:19.974482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.974601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.975032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.975448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.977316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.979577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:19.981699 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 891/1772] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:19.982392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:19.985695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b53d0-7ecf-4087-9d7c-081f814e9c12 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.991341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:19.991942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:19.992824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:19.993110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:19.993760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:19.995209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b044-680d-457f-988f-19b8b5b0a70a tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:19.995657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.000250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.000864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.001185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.001464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.002171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.004059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.019430 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 882/1773] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:19 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:20.020242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 892/1774] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.024194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.024428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.035478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958776db-3156-4009-b54c-52545edfbac0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.036341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df86ed0-ab01-4201-8a81-fa6c36832ab9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.041261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.041917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.042199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.042468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.043125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.043244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.043909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.044256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.044600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.044927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.045412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.048166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.058319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 883/1775] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.061904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.062903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 893/1776] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.068010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.079445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d6ae6-978e-4f12-adcc-229cdda67d20 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.083143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839673-c787-4472-9409-19d2bedcea3a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.084891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.085630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.086032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.086486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.087400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.089073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.089259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.090018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.090362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.090813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] PATH_INFO: `/v3/projects/d1e4d67419ff4527924ff094245c8004/users/4fef60ce3152469e8c131a770f6a55e8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.102683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 884/1777] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:20.106710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.111680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e4d67419ff4527924ff094245c8004, user_id=4fef60ce3152469e8c131a770f6a55e8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.115880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf5a1-2c1a-41a8-99ea-55333fa5c52b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.120125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c0636-9465-4a69-9204-62cf58fa8312 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.129191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.131167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.131727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.132080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] PATH_INFO: `/v3/projects/c6175b9a7762451cbcb57d7d96b630de/users/8f1e42af5ed84f9f855210861ec1e48b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.145440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 894/1778] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/d1e4d67419ff4527924ff094245c8004/users/4fef60ce3152469e8c131a770f6a55e8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:20.147210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce7e3-9df5-45ed-821d-9e9731c9ba37 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.147564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce7e3-9df5-45ed-821d-9e9731c9ba37 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.147913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ce7e3-9df5-45ed-821d-9e9731c9ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.149771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:20.157760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6175b9a7762451cbcb57d7d96b630de, user_id=8f1e42af5ed84f9f855210861ec1e48b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.163051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ec03-2514-4c61-bc59-ec18bb55beec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.183292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 885/1779] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/c6175b9a7762451cbcb57d7d96b630de/users/8f1e42af5ed84f9f855210861ec1e48b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:20.187254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-782ce7e3-9df5-45ed-821d-9e9731c9ba37 None None] MFA Rules not processed for user `4fef60ce3152469e8c131a770f6a55e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:20.188693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-782ce7e3-9df5-45ed-821d-9e9731c9ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:20.194288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.194608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.194902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.236084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] MFA Rules not processed for user `8f1e42af5ed84f9f855210861ec1e48b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:20.236084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:20.279699 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 895/1780] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:20.281166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.281385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.281653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.300700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 886/1781] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:20.301048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] MFA Rules not processed for user `61dd0db9c36e46bdba9f6570379591af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:20.302015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:20.304929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.360288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 896/1782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:20.361144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.371554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b68dc1-bf87-4799-973b-abf0b2313e89 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.372958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b929a0-39aa-496a-811f-4dbd9d1e3d4e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.376066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.376668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.376951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.377256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.377891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.377995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.378590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.378984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.379260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.379773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.380012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.381931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.417898 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 897/1783] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:20.420887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.424933 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 887/1784] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:20.426105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.435472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:20.502193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151e8e9-67df-4569-b346-cbb7c22275d6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.503242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c5022-b0b8-4b98-88ac-8ebf0f2287d2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.507229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.508092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.508284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.508784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.508900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.509486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.509593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.509680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.509981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.510529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.511986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.512689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.526652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:20.540011 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 898/1785] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:20.542560 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 888/1786] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/users => generated 308 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:20.543730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.546355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.556072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31e47-40b7-45ba-8191-53b32aef737e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.557330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b946d0d-5c44-4a4d-906c-de22781c36bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.562259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.562535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.563209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.563856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.563936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.564018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.564089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.564155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.564592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.564695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.566259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.566371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.585333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 889/1788] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.585778 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 899/1788] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.586880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.587596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.599089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121f02-034a-4fe6-90d3-202fd0dc4adb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.602683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924063d-cc5c-4a6f-b42f-28332ca63cde admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.605184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.606190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.606468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.606737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] PATH_INFO: `/v3/projects/cd1b78fb2720437c83019f97bd21085c/users/422e6dd483a049298edad49946ed7bb8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.608702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.609510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.609879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.610154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] PATH_INFO: `/v3/projects/4ec8a482bb3e4edc8774c9b857bad514/users/da77bf441acf4f6a8f0fe782a271795f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.623955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1b78fb2720437c83019f97bd21085c, user_id=422e6dd483a049298edad49946ed7bb8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.626505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec8a482bb3e4edc8774c9b857bad514, user_id=da77bf441acf4f6a8f0fe782a271795f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.628161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.630989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.647608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 900/1789] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/4ec8a482bb3e4edc8774c9b857bad514/users/da77bf441acf4f6a8f0fe782a271795f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:20.651966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.655476 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 890/1790] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/cd1b78fb2720437c83019f97bd21085c/users/422e6dd483a049298edad49946ed7bb8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:20.656456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.735363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1902e-b85b-438b-82c1-6b05db40de50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.741627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.742317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.742585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.742856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.743507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.745146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.749314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122754-e4e3-4d19-be7c-84ed179833d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.760065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.760065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.760065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.760065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.768280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 891/1791] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:20.768572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.768572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.768839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.780089 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 901/1792] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:20.781199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.785948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa268f-6b78-474c-b228-b1accf0a6361 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.791003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.791975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.791975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.792207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] PATH_INFO: `/v3/projects/cd1b78fb2720437c83019f97bd21085c/users/422e6dd483a049298edad49946ed7bb8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.792633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d0e77-6fbc-4e1b-97f3-1c4250e14c43 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.794335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1b78fb2720437c83019f97bd21085c, user_id=422e6dd483a049298edad49946ed7bb8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.797110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de208b-08f5-4756-9a83-090fececedc1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.797636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.798292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.798570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.801135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] PATH_INFO: `/v3/projects/4ec8a482bb3e4edc8774c9b857bad514/users/da77bf441acf4f6a8f0fe782a271795f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.803454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec8a482bb3e4edc8774c9b857bad514, user_id=da77bf441acf4f6a8f0fe782a271795f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.806290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.809018 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 892/1793] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/cd1b78fb2720437c83019f97bd21085c/users/422e6dd483a049298edad49946ed7bb8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:20.819360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e57a-981b-4a2b-99af-5b4349b197e5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.819642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e57a-981b-4a2b-99af-5b4349b197e5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.819909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e57a-981b-4a2b-99af-5b4349b197e5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.822136 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 893/1794] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:20.824064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b30ae-3c23-4dd8-b4fd-3690ba65c7fd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.824349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b30ae-3c23-4dd8-b4fd-3690ba65c7fd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.824624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b30ae-3c23-4dd8-b4fd-3690ba65c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.830983 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 902/1795] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:20 2022] PUT /identity/v3/projects/4ec8a482bb3e4edc8774c9b857bad514/users/da77bf441acf4f6a8f0fe782a271795f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:20.831798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:20.861995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-592b30ae-3c23-4dd8-b4fd-3690ba65c7fd None None] MFA Rules not processed for user `422e6dd483a049298edad49946ed7bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:20.863185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-592b30ae-3c23-4dd8-b4fd-3690ba65c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:20.881512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:20.913123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:20.947859 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 894/1796] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:20.949350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2149cfc-bda8-496f-853a-9c67337ddcc7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.949648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2149cfc-bda8-496f-853a-9c67337ddcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.949954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2149cfc-bda8-496f-853a-9c67337ddcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.980050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b2149cfc-bda8-496f-853a-9c67337ddcc7 None None] MFA Rules not processed for user `da77bf441acf4f6a8f0fe782a271795f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:20.981751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2149cfc-bda8-496f-853a-9c67337ddcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:20.985358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8dffc-6895-4a09-bab8-087328d27bae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:20.989972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:20.990605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:20.990886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:20.991163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:20.992344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:20.994603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:20.996144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:20.996290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 903/1797] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:20.997061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.010928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ec21-96e4-4021-8ae6-17e13e323416 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.017693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.018547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.018900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.019262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.030499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.032085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.043936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 904/1798] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:20 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:21.074496 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 895/1799] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:21.097261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.111721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c980f0-ec39-4296-a440-95a55905a290 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.119165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.123037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.123037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.123037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.139366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.139541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.140060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.140355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.141017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.142493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 896/1800] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 16:01:21.147104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:21.152722 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 905/1801] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:21.165302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.174924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33ad2e-3ab7-4e56-87f4-96dcc279f55e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.179909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.180579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.180815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.181128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.182258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.185987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e72ae-6830-487a-870c-cdccd676b0e6 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.188189 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 897/1802] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:21.217022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.229394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f5e8-e41c-408b-9277-f376d329f0a0 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.235935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.236537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.236817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.237204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.256375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.256652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.256919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.258677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 898/1803] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 16:01:21.263188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:21.278931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.288637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5153-58f3-4e15-9f6d-a60141296e01 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.293922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.294590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.294800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.295193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.296288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.298332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.298452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.299942 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 899/1804] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:21.300068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2a03e-de67-4928-abb7-92ee91fedfa9 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.317181 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 906/1805] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:21.328756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.404407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.405072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.405870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.449898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ab3c1-9708-4355-adf9-8b59d6558f30 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.451973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] MFA Rules not processed for user `61dd0db9c36e46bdba9f6570379591af`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:21.454372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.457219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.457869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.458195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.458463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] PATH_INFO: `/v3/users/8f1e42af5ed84f9f855210861ec1e48b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.460426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1e42af5ed84f9f855210861ec1e48b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.464479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.562252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1e42af5ed84f9f855210861ec1e48b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.563014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1e42af5ed84f9f855210861ec1e48b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.576119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1e42af5ed84f9f855210861ec1e48b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.578303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1e42af5ed84f9f855210861ec1e48b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.579718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.591415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ccc12c6a-0912-498a-8382-3b192c81c943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1e42af5ed84f9f855210861ec1e48b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.607095 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 907/1806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:21.622480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.624018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.629092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 900/1807] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:21 2022] DELETE /identity/v3/users/8f1e42af5ed84f9f855210861ec1e48b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:21.635245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.635733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.637138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.650279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede572b-1ed6-4ebd-9563-91c833852762 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.666502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:21.669022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.681219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:21.759442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.760421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.760723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.761104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.762967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.765347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 901/1808] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:21.781673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.783971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.840339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.841961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.853440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 908/1809] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:21.863359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc325-ec75-43a8-b9b3-d07638fca37f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.872598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.873142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:21.873507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.873894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.874345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.875591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:21.885762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.887507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868aae-9a6f-4f31-9680-0eceba52b9a0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.898011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e200254-af0b-41f9-bd88-45c61baafa07 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:21.915367 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 902/1810] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:21.916033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:21.916870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:21.917962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:21.918311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] PATH_INFO: `/v3/users/4fef60ce3152469e8c131a770f6a55e8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:21.919584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fef60ce3152469e8c131a770f6a55e8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:21.922436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:21.984497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fef60ce3152469e8c131a770f6a55e8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.993332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fef60ce3152469e8c131a770f6a55e8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:21.994022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fef60ce3152469e8c131a770f6a55e8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.008285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fef60ce3152469e8c131a770f6a55e8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.009090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e669035-8d68-4fd7-9f68-0b1c3da4ee54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fef60ce3152469e8c131a770f6a55e8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.043273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 909/1811] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:21 2022] DELETE /identity/v3/users/4fef60ce3152469e8c131a770f6a55e8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:22.047838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.048228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.048406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.077833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:22.079541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.177709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.178042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.178321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.179696 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 910/1812] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 16:01:22.187122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:01:22.187434 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 903/1813] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:22.192743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.199533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.201080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.207041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:22.290881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510110b7-c66a-4e8f-a635-53fc89312e0d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.295438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.296458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.296458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.296646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.301829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.303418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.306500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.307919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.313138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:22.321293 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 904/1814] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:22.376428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bbdc4-4bd1-499f-bda8-fcbbf1da706e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.380903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddb1acb193e4d22b664431fd2895e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0da166cd049618bd0e00cfdfd7eff', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.381556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.381831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.382098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.383996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorizing `identity:get_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.386060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.387868 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 911/1815] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:01:22 2022] GET /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 383 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:22.490895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.494587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.506542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.509740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.527967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5f10c-c82f-4563-9bf9-683a6574f421 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.530244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afce0b-82a5-431a-b36b-5ab7940d6bc7 tempest-QuotasAdminNegativeTest-989976896 tempest-QuotasAdminNegativeTest-989976896-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.536815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.537481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.538137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.538422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] PATH_INFO: `/v3/projects/c6175b9a7762451cbcb57d7d96b630de` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.541741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6175b9a7762451cbcb57d7d96b630de)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.542636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.543277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.543549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.543852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] PATH_INFO: `/v3/users/61dd0db9c36e46bdba9f6570379591af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.546116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.547062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dd0db9c36e46bdba9f6570379591af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.550882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.616109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6175b9a7762451cbcb57d7d96b630de', 'request_id': 'req-192a31c9-449a-4b19-a41e-195a23ceff40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.626392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6175b9a7762451cbcb57d7d96b630de', 'request_id': 'req-192a31c9-449a-4b19-a41e-195a23ceff40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.628819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dd0db9c36e46bdba9f6570379591af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.638226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6175b9a7762451cbcb57d7d96b630de', 'request_id': 'req-192a31c9-449a-4b19-a41e-195a23ceff40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.641419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dd0db9c36e46bdba9f6570379591af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.642590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dd0db9c36e46bdba9f6570379591af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.653477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] The token cache is being invalidate because project c6175b9a7762451cbcb57d7d96b630de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:22.653782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.654433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.656114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dd0db9c36e46bdba9f6570379591af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.656379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 905/1816] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:22 2022] DELETE /identity/v3/projects/c6175b9a7762451cbcb57d7d96b630de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:22.657282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73cb6354-1e98-47e2-b41b-2f37a998e8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dd0db9c36e46bdba9f6570379591af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.660445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.665301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.680775 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 912/1817] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:22 2022] DELETE /identity/v3/users/61dd0db9c36e46bdba9f6570379591af => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:22.690002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.690294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.690584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.714808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:22.717212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.734649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:22.767541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a31c9-449a-4b19-a41e-195a23ceff40 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.841545 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 913/1818] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:22.842852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.844158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:22.859684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfca1d-80c7-4258-a23d-db2b483bdc13 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:22.864795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.865493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.865768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.866035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] PATH_INFO: `/v3/projects/d1e4d67419ff4527924ff094245c8004` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.868845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e4d67419ff4527924ff094245c8004)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.870737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.893296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:22.893947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:22.894223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:22.894979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] PATH_INFO: `/v3/users/da77bf441acf4f6a8f0fe782a271795f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:22.896200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da77bf441acf4f6a8f0fe782a271795f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:22.900697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:22.946552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e4d67419ff4527924ff094245c8004', 'request_id': 'req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.955337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e4d67419ff4527924ff094245c8004', 'request_id': 'req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.962999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e4d67419ff4527924ff094245c8004', 'request_id': 'req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.970777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:22.985396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] The token cache is being invalidate because project d1e4d67419ff4527924ff094245c8004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:22.985693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.986438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:22.989182 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 914/1819] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:22 2022] DELETE /identity/v3/projects/d1e4d67419ff4527924ff094245c8004 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:22.990185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:22.991869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.002867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da77bf441acf4f6a8f0fe782a271795f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.003801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da77bf441acf4f6a8f0fe782a271795f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.011970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da77bf441acf4f6a8f0fe782a271795f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.012750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da77bf441acf4f6a8f0fe782a271795f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.021519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da77bf441acf4f6a8f0fe782a271795f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.043347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 906/1820] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:22 2022] DELETE /identity/v3/users/da77bf441acf4f6a8f0fe782a271795f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:23.044247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:23.045761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.075370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e69a1-2d9d-47a0-92be-be5bbe5e4c6a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:23.137924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aa8cd-6652-4f07-9c6c-c7809cf5be88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:23.147161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:23.148899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.149585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.150058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] PATH_INFO: `/v3/users/422e6dd483a049298edad49946ed7bb8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:23.152203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422e6dd483a049298edad49946ed7bb8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:23.155055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:23.183684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:23.184300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.184569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.184842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:23.191690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.218587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:23.224609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:23.230377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:23.248207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 915/1821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:23.256924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422e6dd483a049298edad49946ed7bb8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.257681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422e6dd483a049298edad49946ed7bb8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.269248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422e6dd483a049298edad49946ed7bb8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.270160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422e6dd483a049298edad49946ed7bb8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.284115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422e6dd483a049298edad49946ed7bb8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.309099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 907/1822] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:23 2022] DELETE /identity/v3/users/422e6dd483a049298edad49946ed7bb8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:23.572242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:23.573883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.604143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a824-9750-44e5-aadb-d67b8ac569f6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:23.743963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:23.744474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.744772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.745114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] PATH_INFO: `/v3/projects/4ec8a482bb3e4edc8774c9b857bad514` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:23.746948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec8a482bb3e4edc8774c9b857bad514)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:23.749079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:23.788928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:23.790687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.811804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fe216-b4a6-4970-a6fe-ec496ecaab71 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:23.824211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec8a482bb3e4edc8774c9b857bad514', 'request_id': 'req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.832493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec8a482bb3e4edc8774c9b857bad514', 'request_id': 'req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.840472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec8a482bb3e4edc8774c9b857bad514', 'request_id': 'req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.856601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:23.857373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] The token cache is being invalidate because project 4ec8a482bb3e4edc8774c9b857bad514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:23.857845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.858816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.861088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 916/1823] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:23 2022] DELETE /identity/v3/projects/4ec8a482bb3e4edc8774c9b857bad514 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:23.862727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:23.865252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:23.893095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:23.893724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.894018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.894296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] PATH_INFO: `/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:23.895383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923fa1b9a3e2461fa0f7fea416c5a986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:23.897308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:23.936709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad2f93-aea8-4c5b-94e8-ef1cca0dccc2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:23.948333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923fa1b9a3e2461fa0f7fea416c5a986', 'request_id': 'req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.956729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923fa1b9a3e2461fa0f7fea416c5a986', 'request_id': 'req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.964368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923fa1b9a3e2461fa0f7fea416c5a986', 'request_id': 'req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.970352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:23.975425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] The token cache is being invalidate because project 923fa1b9a3e2461fa0f7fea416c5a986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:23.975712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.976414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b838216d-adbe-4917-b3fb-6ccf4f5ef0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:23.978110 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 908/1824] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:23 2022] DELETE /identity/v3/projects/923fa1b9a3e2461fa0f7fea416c5a986 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:23.982402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.982685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.982954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:23.998366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:23.999000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:23.999276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:23.999545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] PATH_INFO: `/v3/projects/cd1b78fb2720437c83019f97bd21085c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.000660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1b78fb2720437c83019f97bd21085c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.002853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.007166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.009376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.025182 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 909/1825] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.025182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.025182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.033554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da96c83-4c9e-4038-b959-952da79f286e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.038762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.040094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.040468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.040743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] PATH_INFO: `/v3/users/3ddb1acb193e4d22b664431fd2895e50` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.041929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddb1acb193e4d22b664431fd2895e50)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.043832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.059764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1b78fb2720437c83019f97bd21085c', 'request_id': 'req-71988747-d294-46df-accf-24c04cce5855'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.066655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1b78fb2720437c83019f97bd21085c', 'request_id': 'req-71988747-d294-46df-accf-24c04cce5855'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.072877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1b78fb2720437c83019f97bd21085c', 'request_id': 'req-71988747-d294-46df-accf-24c04cce5855'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.087822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] The token cache is being invalidate because project cd1b78fb2720437c83019f97bd21085c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:24.088105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.088773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71988747-d294-46df-accf-24c04cce5855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.090543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 917/1826] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:23 2022] DELETE /identity/v3/projects/cd1b78fb2720437c83019f97bd21085c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:24.091502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.091782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.092052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.099506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddb1acb193e4d22b664431fd2895e50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.100187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddb1acb193e4d22b664431fd2895e50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.111859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddb1acb193e4d22b664431fd2895e50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.112573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddb1acb193e4d22b664431fd2895e50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.115539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.116751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.121471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-464cb258-eba4-49f2-be70-242bf4f65f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddb1acb193e4d22b664431fd2895e50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.145148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 910/1827] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:24 2022] DELETE /identity/v3/users/3ddb1acb193e4d22b664431fd2895e50 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:24.147142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.147619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.147910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.172793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.173995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.202180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:24.230844 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 918/1828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.230844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.230844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.252052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 911/1829] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.252985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.265240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311e5ec-2851-4404-a99a-c853dde1c4d5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.271032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.272270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.273024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.274053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.275374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:24.275972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.278425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a26fc-db8c-4b58-9099-70cee75fe830 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.292954 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 912/1830] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:24.298398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.298685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.299023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.332818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.333375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f65c-5540-4e3b-869a-f12761e87a4e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.334289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.334867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:24.346778 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 913/1831] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.347415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.363382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa494-9598-4c3f-ab74-711bc5104725 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.369532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.370381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.370532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.370710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.371345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.373350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.409991 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 914/1832] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:24.409991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.433049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.433763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.434097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.434439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.437468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.480087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e33cf-7d4a-420a-a350-693ff7bd9aac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.486487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.487171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.487450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.487721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.488411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:24.488716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.491627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.513142 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 915/1833] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:24.513142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.520468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02300f3-3a10-40ac-80ea-8f5fd33629ae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.528387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.530150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.530500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.530789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.532204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.537411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.547419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.548917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.566072 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 916/1834] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:24.570671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.581217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc174e-331a-42ae-aed2-a4f80b88a0fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.585207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 919/1835] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:24.587246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.587584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.587859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.588128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.588760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.591048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.592044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.594967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.613189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba78221-d9ad-4319-b221-2016fe157652 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.620564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.621264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.621544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.621816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] PATH_INFO: `/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.629952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf0da166cd049618bd0e00cfdfd7eff)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.633341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.646215 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 917/1836] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:24.646215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.705296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf0da166cd049618bd0e00cfdfd7eff', 'request_id': 'req-9a964b93-2349-4940-b503-94f6054ed0e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.706687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:24.717683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf0da166cd049618bd0e00cfdfd7eff', 'request_id': 'req-9a964b93-2349-4940-b503-94f6054ed0e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.729988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf0da166cd049618bd0e00cfdfd7eff', 'request_id': 'req-9a964b93-2349-4940-b503-94f6054ed0e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.750415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] The token cache is being invalidate because project 8bf0da166cd049618bd0e00cfdfd7eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:24.751070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.752093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:24.754009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d171f9-c8de-4a72-a27c-bbcbed3be3ca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.754914 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 920/1837] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:24 2022] DELETE /identity/v3/projects/8bf0da166cd049618bd0e00cfdfd7eff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:24.756338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.761950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.805288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:24.846699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.847304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.847576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.847841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.848483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.850090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b161367-7707-4798-a40a-f4f9ba45cedc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.860649 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 918/1838] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:24.864866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964b93-2349-4940-b503-94f6054ed0e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.871946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.872737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.873043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.873397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.873503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.873697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.873969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.874324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.876361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.901133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.902410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.906345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 921/1839] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:24.907295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.909026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.921606 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 919/1840] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.921606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.926603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e24b4-c809-484e-ad8d-8a5371a24759 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.932318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0c9a1-2fb2-4847-b606-58a604356918 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.939500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.940303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.940303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.940546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.941457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.945649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a9e04-65d0-48b8-8212-c5f96b7ef3f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.945773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.945773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.945773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.945773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.946050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:24.947452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:24.957415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 922/1841] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:24.961584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 920/1842] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:24.961584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:24.961806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.962001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.962272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.971483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db9f7-9bff-47d9-ae37-57446f0e2cda admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:24.976605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:24.978565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:24.979053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:24.979518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] PATH_INFO: `/v3/projects/eb88ccffb014497b801541b53d8bb505/users/40da67f39f4d4a6fb25ea033b0f14071/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:24.982383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:24.983602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:24.992811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 923/1843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:24.993554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.003385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb88ccffb014497b801541b53d8bb505, user_id=40da67f39f4d4a6fb25ea033b0f14071, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.006277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c898c59-1439-4b10-89ea-5b1fd5d07086 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.006680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.019454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.020175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.020532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.020805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.021601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.023437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d012b-a8e5-4856-8f85-66821fc768a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.028381 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 921/1844] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:24 2022] PUT /identity/v3/projects/eb88ccffb014497b801541b53d8bb505/users/40da67f39f4d4a6fb25ea033b0f14071/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:25.029230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.034542 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 924/1845] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:25.036018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.036304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.036569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.057213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:25.058446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:25.094801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fabfca-58ad-4738-b225-b41a93ae977d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.099729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.100330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.100607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.100883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.102090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:25.102389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.104100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.116576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 922/1846] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:25.118444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.121282 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 925/1847] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:25.122204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.129236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17879499-3ff0-4f96-99c8-a4993262f59a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.132053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781515-df0b-4181-b04a-c0b7b12fda1a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.133892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.134534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.134807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.135069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] PATH_INFO: `/v3/projects/63444a4996f445398a0f529e53ed5d7a/users/be47a02c67bc4697b77ebf7a21dc9c49/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.137013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.137628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.137901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.138172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.138814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.140687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe35701-3fd5-43dc-baa6-487a18014a89 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.150043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63444a4996f445398a0f529e53ed5d7a, user_id=be47a02c67bc4697b77ebf7a21dc9c49, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.153230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.167318 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 923/1848] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:25 2022] PUT /identity/v3/projects/63444a4996f445398a0f529e53ed5d7a/users/be47a02c67bc4697b77ebf7a21dc9c49/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:25.168309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.169860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:25.173454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 926/1849] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:25.175588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.175962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.176238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.184779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:25.197274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:25.198473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:25.233418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046649e7-5400-4e39-8f0b-b521e998de0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.251220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:25.261873 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 927/1850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:25.262699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.272197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c7f95-9a1d-4e3c-bc9e-5dc9f95d3fe1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.277732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.278334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.278614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.278882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.279543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.281505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.288632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.289381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.289638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.289917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.299692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.301181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.304946 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 928/1851] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:25.305978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.311262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 924/1852] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:25.312061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.317830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616664b6-d2b2-45b3-a2eb-8982551296c8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.321814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.322063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e7581-2800-4d2b-ad8c-cfcda1f407ea service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.322463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.322753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.323025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.327039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.327704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.327956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.328226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.328868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.330476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.333587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.335149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.344191 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 925/1853] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:25.347321 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 929/1854] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:25.347991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.358968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84807214-9bb5-4035-9635-08bd0b6a5ceb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.363741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.364415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.364698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.364967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.365624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.368037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2ee8a-e9a0-418e-9171-b22d7cdab9be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.378066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 926/1855] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:25.382392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.393765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8f34b-21ad-4c23-932f-c18eec557680 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.399691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.400348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.400624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.400964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] PATH_INFO: `/v3/projects/d3a3257e135e42b4848850358a05cd5f/users/e087a69e4fcf42849e275585aa0b9da6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.417928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a3257e135e42b4848850358a05cd5f, user_id=e087a69e4fcf42849e275585aa0b9da6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.420717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.434599 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 930/1856] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:25 2022] PUT /identity/v3/projects/d3a3257e135e42b4848850358a05cd5f/users/e087a69e4fcf42849e275585aa0b9da6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:25.444704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.445061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.445477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.474989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] MFA Rules not processed for user `e087a69e4fcf42849e275585aa0b9da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:25.476316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:25.548688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 927/1857] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:25.553996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.629049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eb988-731e-4ab1-ae12-30a37c751902 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.634126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.634830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.635174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.635514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.636335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.638480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.671823 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 931/1858] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:25.673154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.683950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f79cf-7e98-46c1-bf97-116d98c10161 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.720791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:25.758056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.758875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.759153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.759420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.760063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.762040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.786746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 928/1859] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:25 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:25.791407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.801866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5160b-1d9a-473f-a785-c88a1ed231ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.806916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.807527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.807793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.808058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.808700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.810327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.826469 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 932/1860] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:25.827957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.839719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcba3bd-9ba3-445f-a3b7-d019fe3a9eb7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.844715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.845408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.845687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.845962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] PATH_INFO: `/v3/projects/591e8468e3d84735b18c3f67a6c83b34/users/ba8180d7d8f440e5af23666047126124/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.862558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591e8468e3d84735b18c3f67a6c83b34, user_id=ba8180d7d8f440e5af23666047126124, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.865555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.881502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 929/1861] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:25 2022] PUT /identity/v3/projects/591e8468e3d84735b18c3f67a6c83b34/users/ba8180d7d8f440e5af23666047126124/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:25.883634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.894015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cce3a-55b9-4a59-ba6d-de5d603a9e5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.956297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.957313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.957997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.957997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.958514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:25.960141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93490e-2eec-43cb-b817-924b6ccc2075 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:25.975861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 933/1862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:25.978134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:25.989415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1860b-03a0-4d56-bd71-3498dc6daf89 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:25.995127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:25.995808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:25.996086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:25.997160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] PATH_INFO: `/v3/projects/591e8468e3d84735b18c3f67a6c83b34/users/ba8180d7d8f440e5af23666047126124/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:25.998371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591e8468e3d84735b18c3f67a6c83b34, user_id=ba8180d7d8f440e5af23666047126124, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:26.001137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c615-c37b-4463-9182-3201e3ffd4f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:26.013502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 930/1863] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:25 2022] PUT /identity/v3/projects/591e8468e3d84735b18c3f67a6c83b34/users/ba8180d7d8f440e5af23666047126124/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:26.024880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:26.026704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:26.026704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:26.072512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] MFA Rules not processed for user `ba8180d7d8f440e5af23666047126124`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:26.074098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:26.079280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:26.247379 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 934/1864] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:26.251793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e3d0-53ff-438e-a7ab-da1ff442660f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:26.252013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e3d0-53ff-438e-a7ab-da1ff442660f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:26.252268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97e3d0-53ff-438e-a7ab-da1ff442660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:26.291047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc97e3d0-53ff-438e-a7ab-da1ff442660f None None] MFA Rules not processed for user `e087a69e4fcf42849e275585aa0b9da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:26.293892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc97e3d0-53ff-438e-a7ab-da1ff442660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:26.421839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 931/1865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:26.454654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:26.456240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:26.583133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec119bc-245e-465f-bb87-5dfd956d0009 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:26.591418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:26.592046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:26.592321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:26.592587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:26.605805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:26.607727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014345d-8425-4b5f-af9b-7f9446a4ed05 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:26.618158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 935/1866] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:29.399062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:29.399566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:29.399566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:29.401542 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 932/1867] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:29.407949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f2e7-face-4456-a341-f3e2f5bf8962 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:29.407949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f2e7-face-4456-a341-f3e2f5bf8962 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:29.408609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5f2e7-face-4456-a341-f3e2f5bf8962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:29.431281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b3c5f2e7-face-4456-a341-f3e2f5bf8962 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:29.432699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3c5f2e7-face-4456-a341-f3e2f5bf8962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:29.543727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 936/1868] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:29.571033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:29.573018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:29.597708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b042a-8493-4eaf-87fa-89bf9f828518 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:29.606304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:29.606304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:29.606304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:29.606304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:29.620412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:29.622201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:29.639368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 933/1869] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:30.173501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cd18-9f6c-49a8-9bfb-5fcf57693878 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:30.174024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cd18-9f6c-49a8-9bfb-5fcf57693878 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:30.174448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668cd18-9f6c-49a8-9bfb-5fcf57693878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:30.200419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3668cd18-9f6c-49a8-9bfb-5fcf57693878 None None] MFA Rules not processed for user `f01c86c8f32c4035a71dd59fc55eccdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:30.201958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3668cd18-9f6c-49a8-9bfb-5fcf57693878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:30.228945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:30.274803 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 937/1870] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:31.539782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:31.541375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:31.771728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6115-c55d-4b5d-8f36-8ad9143a5cd9 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:31.787691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:31.789226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:31.789650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:31.791175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] PATH_INFO: `/v3/users/5b1a3f75cdfa416c97694d6b409cfa9e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:31.794625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1a3f75cdfa416c97694d6b409cfa9e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:31.799186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:31.858185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:31.985656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1a3f75cdfa416c97694d6b409cfa9e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:31.987633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1a3f75cdfa416c97694d6b409cfa9e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:32.008731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1a3f75cdfa416c97694d6b409cfa9e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:32.010712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1a3f75cdfa416c97694d6b409cfa9e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:32.032002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1a3f75cdfa416c97694d6b409cfa9e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:32.097094 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 934/1871] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:31 2022] DELETE /identity/v3/users/5b1a3f75cdfa416c97694d6b409cfa9e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:32.100067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:32.100571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:32.101542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:32.135141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:32.137892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:32.282438 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 938/1872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:32.292391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:32.293978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:32.470869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e13732-e46e-438c-b5bb-b2b13f41cf66 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:32.486186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:32.488674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:32.488952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:32.493758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:32.532414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:32.534548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:32.599431 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 935/1873] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:33.024073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:33.026142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:33.183229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e57148-5d08-4cc6-84be-ce4dce0f1949 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:33.200936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:33.203746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:33.221306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:33.224129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:33.225927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:33.226318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:33.233361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553f13d-a31a-4a98-a35a-e1c5abd2ebea service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:33.234755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:33.250873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:33.254593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:33.255055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:33.256630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] PATH_INFO: `/v3/projects/35d74b4355864dcdb903615bc54efd65` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:33.262849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d74b4355864dcdb903615bc54efd65)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:33.265630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:33.343656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d74b4355864dcdb903615bc54efd65', 'request_id': 'req-f6c3f703-6bca-4aaf-be22-f7891140c2f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.353919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d74b4355864dcdb903615bc54efd65', 'request_id': 'req-f6c3f703-6bca-4aaf-be22-f7891140c2f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.368477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d74b4355864dcdb903615bc54efd65', 'request_id': 'req-f6c3f703-6bca-4aaf-be22-f7891140c2f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.382783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] The token cache is being invalidate because project 35d74b4355864dcdb903615bc54efd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:33.383172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.383682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:33.383942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.385590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:33.389266 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 936/1874] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:33 2022] DELETE /identity/v3/projects/35d74b4355864dcdb903615bc54efd65 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:33.390237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:33.391735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:33.405653 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 939/1875] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:33.471409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:33.535644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f703-6bca-4aaf-be22-f7891140c2f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:33.547102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:33.551928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:33.552276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:33.552563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] PATH_INFO: `/v3/users/fa7f28118bd44e5795955015f2db1402` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:33.553847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7f28118bd44e5795955015f2db1402)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:33.555957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:33.654707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7f28118bd44e5795955015f2db1402'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.655847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7f28118bd44e5795955015f2db1402'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.664985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7f28118bd44e5795955015f2db1402'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.666297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7f28118bd44e5795955015f2db1402'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.682373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2cb0aa3e-a1e5-4c8d-a4b1-45c6b451116c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7f28118bd44e5795955015f2db1402'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:33.730799 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 937/1876] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:33 2022] DELETE /identity/v3/users/fa7f28118bd44e5795955015f2db1402 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:34.395813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:34.404293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:34.411692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cb1f-f697-4143-a70e-7543205b19b3 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:34.488681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:34.489912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:34.490457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:34.490960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] PATH_INFO: `/v3/projects/b21d626f1394465a894d31abc8bbe7f2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:34.492729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21d626f1394465a894d31abc8bbe7f2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:34.496208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:34.626456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21d626f1394465a894d31abc8bbe7f2', 'request_id': 'req-c3a212ee-bedd-449e-a367-51c58f65559a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:34.642342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21d626f1394465a894d31abc8bbe7f2', 'request_id': 'req-c3a212ee-bedd-449e-a367-51c58f65559a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:34.652891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21d626f1394465a894d31abc8bbe7f2', 'request_id': 'req-c3a212ee-bedd-449e-a367-51c58f65559a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:34.674158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] The token cache is being invalidate because project b21d626f1394465a894d31abc8bbe7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:34.674763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:34.675486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3a212ee-bedd-449e-a367-51c58f65559a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:34.677265 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 940/1877] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:34 2022] DELETE /identity/v3/projects/b21d626f1394465a894d31abc8bbe7f2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:34.682510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:34.683003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:34.683082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:34.711969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:34.713389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:34.850585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 938/1878] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:34.851143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:34.851426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:34.851692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:34.891704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:34.897314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:34.916785 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 941/1879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:34.917827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:34.924139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:34.930343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:34.944300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b13782-ac14-49c8-82b9-ff6a2027db5e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:34.965751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:34.966544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:34.966917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:34.967435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80601fc0-4ecb-4e5e-91b7-d1e4b0d7a131 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:34.974142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:34.975371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:34.975805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:34.978930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:34.979986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:34.981197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:34.981612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:34.982009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] PATH_INFO: `/v3/users/8820c273919741fa8a16b0486dabb283` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:34.983542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8820c273919741fa8a16b0486dabb283)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:34.987000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.005603 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 939/1880] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:35.008173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.028545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c952635-ecc8-4de9-8e7b-be5b539ab7ff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.036486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.037161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.037442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.037889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.039345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.041763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.080380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8820c273919741fa8a16b0486dabb283'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:35.080539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 940/1881] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:35 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:35.084277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.093539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8820c273919741fa8a16b0486dabb283'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:35.095950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8820c273919741fa8a16b0486dabb283'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:35.096943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:35.111913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8820c273919741fa8a16b0486dabb283'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:35.118075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-379791e7-280e-4ef9-9074-6e973a26b7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8820c273919741fa8a16b0486dabb283'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:35.145843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:35.157994 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 942/1882] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:34 2022] DELETE /identity/v3/users/8820c273919741fa8a16b0486dabb283 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:35.162165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.162523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.163001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.189080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dac17-3b10-451d-9296-3ac6631527fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.196565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:35.198336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:35.298309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.299548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.301658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.302133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.303095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.307345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.328078 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 943/1883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:35.340034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.341914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:35.347711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 941/1884] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:35 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:35.353738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.356153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:35.376891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c72962-f8a1-461a-91b9-2d779bd2e479 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.384056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.385152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.385643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.386585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.387329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.412495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.432884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fcc04-1746-47c8-bc92-3107c5e75866 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.438672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.439898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.440380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.440843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.448401 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 942/1885] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:35.450650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.459786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.462283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.477236 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 944/1886] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:35.479665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189511-2030-4b98-90bb-9087278a9eea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.491696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.492357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.492650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.492914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.498451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.500220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42470ed0-91b5-4022-a384-2a02b5ac3485 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.516303 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 943/1887] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:35.521275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:35.545238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f448-a189-46d2-a504-50c6c8092597 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:35.552561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:35.553291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.554290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.554781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] PATH_INFO: `/v3/projects/a561a55f57f84b06abe9e7c932dbb470/users/ac9ce6da395b4c2b9bcce789fbb307b4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.586513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a561a55f57f84b06abe9e7c932dbb470, user_id=ac9ce6da395b4c2b9bcce789fbb307b4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:35.592050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:35.617417 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 945/1888] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:35 2022] PUT /identity/v3/projects/a561a55f57f84b06abe9e7c932dbb470/users/ac9ce6da395b4c2b9bcce789fbb307b4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:35.630717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:35.631612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:35.631976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:35.722340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] MFA Rules not processed for user `ac9ce6da395b4c2b9bcce789fbb307b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:35.725595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:35.937395 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 944/1889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:35.942699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.129835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dac84c-3c55-48ff-96ba-cd66f9df974f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.135769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.136539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.136946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.137351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.138114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.140130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.182111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.185062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:36.203597 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 946/1890] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:35 2022] POST /identity/v3/projects => generated 397 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:36.206107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.215248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:36.220250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b6052-bca3-4c19-b9f2-d838e9daee76 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.234042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:36.348065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f082-7620-4c6c-a25a-bae8fd697f48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.353464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.354299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.354455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.354663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.355274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.358391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.359780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.361651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.361651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.362132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] PATH_INFO: `/v3/users/76287c8ded5f4077bd8c2817b14fb03f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.365372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76287c8ded5f4077bd8c2817b14fb03f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.371285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.405383 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 947/1891] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:36 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:36.409445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.432917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec080-8562-4f0d-962f-19ba9ca64d27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.445842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.446492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.446769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.447037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.447697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.449763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.476372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 948/1892] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:36.484730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.496495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2cbe6-7f26-4e3f-a377-ac03da5368fa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.518699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76287c8ded5f4077bd8c2817b14fb03f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:36.518919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.519470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76287c8ded5f4077bd8c2817b14fb03f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:36.519716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.520001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.520273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] PATH_INFO: `/v3/projects/60ec1e213c5847bba717b4ff4a1306b7/users/bfcc8a9daba9466d87f6739c6be8a1bf/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.542530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76287c8ded5f4077bd8c2817b14fb03f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:36.544843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76287c8ded5f4077bd8c2817b14fb03f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:36.552559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ec1e213c5847bba717b4ff4a1306b7, user_id=bfcc8a9daba9466d87f6739c6be8a1bf, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.555634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.557296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-473cf381-45a1-49df-8e72-93d6246be00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76287c8ded5f4077bd8c2817b14fb03f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:36.584409 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 949/1893] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:36 2022] PUT /identity/v3/projects/60ec1e213c5847bba717b4ff4a1306b7/users/bfcc8a9daba9466d87f6739c6be8a1bf/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:36.586703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.593960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:36.623326 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 945/1894] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:36 2022] DELETE /identity/v3/users/76287c8ded5f4077bd8c2817b14fb03f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:36.630061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.630346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.631258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.692025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:36.693100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:36.782025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e7cd9-9a5e-4ab2-8cbd-de4d56b64591 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.837905 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 946/1895] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:36.867420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.868913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:36.899939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.900695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.901188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.901467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.902144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:36.908363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:36.927832 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 950/1896] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:36.934974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:36.948477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:36.962166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:36.978280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8584f52-ed31-450a-b893-6b30cf631481 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:36.990914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:36.991564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:36.991900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:36.992183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] PATH_INFO: `/v3/projects/60ec1e213c5847bba717b4ff4a1306b7/users/bfcc8a9daba9466d87f6739c6be8a1bf/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:36.994992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ec1e213c5847bba717b4ff4a1306b7, user_id=bfcc8a9daba9466d87f6739c6be8a1bf, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:37.002066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8281a7-dae9-4b38-97a6-8546a6a09c50 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:37.014769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca448fe2-44ce-4d77-ac87-f541c4903075 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:37.017134 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 951/1897] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:36 2022] PUT /identity/v3/projects/60ec1e213c5847bba717b4ff4a1306b7/users/bfcc8a9daba9466d87f6739c6be8a1bf/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:37.031440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:37.034299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:37.035746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:37.103475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] MFA Rules not processed for user `bfcc8a9daba9466d87f6739c6be8a1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:37.104803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:37.126654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:37.127368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:37.127718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:37.127993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:37.265376 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 952/1898] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:37.266262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:37.267784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:37.269270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:37.275551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:37.294108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 947/1899] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:37.295376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38855a-3828-4d65-b1ac-790aea82b98a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:37.300728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:37.301499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:37.301848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:37.302188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] PATH_INFO: `/v3/projects/187142db0e8645c6a31350392a6b5d33` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:37.303412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187142db0e8645c6a31350392a6b5d33)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:37.305798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:37.368386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187142db0e8645c6a31350392a6b5d33', 'request_id': 'req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.376937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187142db0e8645c6a31350392a6b5d33', 'request_id': 'req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.384299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187142db0e8645c6a31350392a6b5d33', 'request_id': 'req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.394839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:37.397316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:37.423194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] The token cache is being invalidate because project 187142db0e8645c6a31350392a6b5d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:37.425660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.429718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.432123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 953/1900] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:37 2022] DELETE /identity/v3/projects/187142db0e8645c6a31350392a6b5d33 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:37.437681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:37.441364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:37.593809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19998ade-516f-4fd4-91ab-d5946a6f90f0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:37.598395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:37.609684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ab69-bb2a-4d97-b54a-36a1ff630be2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:37.673233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:37.673912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:37.674193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:37.674468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] PATH_INFO: `/v3/users/9b5e11548f6b44a2a202c8ff7d8d5705` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:37.677135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5e11548f6b44a2a202c8ff7d8d5705)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:37.679635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:37.731378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:37.790258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5e11548f6b44a2a202c8ff7d8d5705'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.811887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5e11548f6b44a2a202c8ff7d8d5705'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.812659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5e11548f6b44a2a202c8ff7d8d5705'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.829800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:37.831446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:37.831760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:37.832013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:37.835005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5e11548f6b44a2a202c8ff7d8d5705'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.835758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5e11548f6b44a2a202c8ff7d8d5705'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:37.838070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:37.886687 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 954/1901] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:37 2022] DELETE /identity/v3/users/9b5e11548f6b44a2a202c8ff7d8d5705 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:37.957908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:37.961477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:37.992206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 948/1902] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:38.066456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:38.069924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:38.209982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117b060-ac2c-4de9-ae20-a3905b64c55d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:38.218146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:38.219328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:38.219868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:38.220302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:38.224446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:38.320336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:38.321824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:38.349365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b820bee-76c1-44a9-b8ba-43f54cac1390 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:38.377849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:38.380109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:38.428517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 955/1903] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:38.450042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:38.453350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:38.486163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:38.488063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:38.488750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:38.489151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:38.489433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] PATH_INFO: `/v3/projects/174f2eeb6cc948ec8e086efad11449a1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:38.494171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174f2eeb6cc948ec8e086efad11449a1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:38.501341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:38.662750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8dbc-e2e2-4de8-8920-219bc122a668 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:38.685773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174f2eeb6cc948ec8e086efad11449a1', 'request_id': 'req-e9754fdb-569d-4719-9712-38eada9059b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:38.702889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174f2eeb6cc948ec8e086efad11449a1', 'request_id': 'req-e9754fdb-569d-4719-9712-38eada9059b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:38.720446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174f2eeb6cc948ec8e086efad11449a1', 'request_id': 'req-e9754fdb-569d-4719-9712-38eada9059b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:38.770546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] The token cache is being invalidate because project 174f2eeb6cc948ec8e086efad11449a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:38.770833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:38.775810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:38.791911 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 949/1904] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:38 2022] DELETE /identity/v3/projects/174f2eeb6cc948ec8e086efad11449a1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:38.795596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:38.801445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:38.814415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:38.862788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:38.863449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:38.874615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:38.874965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] PATH_INFO: `/v3/projects/eedcd670e5b4403081b32b8c79fec62a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:38.876372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedcd670e5b4403081b32b8c79fec62a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:38.878358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:38.977234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754fdb-569d-4719-9712-38eada9059b9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.005362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedcd670e5b4403081b32b8c79fec62a', 'request_id': 'req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.021656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedcd670e5b4403081b32b8c79fec62a', 'request_id': 'req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.038491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedcd670e5b4403081b32b8c79fec62a', 'request_id': 'req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.075074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] The token cache is being invalidate because project eedcd670e5b4403081b32b8c79fec62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:39.075384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.076514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e8812e9-5822-4ca7-b69b-ebbd65a7867a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.078861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 956/1905] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:38 2022] DELETE /identity/v3/projects/eedcd670e5b4403081b32b8c79fec62a => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:39.090431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.090907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.091197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.125216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:39.126737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:39.128690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:39.130632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.130923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.131195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] PATH_INFO: `/v3/users/14a286ff6df64de9a3ec05c669d7abfc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.134024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a286ff6df64de9a3ec05c669d7abfc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:39.136352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:39.143718 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 957/1906] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:39.145056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:39.147352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:39.160068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fbc6a-948f-4057-a486-1ca7d3f80dbf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.166576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:39.167464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.167928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.168388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] PATH_INFO: `/v3/users/ac9ce6da395b4c2b9bcce789fbb307b4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.169865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9ce6da395b4c2b9bcce789fbb307b4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:39.171994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:39.231701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a286ff6df64de9a3ec05c669d7abfc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.233246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a286ff6df64de9a3ec05c669d7abfc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.235926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:39.255797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9ce6da395b4c2b9bcce789fbb307b4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.258187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a286ff6df64de9a3ec05c669d7abfc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.258942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a286ff6df64de9a3ec05c669d7abfc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.277553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de87e85-4023-4898-aa6b-e7fc7e40aa80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a286ff6df64de9a3ec05c669d7abfc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.290706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9ce6da395b4c2b9bcce789fbb307b4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.291704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9ce6da395b4c2b9bcce789fbb307b4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.308800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9ce6da395b4c2b9bcce789fbb307b4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.310454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa056ae2-c877-41d2-9801-7cc0b5f1bb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9ce6da395b4c2b9bcce789fbb307b4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:39.328125 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 950/1907] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:38 2022] DELETE /identity/v3/users/14a286ff6df64de9a3ec05c669d7abfc => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:39.333718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.334074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.334409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.346123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 958/1908] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:39 2022] DELETE /identity/v3/users/ac9ce6da395b4c2b9bcce789fbb307b4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:39.352245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.352836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.353388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.385850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:39.401611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:39.404053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:39.405458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:39.499500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:39.611468 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 959/1909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:39.640379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 951/1910] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:39.643855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:39.661552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790410-8739-4385-99d2-01cbd4e9d079 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.667915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:39.668687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.669128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.669898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.670856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:39.671225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:39.674430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:39.682356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:39.683994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:39.695928 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 960/1911] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:39.697267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:39.708657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9b52-5e62-4097-9944-48250cdb0b75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.714185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:39.714923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.715161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.715478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.716502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:39.722523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:39.814994 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 961/1912] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:39 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:39.815947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:39.858548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08d10-dba8-4bcc-91df-f09fcc668fd7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.924707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f52b-432c-4e52-9e85-fcda5a4412c2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:39.941068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:39.942568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:39.943416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:39.944442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:39.947564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:39.950905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:39.990667 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 962/1913] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:39 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:39.993714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.010902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f0067-cf19-41e6-bace-c5194f3a7fbf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.028018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.029354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.029886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.030360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.031227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.033501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.035753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:40.049544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.051887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.052349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.053801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.060451 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 963/1914] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:40.062095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.084238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc834d-1f16-4c66-9efb-1f26a7d1271a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.094782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.095953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.096373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.096649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.097453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.107268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.108978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32155646-027f-4cc0-90de-be0cecccf7ec admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.109481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.140091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 952/1915] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:40.149310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 964/1916] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:40.153883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.177584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c664d0-6ece-43a8-86c8-83ed1b836821 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.187785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.188534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.188934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.189367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] PATH_INFO: `/v3/projects/d922e86ff82145e49a876f54379abc85/users/094bf0c48f0142c9a69bad604b39da8a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.209230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d922e86ff82145e49a876f54379abc85, user_id=094bf0c48f0142c9a69bad604b39da8a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.213771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.246193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 953/1917] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:40 2022] PUT /identity/v3/projects/d922e86ff82145e49a876f54379abc85/users/094bf0c48f0142c9a69bad604b39da8a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:40.247352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1944e8-aad6-489c-b85f-0412179e0ffd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.247618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1944e8-aad6-489c-b85f-0412179e0ffd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.247962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1944e8-aad6-489c-b85f-0412179e0ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.281121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8e1944e8-aad6-489c-b85f-0412179e0ffd None None] MFA Rules not processed for user `094bf0c48f0142c9a69bad604b39da8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:40.282433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e1944e8-aad6-489c-b85f-0412179e0ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:40.433932 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 965/1918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:40.438577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.474714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.475240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.475521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.576162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] MFA Rules not processed for user `be47a02c67bc4697b77ebf7a21dc9c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:40.578472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:40.594644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdcb8-9d23-42a2-992a-77bd93786d21 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.600251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.602373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.602836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.603287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.604238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.606896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.621084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:40.675702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 954/1919] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:40 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:40.677710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.728635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 966/1920] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:40.739519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.741704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:40.799955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd110f-37e6-44c7-9602-9464472e586a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.809701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.811505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.812112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.812644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.813683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.817712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.859917 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 955/1921] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:40 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:40.862342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.905070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0a8e-a562-4e09-9cec-5ad86b2bd301 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.924365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:40.925016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:40.925752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:40.925752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:40.926173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:40.927795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:40.969120 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 956/1922] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:40.969704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:40.973789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:40.982784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d54b-deed-447e-af1f-8af68a6e1e8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:40.996466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1053a2-db97-469e-ad63-8a2ee84bdc6c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:41.024247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.025175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.025454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.025901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] PATH_INFO: `/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b/users/0fccdc810d9541bebcae58f53bc825c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.082538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a9f1fa7d744fbba4887e6b8abb5c9b, user_id=0fccdc810d9541bebcae58f53bc825c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.085190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.130644 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 957/1923] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:40 2022] PUT /identity/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b/users/0fccdc810d9541bebcae58f53bc825c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:41.131635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:41.234153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.235150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.241564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.242185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.299283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76fc84-4319-405c-8db3-c57b601bb3f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:41.309955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.310805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.311011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.311283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.311925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.314295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.340136 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 958/1924] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:41.345821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:41.380069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1e17d-1006-4111-a565-3852a4a35c44 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:41.386635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.388734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.390115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.390555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] PATH_INFO: `/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b/users/0fccdc810d9541bebcae58f53bc825c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.394522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.400265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a9f1fa7d744fbba4887e6b8abb5c9b, user_id=0fccdc810d9541bebcae58f53bc825c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.401806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b59494-19b3-4d46-87eb-f95d57c05cd0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.404896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.450646 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 959/1925] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:41 2022] PUT /identity/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b/users/0fccdc810d9541bebcae58f53bc825c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:41.453209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:41.454692 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 967/1926] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:41.466889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.467216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.467539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.471723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:41.529200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:41.554943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] MFA Rules not processed for user `0fccdc810d9541bebcae58f53bc825c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:41.559042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:41.602602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39ab47-c237-4f2a-8ace-a7457ef74c96 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:41.618714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.622408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.623500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.624326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] PATH_INFO: `/v3/projects/a561a55f57f84b06abe9e7c932dbb470` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.627254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a561a55f57f84b06abe9e7c932dbb470)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.629623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.713232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 968/1927] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:41.717678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:41.721416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:41.739129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695943c7-fd95-4217-b649-d0285f5389d2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:41.746131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:41.748559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.748910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.749318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] PATH_INFO: `/v3/projects/b8f13773b92f4486a72ff866f2d03373` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.751853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f13773b92f4486a72ff866f2d03373)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:41.754954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:41.790125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a561a55f57f84b06abe9e7c932dbb470', 'request_id': 'req-11ca3e89-0465-467d-94c6-7b13f1e17a68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.809467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:41.822412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a561a55f57f84b06abe9e7c932dbb470', 'request_id': 'req-11ca3e89-0465-467d-94c6-7b13f1e17a68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.837647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a561a55f57f84b06abe9e7c932dbb470', 'request_id': 'req-11ca3e89-0465-467d-94c6-7b13f1e17a68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.869319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] The token cache is being invalidate because project a561a55f57f84b06abe9e7c932dbb470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:41.869619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.870326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.874758 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 960/1928] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:41 2022] DELETE /identity/v3/projects/a561a55f57f84b06abe9e7c932dbb470 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:41.877910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:41.878990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f13773b92f4486a72ff866f2d03373', 'request_id': 'req-d60d12f1-07c4-41d6-b74f-7baad10d1982'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.879340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:41.895071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f13773b92f4486a72ff866f2d03373', 'request_id': 'req-d60d12f1-07c4-41d6-b74f-7baad10d1982'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.914861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f13773b92f4486a72ff866f2d03373', 'request_id': 'req-d60d12f1-07c4-41d6-b74f-7baad10d1982'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.942681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] The token cache is being invalidate because project b8f13773b92f4486a72ff866f2d03373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:41.943359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.945346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d60d12f1-07c4-41d6-b74f-7baad10d1982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:41.948582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 969/1929] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:41 2022] DELETE /identity/v3/projects/b8f13773b92f4486a72ff866f2d03373 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:41.953838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:41.954243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:41.954647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:41.987628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3e89-0465-467d-94c6-7b13f1e17a68 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.009930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:42.011515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.122293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.122903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.123235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.123504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] PATH_INFO: `/v3/users/bfcc8a9daba9466d87f6739c6be8a1bf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.125027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcc8a9daba9466d87f6739c6be8a1bf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.128120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.137795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:42.155459 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 970/1930] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:42.155459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.155459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.206873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcc8a9daba9466d87f6739c6be8a1bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:42.214091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcc8a9daba9466d87f6739c6be8a1bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:42.235431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcc8a9daba9466d87f6739c6be8a1bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:42.238639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcc8a9daba9466d87f6739c6be8a1bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:42.253886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-83dce1da-363e-48c6-90f9-4a3fc54a9cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcc8a9daba9466d87f6739c6be8a1bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:42.274298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429d79-6ac3-41bf-811e-0b8e718ad81c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.281113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.281901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.282311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.282817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.286781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.297037 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 961/1931] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:41 2022] DELETE /identity/v3/users/bfcc8a9daba9466d87f6739c6be8a1bf => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:42.298397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.298687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.298961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.347315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:42.349692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.385274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:42.438332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.442061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.462455 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 971/1932] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:42.510129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 962/1933] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:42.515151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.539530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdc26a-ae83-4989-8cb5-8d5b6ef9c5d3 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.545385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.546145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.546517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.546884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.547637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:42.548032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.549907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.554811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.556690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.580473 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 972/1934] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:01:42.582824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.614084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e74165-0d00-445a-814d-677aca650f76 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.625923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.626610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.627937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.628294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.629209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.633822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.692636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 973/1935] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:42 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:42.698268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.736230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e7b1-b13d-41d2-a9d4-225c64e7b32b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.789834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:42.799299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751f93-a652-4f92-89f3-a00f5d1e2056 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.806382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.807119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.807855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.808204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.809011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.811300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.852984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 974/1936] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:42 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:42.858697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.874592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62581-c4a0-43dc-8669-2d7fad093234 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.885618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.890820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.891219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.892515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.894859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:42.896616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:42.922796 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 975/1937] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:42.930834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:42.939147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.939929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.940323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.940948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.948742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:42.968037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb148b-7acc-4022-bf4b-7c3471196bb6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:42.994561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:42.995375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:42.996885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:42.997368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:42.998574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:43.006757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eeee88-cefa-425e-8be8-f3c4ea7ffb3f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:43.053192 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 976/1938] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:43.056117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:43.056769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:43.057227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:43.130079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] MFA Rules not processed for user `40da67f39f4d4a6fb25ea033b0f14071`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:43.131587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:43.161957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:43.165365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:43.178102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 963/1939] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:43.179800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:43.199613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7573f5-86fc-4a68-a364-8af47b82cb0f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:43.204909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:43.206183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:43.206784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:43.207156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] PATH_INFO: `/v3/projects/e3dfb586c7744602b4d322746de58012/users/34eaca8b0af74aa488e8d5b70fc11771/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:43.232087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dfb586c7744602b4d322746de58012, user_id=34eaca8b0af74aa488e8d5b70fc11771, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:43.235620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bcfa-c7a7-4781-bb10-4bb41abd476a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:43.267165 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 964/1940] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:43 2022] PUT /identity/v3/projects/e3dfb586c7744602b4d322746de58012/users/34eaca8b0af74aa488e8d5b70fc11771/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:43.283523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:43.283895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:43.284238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:43.312347 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 977/1941] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:43.317492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:43.318916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:43.340882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:43.345383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] MFA Rules not processed for user `34eaca8b0af74aa488e8d5b70fc11771`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:43.346802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:43.364853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346a3d-dfaf-4435-b17f-5008b84cb1a2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:43.529583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:43.530795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:43.531072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:43.531339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:43.531980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:43.532639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 965/1942] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:43.535324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:43.541681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:43.591475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf719b-00de-4a16-bc52-bc3c2ae5c9b1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:43.610391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:43.612831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:43.613392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:43.613677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:43.614330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:43.616780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:43.629103 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 978/1943] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:01:43.634475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:43.729803 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 966/1944] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:43.742686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:43.763936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:43.819683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba2fe4-9355-4dc7-b0ac-93d3f1c526bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.016218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd598f1-00d1-454b-a9d2-aae313ef80cf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.037279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.038269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.039957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.040774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.042281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.045836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.046666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.047048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.047422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.047872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.048668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.054979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.103539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 967/1945] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/users => generated 291 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:44.104571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.111777 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 979/1946] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:43 2022] POST /identity/v3/users => generated 298 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:44.115349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.119270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.124905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.161291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af46bb-765d-41a4-8e9c-7087a354d30c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.171709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2a78-1a14-4273-872a-a0d1d3d2c7ba admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.184264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.185542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.185821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.186093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] PATH_INFO: `/v3/projects/60ec1e213c5847bba717b4ff4a1306b7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.190063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ec1e213c5847bba717b4ff4a1306b7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.192062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.196878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.197579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.198206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.198206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] PATH_INFO: `/v3/users/094bf0c48f0142c9a69bad604b39da8a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.202008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094bf0c48f0142c9a69bad604b39da8a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.210613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.277886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:44.328339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094bf0c48f0142c9a69bad604b39da8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.332830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094bf0c48f0142c9a69bad604b39da8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.333633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ec1e213c5847bba717b4ff4a1306b7', 'request_id': 'req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.361525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ec1e213c5847bba717b4ff4a1306b7', 'request_id': 'req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.363781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094bf0c48f0142c9a69bad604b39da8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.365050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094bf0c48f0142c9a69bad604b39da8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.383868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ec1e213c5847bba717b4ff4a1306b7', 'request_id': 'req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.388444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094bf0c48f0142c9a69bad604b39da8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.418645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] The token cache is being invalidate because project 60ec1e213c5847bba717b4ff4a1306b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:44.418909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.420625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:44.430373 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 980/1947] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:44 2022] DELETE /identity/v3/projects/60ec1e213c5847bba717b4ff4a1306b7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:44.431468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.434491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.449751 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 968/1948] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:44 2022] DELETE /identity/v3/users/094bf0c48f0142c9a69bad604b39da8a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:44.450713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.455593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.639134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203b4f9-c09d-4e44-b7b9-dd0a5cf5d9d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.688895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb23b8-4102-4961-a624-a15bd71fda57 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.700502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.701416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.702141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.703489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.705830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.709846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b606444-6332-41bb-af2f-4660f4df626e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.737918 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 969/1949] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:44.743784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.744893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.745820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.788870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:44.805331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.809101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.809606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.810073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.810942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.825936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72b3c4-ac23-44e7-947e-f42ef40c1f28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:44.839064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:44.840371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.844764 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 981/1950] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:44.846135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.846418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.846686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.888364 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 970/1951] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:44.889372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.893501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.910374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:44.911778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:44.925970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd005e-5c12-48df-8a48-c52181c9f5b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.940918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.942258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.942546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.942825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] PATH_INFO: `/v3/projects/acc1f2e701884cafbe211c1ecc965f79/users/7cb6894f296242c1ad06b65570ad8f99/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.947423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 982/1952] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:44.948390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:44.971524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c7cf1-7319-4133-b1e4-48311e397637 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:44.983741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc1f2e701884cafbe211c1ecc965f79, user_id=7cb6894f296242c1ad06b65570ad8f99, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:44.985996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:44.987106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:44.987388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:44.987659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] PATH_INFO: `/v3/projects/1014f401f15f4980aeed77a648a76411/users/645a2fa9a2ee4c5ca24ea710cbd4be54/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:44.988905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d691539-24dd-4916-af84-ca5e0e6f60c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.025505 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 971/1953] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:44 2022] PUT /identity/v3/projects/acc1f2e701884cafbe211c1ecc965f79/users/7cb6894f296242c1ad06b65570ad8f99/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:45.028091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.028872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.029182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.032773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1014f401f15f4980aeed77a648a76411, user_id=645a2fa9a2ee4c5ca24ea710cbd4be54, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.035620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.068611 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 983/1954] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:44 2022] PUT /identity/v3/projects/1014f401f15f4980aeed77a648a76411/users/645a2fa9a2ee4c5ca24ea710cbd4be54/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:45.070338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.074986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:45.079394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:45.080611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:45.128710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:45.207687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959bee4-99e4-4bec-8bbc-fe37ee1c88f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.223205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.228219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.229577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.230366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.236115 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 972/1955] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:45.238152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.255963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.260196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.264330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d288-96f1-4063-bd31-371e0355f3ba None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.279569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.280292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.281433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.281433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.283051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.285102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 984/1956] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:45.286789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.287688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.310093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e9704-cd98-4bd4-aa82-fff27fc5deb9 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.312968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 973/1957] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:45.314317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.327318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.327934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.328230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.328580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.329365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.331120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.336097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c81c-9278-4d1b-8efd-e96d92ff999f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.343885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 985/1958] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:45.344915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.361076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d2213-a6b5-4057-8866-e64754ca1f53 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.361673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.362305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.362584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.362850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.363505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:45.363808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.365596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.369687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.371587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.371587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.371822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] PATH_INFO: `/v3/projects/acc1f2e701884cafbe211c1ecc965f79/users/7cb6894f296242c1ad06b65570ad8f99/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.386592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc1f2e701884cafbe211c1ecc965f79, user_id=7cb6894f296242c1ad06b65570ad8f99, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.393537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.393708 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 974/1959] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:45.394475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.416598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda761dd-9b38-491a-bc90-330e07ad5597 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.416779 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 986/1960] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:45 2022] PUT /identity/v3/projects/acc1f2e701884cafbe211c1ecc965f79/users/7cb6894f296242c1ad06b65570ad8f99/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:45.418346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.548220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.548847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.549154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.549422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] PATH_INFO: `/v3/projects/1014f401f15f4980aeed77a648a76411/users/645a2fa9a2ee4c5ca24ea710cbd4be54/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.552441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1014f401f15f4980aeed77a648a76411, user_id=645a2fa9a2ee4c5ca24ea710cbd4be54, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.556115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b323c6-4e31-434c-9634-6eaec61c9544 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.566656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a456e-8d92-418b-b129-caf1c35e042c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.567609 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 975/1961] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:45 2022] PUT /identity/v3/projects/1014f401f15f4980aeed77a648a76411/users/645a2fa9a2ee4c5ca24ea710cbd4be54/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:45.580842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.580842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.580842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.638868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] MFA Rules not processed for user `645a2fa9a2ee4c5ca24ea710cbd4be54`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:45.643193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:45.714512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.716888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.717482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.717927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.729117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.731957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.742358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:45.799032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 987/1962] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:45 2022] POST /identity/v3/projects => generated 407 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:45.811431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.859292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 976/1963] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:45.868636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:45.870085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:45.871681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:45.926644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdc71c-28ac-441c-9060-3fd185c2c547 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:45.937182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:45.937964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:45.938287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:45.938611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:45.939406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:45.941646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:45.980149 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 988/1964] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:45 2022] POST /identity/v3/users => generated 304 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:45.984479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.010112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf45902-aabf-484b-94bc-e47dac7dd0dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.026990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.028500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.028800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.031397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.033258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.037091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.040532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2021-a4d1-485e-8357-d535108e32b8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.071986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 989/1965] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:46.076465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.108513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233e967-c047-4eaf-9e39-540ff9309c45 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.120957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.121592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.121870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.122134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.122783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.130272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.156111 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 990/1966] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:46.160382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.183835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e70837-cb1a-418d-82a4-62d374fad4bb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.193159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.193835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.194642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.194914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] PATH_INFO: `/v3/projects/6b38919f24694316bc40989641626d36/users/39df268480c54cdbabf8b0468d7aaca9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.202009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.202744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.203032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.203307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.232426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b38919f24694316bc40989641626d36, user_id=39df268480c54cdbabf8b0468d7aaca9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.235077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c467d4-4418-4a61-a0c6-f650abde5e05 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.260862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 991/1967] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:46 2022] PUT /identity/v3/projects/6b38919f24694316bc40989641626d36/users/39df268480c54cdbabf8b0468d7aaca9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:46.271624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.271968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.272266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.293605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.295229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.303882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:46.321146 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 977/1968] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:46.338496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] MFA Rules not processed for user `39df268480c54cdbabf8b0468d7aaca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:46.339727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:46.501723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.517881 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 992/1969] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:46.520180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3037627-3ff2-4467-b140-700e3154fbfa service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.522428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.638973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.639756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.640124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.640528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] PATH_INFO: `/v3/users/34eaca8b0af74aa488e8d5b70fc11771` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.642767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34eaca8b0af74aa488e8d5b70fc11771)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.648068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.733364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34eaca8b0af74aa488e8d5b70fc11771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:46.734204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34eaca8b0af74aa488e8d5b70fc11771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:46.739192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70daa-ad4e-4eb1-9039-d4d4b4ace1b4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:46.750061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34eaca8b0af74aa488e8d5b70fc11771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:46.753635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34eaca8b0af74aa488e8d5b70fc11771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:46.758735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:46.759900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.761473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.761944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.763598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34eaca8b0af74aa488e8d5b70fc11771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:46.764232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:46.769814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657e5f-2459-4e05-96ae-a731796e3ab9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:46.797072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:46.829157 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 978/1970] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:46 2022] DELETE /identity/v3/users/34eaca8b0af74aa488e8d5b70fc11771 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:46.829157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.834273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:46.842582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 993/1971] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:46 2022] POST /identity/v3/projects => generated 407 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:46.844258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:46.844824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:46.845408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:46.875699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:46.879328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:46.979931 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 994/1972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:46.981077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:46.982661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:46.995444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1219-96ad-4746-9b01-ddc946a5dede None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.001032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.001553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.001832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.002358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.003134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.005268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.009690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bb189-2b09-482c-853d-dfd4b7aaf260 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.025932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.026742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.027141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.027473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] PATH_INFO: `/v3/projects/d922e86ff82145e49a876f54379abc85` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.029049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d922e86ff82145e49a876f54379abc85)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.030977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.040980 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 995/1973] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:46 2022] POST /identity/v3/users => generated 310 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:47.041871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.043856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:47.088104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:47.129115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211773ad-2466-4b95-9933-e55de7d655e5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.178985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd922e86ff82145e49a876f54379abc85', 'request_id': 'req-0b87d465-c87f-45bc-aa90-e5915d84909e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.200101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.200743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.201081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.201446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.205600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd922e86ff82145e49a876f54379abc85', 'request_id': 'req-0b87d465-c87f-45bc-aa90-e5915d84909e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.224004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd922e86ff82145e49a876f54379abc85', 'request_id': 'req-0b87d465-c87f-45bc-aa90-e5915d84909e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.262163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:47.269268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] The token cache is being invalidate because project d922e86ff82145e49a876f54379abc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:47.269620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.278338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.282392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 979/1974] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:46 2022] DELETE /identity/v3/projects/d922e86ff82145e49a876f54379abc85 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:47.283269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.288608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.288926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:47.290634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.307367 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 996/1975] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:47.308349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.314127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87d465-c87f-45bc-aa90-e5915d84909e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.321389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6120b-e725-43e4-9d1b-aa582d202812 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.327090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.327739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.328012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.328280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] PATH_INFO: `/v3/users/0fccdc810d9541bebcae58f53bc825c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.329678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fccdc810d9541bebcae58f53bc825c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.331902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.348076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.348800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.349117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.349414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.350556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.353089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.375004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 980/1976] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:47.381035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.395057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135ef5-e5d3-448e-b1fa-ca251a3034a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.411475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fccdc810d9541bebcae58f53bc825c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.414103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.416108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.416861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.417936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] PATH_INFO: `/v3/projects/66595d3c12224791b9f537e6bdf2db86/users/9296195940fb432eaeefe8a57b227dcc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.423484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fccdc810d9541bebcae58f53bc825c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.423972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fccdc810d9541bebcae58f53bc825c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.440595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fccdc810d9541bebcae58f53bc825c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.442224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fccdc810d9541bebcae58f53bc825c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:47.489470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66595d3c12224791b9f537e6bdf2db86, user_id=9296195940fb432eaeefe8a57b227dcc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.493798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.502686 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 997/1977] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:47 2022] DELETE /identity/v3/users/0fccdc810d9541bebcae58f53bc825c0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:47.520827 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 981/1978] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:47 2022] PUT /identity/v3/projects/66595d3c12224791b9f537e6bdf2db86/users/9296195940fb432eaeefe8a57b227dcc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:47.521972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.523722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:47.673699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a04f3c-41de-4786-8484-0f0342fc86f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.790308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:47.804005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.804782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.805097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.805373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.806071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.807939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ae858-ed27-4464-9b47-daa92eebea93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.830809 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 998/1979] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:01:47.835294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:47.904470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd967-94a3-4e99-b1a5-080f5dbd1f9a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:47.917664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:47.919001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.919287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.919558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] PATH_INFO: `/v3/projects/66595d3c12224791b9f537e6bdf2db86/users/9296195940fb432eaeefe8a57b227dcc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:47.926748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66595d3c12224791b9f537e6bdf2db86, user_id=9296195940fb432eaeefe8a57b227dcc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:47.945767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:47.969029 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 982/1980] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:47 2022] PUT /identity/v3/projects/66595d3c12224791b9f537e6bdf2db86/users/9296195940fb432eaeefe8a57b227dcc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:47.970325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:47.970755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:47.970755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:48.042615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] MFA Rules not processed for user `9296195940fb432eaeefe8a57b227dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:48.043869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:48.206681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 999/1981] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:48.214043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:48.216166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:48.320527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:48.326613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:48.431217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8d058-ccf3-4986-acc6-f3effc8462b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:48.457880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:48.458518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:48.458786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:48.459067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:48.479033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1925dd-7922-4067-bed1-aae6194cd585 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:48.483087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:48.488255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:48.502316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:48.505149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:48.505149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:48.505382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] PATH_INFO: `/v3/projects/e3dfb586c7744602b4d322746de58012` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:48.508421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dfb586c7744602b4d322746de58012)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:48.521099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 983/1982] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:48.528098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:48.636898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:48.638128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dfb586c7744602b4d322746de58012', 'request_id': 'req-7ae45310-7aab-45bb-8613-c1803ee8a72e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.650557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dfb586c7744602b4d322746de58012', 'request_id': 'req-7ae45310-7aab-45bb-8613-c1803ee8a72e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.667006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ce04f-7b61-4e97-9d5c-367abd6453a4 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:48.673977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dfb586c7744602b4d322746de58012', 'request_id': 'req-7ae45310-7aab-45bb-8613-c1803ee8a72e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.703165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] The token cache is being invalidate because project e3dfb586c7744602b4d322746de58012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:48.703812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.704703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.706837 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1000/1983] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:48 2022] DELETE /identity/v3/projects/e3dfb586c7744602b4d322746de58012 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:48.707937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:48.710273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:48.723008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:48.764215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:48.813919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:48.814608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:48.815372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:48.815652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:48.818206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae45310-7aab-45bb-8613-c1803ee8a72e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:48.822093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:48.825217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:48.825878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:48.826152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:48.826860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] PATH_INFO: `/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:48.827717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a9f1fa7d744fbba4887e6b8abb5c9b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:48.829784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:48.919786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a9f1fa7d744fbba4887e6b8abb5c9b', 'request_id': 'req-eab5778f-267f-491e-8aee-0b0922608937'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.938048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a9f1fa7d744fbba4887e6b8abb5c9b', 'request_id': 'req-eab5778f-267f-491e-8aee-0b0922608937'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.954872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a9f1fa7d744fbba4887e6b8abb5c9b', 'request_id': 'req-eab5778f-267f-491e-8aee-0b0922608937'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:48.974261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:48.976302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:48.989417 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 984/1984] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:48.990377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:48.992359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.002643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] The token cache is being invalidate because project a7a9f1fa7d744fbba4887e6b8abb5c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:49.004548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.012029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eab5778f-267f-491e-8aee-0b0922608937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.015996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1001/1985] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:48 2022] DELETE /identity/v3/projects/a7a9f1fa7d744fbba4887e6b8abb5c9b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:49.021995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207d7c-c77b-4f5f-91c3-5bcc2bd00762 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.022942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207d7c-c77b-4f5f-91c3-5bcc2bd00762 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.023470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe207d7c-c77b-4f5f-91c3-5bcc2bd00762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.032549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a2403-e345-4fce-aed2-57f28e41e120 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.074907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fe207d7c-c77b-4f5f-91c3-5bcc2bd00762 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:49.080970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fe207d7c-c77b-4f5f-91c3-5bcc2bd00762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.191813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.192706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.193212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.195266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] PATH_INFO: `/v3/users/645a2fa9a2ee4c5ca24ea710cbd4be54` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.199153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=645a2fa9a2ee4c5ca24ea710cbd4be54)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.205470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.255155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1002/1986] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:49.255155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.257141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.257141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.292896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:49.293924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.307212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1003/1987] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:49.308366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.321136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b70ef-4c63-4e1f-b796-4ed88e58b2df None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.326443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.327097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.327481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.327619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.328274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:49.328574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.330611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.341594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645a2fa9a2ee4c5ca24ea710cbd4be54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.343471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645a2fa9a2ee4c5ca24ea710cbd4be54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.357939 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1004/1988] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:49.359032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.367382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645a2fa9a2ee4c5ca24ea710cbd4be54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.370990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645a2fa9a2ee4c5ca24ea710cbd4be54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.376344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d553cb-67e6-4f73-b5f4-9ead89dbd84f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.389762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.389762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.389762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.390080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.390945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.393765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.395443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645a2fa9a2ee4c5ca24ea710cbd4be54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.444302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:49.447812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:49.459137 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 985/1990] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:48 2022] DELETE /identity/v3/users/645a2fa9a2ee4c5ca24ea710cbd4be54 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:49.461047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.466140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1005/1989] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:49 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:49.467149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.474156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.474390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.654662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79047598-6e9b-48fb-979e-574cda630d12 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.655706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f5dbe-9ab4-49da-9e6b-3a6db36b4be2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.660753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.661423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.661706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.661978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.662623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.665279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.672040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.673402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.673924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.674610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] PATH_INFO: `/v3/users/39df268480c54cdbabf8b0468d7aaca9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.678846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39df268480c54cdbabf8b0468d7aaca9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.681109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.724461 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1006/1991] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:49 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:49.726255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.758712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d529862-d564-4f42-876e-43021e550073 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.774431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.775155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.775341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.775615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.776278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.777933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.785792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39df268480c54cdbabf8b0468d7aaca9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.786865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39df268480c54cdbabf8b0468d7aaca9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.799886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39df268480c54cdbabf8b0468d7aaca9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.800924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39df268480c54cdbabf8b0468d7aaca9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.805910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1007/1992] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:49.806848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.809536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.817100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-818cb30d-680c-4825-99e4-7a9d5b225e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39df268480c54cdbabf8b0468d7aaca9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:49.846882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f6ac-5f84-48b0-8ee9-cf9105150146 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:49.860925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:49.861429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.861710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.862217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.862850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:49.866747 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 986/1993] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:49 2022] DELETE /identity/v3/users/39df268480c54cdbabf8b0468d7aaca9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:49.867564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:49.871175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:49.871547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:49.871816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:49.904452 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1008/1994] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:49.910227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:49.923615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:49.926874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:49.949641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d94ca1-e505-400d-9517-854de06a7b48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:50.114518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:50.115323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.115611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.115940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] PATH_INFO: `/v3/projects/e5a74500f03c437a9df0c33b03d4c751/users/b7136c17eac84b0bb2773da5cc61eca8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.117085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 987/1995] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:50.137826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a74500f03c437a9df0c33b03d4c751, user_id=b7136c17eac84b0bb2773da5cc61eca8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:50.141186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2c22-cffb-4b7d-9f6a-8c03927b2e08 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:50.168103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:50.169685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:50.177853 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1009/1996] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:49 2022] PUT /identity/v3/projects/e5a74500f03c437a9df0c33b03d4c751/users/b7136c17eac84b0bb2773da5cc61eca8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:50.190047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.190047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.190480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.213914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:50.252558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] MFA Rules not processed for user `b7136c17eac84b0bb2773da5cc61eca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:50.253933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:50.276610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c41d7-382f-4529-ad7d-6d316a8c7dd3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:50.358260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:50.410073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:50.411005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.411352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.411833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.432293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1010/1997] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:50.435927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:50.603030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:50.604485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:50.621135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513bc1c-d19f-4803-8e4b-d2dab1e96fb2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:50.627502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 988/1998] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:50.628381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:50.639227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:50.642603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:50.643247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.643531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.643806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.644490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:50.646485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:50.672926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd471-b561-4d06-84f1-634d272c2d54 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:50.689743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:50.690399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.690678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.690949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] PATH_INFO: `/v3/projects/1014f401f15f4980aeed77a648a76411` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.696449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1014f401f15f4980aeed77a648a76411)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:50.699582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1011/1999] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:50 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:50.703823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:50.703985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:50.839360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db05cd0-5739-4a11-9d14-e61839a53faa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:50.872405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1014f401f15f4980aeed77a648a76411', 'request_id': 'req-8de72baa-1713-4859-b93a-9716bb4993c1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:50.899274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1014f401f15f4980aeed77a648a76411', 'request_id': 'req-8de72baa-1713-4859-b93a-9716bb4993c1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:50.931045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:50.932942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.933627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.934318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.935190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:50.935873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1014f401f15f4980aeed77a648a76411', 'request_id': 'req-8de72baa-1713-4859-b93a-9716bb4993c1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:50.937954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ffe37-dd0b-4a85-ae1d-352ba77354ae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:50.976238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:50.979823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] The token cache is being invalidate because project 1014f401f15f4980aeed77a648a76411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:50.980213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:50.981876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:50.985195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 989/2000] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:50 2022] DELETE /identity/v3/projects/1014f401f15f4980aeed77a648a76411 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:50.989453 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1012/2001] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:50 2022] POST /identity/v3/users => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:50.990714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:50.993445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7bd9-aaef-4186-9581-fcd8d284e9e5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:50.994022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7bd9-aaef-4186-9581-fcd8d284e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:50.994499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e7bd9-aaef-4186-9581-fcd8d284e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:50.996855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.021329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-509e7bd9-aaef-4186-9581-fcd8d284e9e5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:51.023248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-509e7bd9-aaef-4186-9581-fcd8d284e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.028193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72baa-1713-4859-b93a-9716bb4993c1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.034939 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1013/2002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:51.036502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.037163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.037442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.037887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.038605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.040302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.047987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:51.050743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eeaa-a480-4d69-bbc5-b33af6105aaa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.051289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eeaa-a480-4d69-bbc5-b33af6105aaa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.052109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297eeaa-a480-4d69-bbc5-b33af6105aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.086172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3297eeaa-a480-4d69-bbc5-b33af6105aaa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:51.086789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 990/2003] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:51.090475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.093449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3297eeaa-a480-4d69-bbc5-b33af6105aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.102898 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1014/2004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:51.104238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067bc1-5ed1-4a79-a437-3e36912e2b12 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.104622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067bc1-5ed1-4a79-a437-3e36912e2b12 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.105017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067bc1-5ed1-4a79-a437-3e36912e2b12 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.106649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1015/2005] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:01:51.107447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06067bc1-5ed1-4a79-a437-3e36912e2b12 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.124941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743378a3-9ed9-425a-9031-ebb29e3fc989 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.125973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06067bc1-5ed1-4a79-a437-3e36912e2b12 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.133865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.134728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.135113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.135511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.136300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:51.136702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.139012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.139979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.140857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.141303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.144686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] PATH_INFO: `/v3/projects/f2ff20045c1547138d6d3d50a3e8f691/users/548657cd86e64eedafd9a42da697176e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.161761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1016/2006] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:51.167220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.181216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27506d16-1bea-4519-99dd-2274e01c6611 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.188370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.189641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.190049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.190426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.191194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.193311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.224392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff20045c1547138d6d3d50a3e8f691, user_id=548657cd86e64eedafd9a42da697176e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.227491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.245313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1017/2007] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:51 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:51.246945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.273209 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 991/2008] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:51 2022] PUT /identity/v3/projects/f2ff20045c1547138d6d3d50a3e8f691/users/548657cd86e64eedafd9a42da697176e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:51.277194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.386934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d0dc3-eab4-406c-9300-8976a983a104 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.423513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2697a-a84e-4e08-91ca-19a11ed8a026 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.429819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.430699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.431051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.431441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.432322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.434669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3711-bf48-442c-87b1-2254d46bda92 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.454501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 992/2009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:51.458361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.459097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.461561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.495556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:51.497806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.508004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.508629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.509020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.509371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.510173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.511941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.572237 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1018/2010] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:51 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:51.572237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.598256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452bf5c-fd89-41e3-99af-a34ec08a7810 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.610125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.610815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.611090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.611361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] PATH_INFO: `/v3/projects/f2ff20045c1547138d6d3d50a3e8f691/users/548657cd86e64eedafd9a42da697176e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.615385 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 993/2011] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:51.617505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff20045c1547138d6d3d50a3e8f691, user_id=548657cd86e64eedafd9a42da697176e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.617807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.619387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.620513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.639758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be314-e86e-41af-9b8f-da1b21c27168 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.655668 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1019/2012] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:51 2022] PUT /identity/v3/projects/f2ff20045c1547138d6d3d50a3e8f691/users/548657cd86e64eedafd9a42da697176e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:51.656854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.745488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:51.748845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.751969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.753446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.753937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] PATH_INFO: `/v3/users/be47a02c67bc4697b77ebf7a21dc9c49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.756318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be47a02c67bc4697b77ebf7a21dc9c49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.759539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.768634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:51.798283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29316c8-2c76-4849-9359-895542b7c751 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:51.831597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:51.832681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.834818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.834818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.835579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:51.837381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:51.852933 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1020/2013] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:51.852933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:51.859598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:51.873634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be47a02c67bc4697b77ebf7a21dc9c49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:51.875263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be47a02c67bc4697b77ebf7a21dc9c49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:51.888810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be47a02c67bc4697b77ebf7a21dc9c49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:51.889827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be47a02c67bc4697b77ebf7a21dc9c49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:51.905456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-75b77663-ec1c-412a-a50f-865e0fa7a6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be47a02c67bc4697b77ebf7a21dc9c49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:51.963621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 994/2014] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:51 2022] DELETE /identity/v3/users/be47a02c67bc4697b77ebf7a21dc9c49 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:51.965258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:51.969710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:51.970190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:51.990234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216208d2-0e92-4e8d-a045-2755ca1fb383 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.043964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] MFA Rules not processed for user `548657cd86e64eedafd9a42da697176e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:52.045612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.110227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.110924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.111269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.111550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.116030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.135204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.137385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.153059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1021/2015] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:52.153973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.155613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.180742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 995/2016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:52.181905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.184297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.261998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaaa97-ea66-4415-aa7c-ce6eaab49fde service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.269183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.270040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.270319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.270576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] PATH_INFO: `/v3/projects/6b38919f24694316bc40989641626d36` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.271933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b38919f24694316bc40989641626d36)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.275061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.292499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d79b8a-0049-4742-bdcf-dd64fa43ba98 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.297063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:52.298855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.299961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.300426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.300879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.302011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.304157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.317113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 996/2017] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:52.317867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.320346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.332235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:52.358094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b38919f24694316bc40989641626d36', 'request_id': 'req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.366804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b38919f24694316bc40989641626d36', 'request_id': 'req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.374410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b38919f24694316bc40989641626d36', 'request_id': 'req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.400854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] The token cache is being invalidate because project 6b38919f24694316bc40989641626d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:52.401172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.409534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.419977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1022/2018] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:52 2022] DELETE /identity/v3/projects/6b38919f24694316bc40989641626d36 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:52.419977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.419977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.487691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c815d-bb28-4d02-a5d1-337c48d4dd65 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.503732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae9df8-2661-4e5d-9a06-ea70f32b08e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.520256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.520915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.521220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.524727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] PATH_INFO: `/v3/projects/63444a4996f445398a0f529e53ed5d7a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.526178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63444a4996f445398a0f529e53ed5d7a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.528669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.605045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.606769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.607942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.608058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.610974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63444a4996f445398a0f529e53ed5d7a', 'request_id': 'req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.612747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.624063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63444a4996f445398a0f529e53ed5d7a', 'request_id': 'req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.630953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63444a4996f445398a0f529e53ed5d7a', 'request_id': 'req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.662699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] The token cache is being invalidate because project 63444a4996f445398a0f529e53ed5d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:52.663906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.664876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:52.666889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1023/2019] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:52 2022] DELETE /identity/v3/projects/63444a4996f445398a0f529e53ed5d7a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:52.667929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.669803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.715174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.717119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.741618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:52.747412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 997/2020] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:52.750105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:52.755405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.785877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a50a2-6691-423e-9cbb-ebd9639fb6d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.791170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c659d6-adde-46fa-bf91-d0ad0643bf30 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:52.796951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.797923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.798303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.798677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] PATH_INFO: `/v3/projects/4f8cd1e5d7af4445af0d15421d0d7365/users/5002086a01b54dfc92981315c3e0ffe7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.804592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:52.807200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.807635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.808072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] PATH_INFO: `/v3/users/9296195940fb432eaeefe8a57b227dcc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.811485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9296195940fb432eaeefe8a57b227dcc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.820272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.828757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8cd1e5d7af4445af0d15421d0d7365, user_id=5002086a01b54dfc92981315c3e0ffe7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:52.832455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113780c7-ceb1-4fa1-9d25-f86f352393c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:52.866317 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1024/2021] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:52 2022] PUT /identity/v3/projects/4f8cd1e5d7af4445af0d15421d0d7365/users/5002086a01b54dfc92981315c3e0ffe7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:52.872281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321b2e-37f6-49bf-a099-dfba5cb683bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:52.872898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321b2e-37f6-49bf-a099-dfba5cb683bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:52.873538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321b2e-37f6-49bf-a099-dfba5cb683bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:52.914109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d3321b2e-37f6-49bf-a099-dfba5cb683bb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:52.916414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3321b2e-37f6-49bf-a099-dfba5cb683bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:52.949928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.000392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9296195940fb432eaeefe8a57b227dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.001882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9296195940fb432eaeefe8a57b227dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.019625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9296195940fb432eaeefe8a57b227dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.020572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9296195940fb432eaeefe8a57b227dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.034266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6063f7e-ba56-40bb-a7e4-6aca429937aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9296195940fb432eaeefe8a57b227dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.086677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 998/2022] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:52 2022] DELETE /identity/v3/users/9296195940fb432eaeefe8a57b227dcc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:53.091954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.092539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.093960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.115595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1025/2023] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:53.125431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.125704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.125977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.168247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] MFA Rules not processed for user `5002086a01b54dfc92981315c3e0ffe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:53.168592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:53.169517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.171893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.316565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 999/2024] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:53.322535 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1026/2025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:53.323328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.327288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.330283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.355744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5964-146b-49d6-8713-e8410577aa8b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.358223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f469-16dc-4d40-b800-806bb29b7fb5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.362398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.363073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.364068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.364068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.364422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.369081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.370086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.372734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.373269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.374234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.376546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:53.377802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.380810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.410838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1027/2026] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:53.413797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.418421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.422894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1000/2027] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:53.425877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.449704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36934bd2-a514-4931-af94-937a2fb440d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.500945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.551291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5646a-2037-4ab2-a643-b3e91e6278bf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.558502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.559386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.559668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.559939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.560980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.564369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.564729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.566348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.566891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.567440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] PATH_INFO: `/v3/users/b7136c17eac84b0bb2773da5cc61eca8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.570387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7136c17eac84b0bb2773da5cc61eca8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.574214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.607847 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1001/2028] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:53.610778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.623383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:53.663029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7136c17eac84b0bb2773da5cc61eca8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.676848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7136c17eac84b0bb2773da5cc61eca8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.677705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7136c17eac84b0bb2773da5cc61eca8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.693227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7136c17eac84b0bb2773da5cc61eca8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.695432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7136c17eac84b0bb2773da5cc61eca8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:53.728757 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1028/2029] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:53 2022] DELETE /identity/v3/users/b7136c17eac84b0bb2773da5cc61eca8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:53.729738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.731450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.760738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed902a-7b7b-4b6b-b6a3-1b671e8550db admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.836527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ec8d-ee5e-42c9-bfab-41c524161ea8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.842418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.843256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.843533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.843800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.844629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.847087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ff9d3-bb02-4761-829a-9293c944ba52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.850906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.851973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.852298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.852572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.853289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.855368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.890024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1029/2030] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:53.893043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.894208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.894537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.925347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1002/2031] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:53.928757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.934875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.956572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:53.959108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:53.963513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5b0b-d0cf-47e1-bd9b-5cae160340ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:53.973830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:53.974725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:53.975019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:53.975294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] PATH_INFO: `/v3/projects/66595d3c12224791b9f537e6bdf2db86` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:53.978477 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1030/2032] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:53.979279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66595d3c12224791b9f537e6bdf2db86)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:53.980115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:53.984981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:53.999849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c601cd-ba03-4ca2-a93f-dc60cbb1e6a2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.008402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.009125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.009411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.009693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.010387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.011991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.024380 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1031/2033] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:54.026304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.028388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.059210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a0684-c02a-48d8-ad90-04e6650f7892 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.073390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66595d3c12224791b9f537e6bdf2db86', 'request_id': 'req-8210429e-e890-4c9c-b19e-5f8bb8a6c541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:54.088010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66595d3c12224791b9f537e6bdf2db86', 'request_id': 'req-8210429e-e890-4c9c-b19e-5f8bb8a6c541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:54.104674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66595d3c12224791b9f537e6bdf2db86', 'request_id': 'req-8210429e-e890-4c9c-b19e-5f8bb8a6c541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:54.107159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:54.130052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] The token cache is being invalidate because project 66595d3c12224791b9f537e6bdf2db86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:54.130407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:54.132070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:54.133830 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1003/2034] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:53 2022] DELETE /identity/v3/projects/66595d3c12224791b9f537e6bdf2db86 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:54.134631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.138472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.174327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.175037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.175717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.176073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.176646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.179295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.188515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:54.201779 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1032/2035] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:54.212657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.225586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.244509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5e1f-ff61-4f2d-934c-f106fb8606c1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.250675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.251623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.252069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.259732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.260475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.262418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99861b2-e920-41f9-8c85-dbf8d11d0426 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.274043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210429e-e890-4c9c-b19e-5f8bb8a6c541 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.280576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.281241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.281635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.281907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.284237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.287025 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1033/2036] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:54.289080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.289395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.289598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.317391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.318635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.324540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:54.327960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.330158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1004/2037] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:54.331036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.332916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.338571 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1034/2038] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:54.347502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.347797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3111-75e9-422b-9c33-ad7935e2765e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.354214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.354893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.355970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.355970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] PATH_INFO: `/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa/users/92cbb651b1114a59b228eaf5984b4ed5/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.365592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659fbfd-a45a-464f-a059-e68ff81174f0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.373948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.380223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.380511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.380795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] PATH_INFO: `/v3/projects/9c2404823fb54cc2bcee162756e6ef79/users/3ffc4db9f1d64b4e864915e980af84f4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.386903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8c708b4c0d4ba7b625d1e43be9c8aa, user_id=92cbb651b1114a59b228eaf5984b4ed5, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.389871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111e011-00da-42d3-818b-69e258dd6533 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.411939 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1005/2039] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:54 2022] PUT /identity/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa/users/92cbb651b1114a59b228eaf5984b4ed5/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:54.415996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2404823fb54cc2bcee162756e6ef79, user_id=3ffc4db9f1d64b4e864915e980af84f4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.417571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a4fc-6854-40c9-acd5-a46ac22ff238 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.418087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a4fc-6854-40c9-acd5-a46ac22ff238 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.420113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.420615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a4fc-6854-40c9-acd5-a46ac22ff238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.453425 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1035/2040] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:54 2022] PUT /identity/v3/projects/9c2404823fb54cc2bcee162756e6ef79/users/3ffc4db9f1d64b4e864915e980af84f4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:54.455912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.458528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f5a3a4fc-6854-40c9-acd5-a46ac22ff238 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:54.460143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5a3a4fc-6854-40c9-acd5-a46ac22ff238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.543879 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1006/2041] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:54.545548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.546091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.546903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.579870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:54.581624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:54.599784 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1007/2042] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:54.602398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.616281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313050c-b6ae-4a17-a7ee-45ed2d1b0000 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.623467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.624235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.624652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.624936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.625776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:54.626086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.628487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.638749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3961e7-3993-49b6-b199-f6400e66e97d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.644027 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1008/2043] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:54.650227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.659022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.659786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.660299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.660653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.661512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.667820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.677299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cd74-f9d4-4808-9795-316d0800dc1a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.688504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.691032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.691383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.691726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.693428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.695220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1036/2044] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:54.697346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.698305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.800236 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1009/2045] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:54 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:54.800236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:54.902539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3029e-5a99-418a-8912-a7ac61a1dfa9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.958056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d225aa2-2000-44ba-9294-0eeca908bfca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:54.973097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:54.974140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:54.974140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:54.975567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] PATH_INFO: `/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa/users/92cbb651b1114a59b228eaf5984b4ed5/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:54.979987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8c708b4c0d4ba7b625d1e43be9c8aa, user_id=92cbb651b1114a59b228eaf5984b4ed5, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:54.983387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:54.987992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:54.989350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:55.014192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1010/2046] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:54 2022] PUT /identity/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa/users/92cbb651b1114a59b228eaf5984b4ed5/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:55.014946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.038743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:55.039385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.039664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.039933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.062425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:55.063972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:55.105700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1037/2047] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:55.106732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.109858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:55.133944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453a09-b30a-4d99-b7f9-67a6b1b4299a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:55.177655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97236144-f102-45b1-9191-4dc125db1e3a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:55.192729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:55.193853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.194258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.194648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.195373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:55.197431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb353ce-da27-4e70-b2e2-0ba2e56453b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:55.239746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1011/2048] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:55 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:55.242127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.242426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.242771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.316810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:55.318442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.318996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.319487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] PATH_INFO: `/v3/projects/e5a74500f03c437a9df0c33b03d4c751` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.321913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a74500f03c437a9df0c33b03d4c751)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:55.324739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] MFA Rules not processed for user `92cbb651b1114a59b228eaf5984b4ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:55.326122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:55.326260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:55.426561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a74500f03c437a9df0c33b03d4c751', 'request_id': 'req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.441259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a74500f03c437a9df0c33b03d4c751', 'request_id': 'req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.459263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a74500f03c437a9df0c33b03d4c751', 'request_id': 'req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.479217 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1012/2049] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:55.480791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.486044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] The token cache is being invalidate because project e5a74500f03c437a9df0c33b03d4c751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:55.486334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.487182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.492482 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1038/2050] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:55 2022] DELETE /identity/v3/projects/e5a74500f03c437a9df0c33b03d4c751 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:55.494702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.496126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:55.514489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e186551-8a4d-4722-aae0-cd01997079dc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:55.640740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6303ca-cc1c-415a-8917-a6e4f8f58a07 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:55.650126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:55.650767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.651047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.651319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.651971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:55.655626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:55.661482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:55.662140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:55.662481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:55.663335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] PATH_INFO: `/v3/users/548657cd86e64eedafd9a42da697176e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:55.667819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] RBAC: Authorizing `identity:delete_user(user_id=548657cd86e64eedafd9a42da697176e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:55.670055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:55.680856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1013/2051] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:55.681747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.686407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:55.686963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:55.706943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:55.772337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548657cd86e64eedafd9a42da697176e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.786059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548657cd86e64eedafd9a42da697176e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.788642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548657cd86e64eedafd9a42da697176e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.804274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548657cd86e64eedafd9a42da697176e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.805640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548657cd86e64eedafd9a42da697176e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:55.853823 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1039/2052] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:55 2022] DELETE /identity/v3/users/548657cd86e64eedafd9a42da697176e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:01:55.861877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:55.865021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:55.873082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c8a87-e822-4ccc-8932-f51bf197b6be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:55.999088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4c2f-093b-43d2-aa57-185cd5e9acac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.015612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.016444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.017855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.018362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.021432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.025771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98aeb3-a4ce-4408-bb5e-6415742f0590 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.043549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.044313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.044853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.045271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.049105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1040/2053] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:56.050003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.051136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.051694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.052295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.092940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] MFA Rules not processed for user `7cb6894f296242c1ad06b65570ad8f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:56.094875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.180634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.182566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.202867 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1014/2054] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:56.202867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:56.230897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a46a4-9e03-45dc-beb2-f8c2bbdb8ba3 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.236647 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1041/2055] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:56.246518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.247207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.250483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.251790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] PATH_INFO: `/v3/projects/c91c440777a0421c961411bafbc058ad/users/19e2cb9474fb47a6b3f3793c7f162caf/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.252976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:56.255585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.270158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:56.292524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91c440777a0421c961411bafbc058ad, user_id=19e2cb9474fb47a6b3f3793c7f162caf, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.295583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.338179 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1015/2056] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:56 2022] PUT /identity/v3/projects/c91c440777a0421c961411bafbc058ad/users/19e2cb9474fb47a6b3f3793c7f162caf/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:56.339216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:56.341662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.362493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:56.406563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e814-43a4-4c99-a61a-f9443edcb59f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.456976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917bf7-d722-4eaa-bd10-59a026318c35 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.471580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.472522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.472901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.473373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.476840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.494256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.496157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.497520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.499390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.600659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.602618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc966c-9ea8-45ea-9fe7-8740ba576d86 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.619305 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1016/2057] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:56.621042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.621418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.621937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.649755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:56.651274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.763526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.765169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.769970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1017/2058] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:56.771265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:56.786522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.793458 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1042/2059] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:56.794514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:56.796755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:56.850697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20759f8-0251-469b-8014-7b029cd35f23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.865136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:56.866691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:56.867124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:56.867572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] PATH_INFO: `/v3/projects/f2ff20045c1547138d6d3d50a3e8f691` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:56.875579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ff20045c1547138d6d3d50a3e8f691)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:56.881754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:56.955506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:56.964064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ff20045c1547138d6d3d50a3e8f691', 'request_id': 'req-8434b8b0-a775-41b1-aacd-a1adca9eb463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:56.972623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445838-4d43-4e4e-870e-95952d0ee101 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:56.978281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ff20045c1547138d6d3d50a3e8f691', 'request_id': 'req-8434b8b0-a775-41b1-aacd-a1adca9eb463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:56.994224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ff20045c1547138d6d3d50a3e8f691', 'request_id': 'req-8434b8b0-a775-41b1-aacd-a1adca9eb463'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.010047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] The token cache is being invalidate because project f2ff20045c1547138d6d3d50a3e8f691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:57.010722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.014186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8434b8b0-a775-41b1-aacd-a1adca9eb463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.021086 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1018/2060] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:56 2022] DELETE /identity/v3/projects/f2ff20045c1547138d6d3d50a3e8f691 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:57.033085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a4ec4-0399-4763-9caf-c5b08150b4a6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.034809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a4ec4-0399-4763-9caf-c5b08150b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.035408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a4ec4-0399-4763-9caf-c5b08150b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.051159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:57.100717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:57.101555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.101944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.102290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.104409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.122500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-346a4ec4-0399-4763-9caf-c5b08150b4a6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:57.125079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-346a4ec4-0399-4763-9caf-c5b08150b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.247610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:57.248974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:57.272199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1043/2061] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:01:57.273526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:57.282218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.304868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1ff2-1943-4b7f-8ce1-9b0faef44d5b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:57.323932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:57.324614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.325323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.325610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] PATH_INFO: `/v3/users/5002086a01b54dfc92981315c3e0ffe7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.329179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5002086a01b54dfc92981315c3e0ffe7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:57.341820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:57.370550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1019/2062] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:57.376778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.377911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.380925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.456737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:57.458269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.482153 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1020/2063] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:57.485863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:57.520006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14701f01-23a5-47ef-a160-cd4d71466e9f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:57.533967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:57.534352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.534669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.534964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.536907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:01:57.538783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:57.540890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:57.570864 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1021/2064] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:01:57.571791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:57.597150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5002086a01b54dfc92981315c3e0ffe7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.598143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166926-08cb-4c8c-bb2c-569abd674c2e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:57.623040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:57.623675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.623955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.624228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.624458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5002086a01b54dfc92981315c3e0ffe7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.625491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:57.629403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:57.629545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5002086a01b54dfc92981315c3e0ffe7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.659198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5002086a01b54dfc92981315c3e0ffe7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.660705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb4955f-a300-40f2-8ea1-49baac16d6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5002086a01b54dfc92981315c3e0ffe7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:57.746996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1044/2065] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:57 2022] DELETE /identity/v3/users/5002086a01b54dfc92981315c3e0ffe7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:57.748961 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1022/2066] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:57 2022] POST /identity/v3/projects => generated 409 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:57.751479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:57.752672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:57.753829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:57.755840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:57.765055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.840097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:57.841502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:57.984327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:57.988159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01e9d6-5b49-4155-9ec6-85a3cfbe93b5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.000056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.000943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.002182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.003000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.004155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.008614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.017030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1045/2067] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:01:58.031659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.033436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:58.060360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1023/2068] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:57 2022] POST /identity/v3/users => generated 305 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:58.072672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.121959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae096609-735c-4204-b082-a195f5e45d9b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.138100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.138740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.139023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.139296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.139961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.141609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.157568 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1024/2069] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:58.159340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.172334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be4edc-813f-4f15-8757-6310160afe97 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.178511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.179252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.179794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.180204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.180916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.182774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.185850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:58.203452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1025/2070] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:58.204603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.221608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3773c-95ed-4326-962b-8d0482877f6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.227555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.228394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.228769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.229428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] PATH_INFO: `/v3/projects/d14b7c39a6c447bdb4d0ee6993d83941/users/3e0a4336a8a0444c9a99d18e539082a2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.248466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcdce9-a555-45cb-abab-21f6edcfefc0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.268331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14b7c39a6c447bdb4d0ee6993d83941, user_id=3e0a4336a8a0444c9a99d18e539082a2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.268514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.269189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.269461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.269737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.274608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a197-9aee-4bc0-895e-618493e3f026 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.288498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.293902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.314760 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1026/2071] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:58 2022] PUT /identity/v3/projects/d14b7c39a6c447bdb4d0ee6993d83941/users/3e0a4336a8a0444c9a99d18e539082a2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:58.329371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.329987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.330735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.338688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1046/2072] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:01:58.442002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] MFA Rules not processed for user `3e0a4336a8a0444c9a99d18e539082a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:01:58.445657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:58.664724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1027/2073] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:01:58.674934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.688299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462d9d-f739-46b0-a29f-a1b59a8d8b4d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:58.861241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:58.861879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:58.862157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:58.862436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:58.863142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:58.865378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:58.972531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:58.994967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1047/2074] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:01:58 2022] POST /identity/v3/projects => generated 411 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:59.008755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2f0a-2c64-48b2-a8b8-1837cb2c4e3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:59.150054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:59.155372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:59.308142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:59.309359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:59.309851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:59.310328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:59.311214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:59.314147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:59.397940 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1028/2075] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:01:58 2022] POST /identity/v3/users => generated 312 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:01:59.399678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:59.420614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8632-fdc2-44e9-9dc3-ade1d995412a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:59.428523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a029864-2d1c-4ee8-aadc-327ef53b433c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:59.429816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:59.430629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:59.431064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:59.431445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] PATH_INFO: `/v3/projects/4f8cd1e5d7af4445af0d15421d0d7365` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:59.437357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8cd1e5d7af4445af0d15421d0d7365)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:59.438372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:59.439427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:59.439851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:59.440365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:59.441473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:59.441955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:59.483996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:59.501301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:59.518672 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1029/2076] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:01:59.530522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:59.563419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c10a99-f05b-45df-89ed-e3df17613d22 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:59.592896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8cd1e5d7af4445af0d15421d0d7365', 'request_id': 'req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.612632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8cd1e5d7af4445af0d15421d0d7365', 'request_id': 'req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.626632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8cd1e5d7af4445af0d15421d0d7365', 'request_id': 'req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.692156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] The token cache is being invalidate because project 4f8cd1e5d7af4445af0d15421d0d7365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:01:59.693319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.694738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.699617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1048/2077] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:01:59 2022] DELETE /identity/v3/projects/4f8cd1e5d7af4445af0d15421d0d7365 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:59.703400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:59.705386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:59.713242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:01:59.759931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:59.760783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:59.761195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:59.761710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] PATH_INFO: `/v3/projects/552f476e981743d0a30a73b2b4a657bb/users/3e6995bdd3d3431b9a8adcee11f39f8c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:59.816204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a1e3f-e5ee-402b-a02a-7d22f3fccfb0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:01:59.822935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:01:59.823587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:01:59.823977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:01:59.824560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] PATH_INFO: `/v3/users/92cbb651b1114a59b228eaf5984b4ed5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:01:59.825904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cbb651b1114a59b228eaf5984b4ed5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:59.829245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:59.829564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=552f476e981743d0a30a73b2b4a657bb, user_id=3e6995bdd3d3431b9a8adcee11f39f8c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:01:59.840785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:01:59.876707 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1030/2078] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:01:59 2022] PUT /identity/v3/projects/552f476e981743d0a30a73b2b4a657bb/users/3e6995bdd3d3431b9a8adcee11f39f8c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:01:59.880871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:01:59.887936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:01:59.967527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cbb651b1114a59b228eaf5984b4ed5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.984907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cbb651b1114a59b228eaf5984b4ed5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:01:59.987619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cbb651b1114a59b228eaf5984b4ed5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:00.016149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cbb651b1114a59b228eaf5984b4ed5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:00.016861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cbb651b1114a59b228eaf5984b4ed5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:00.065572 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1049/2079] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:01:59 2022] DELETE /identity/v3/users/92cbb651b1114a59b228eaf5984b4ed5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:00.119692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4ae6-2b6c-4fc2-abcb-89f79d491aea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:00.258703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:00.261491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:00.262321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:00.264080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:00.266246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:00.272438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c933-9836-4562-b30f-b840dec86a18 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:00.315069 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1031/2080] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:00.316268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:00.317725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:00.353144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dab67-0907-4dc9-9f4c-ea493eeb59d4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:00.371317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:00.372075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:00.372369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:00.372640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] PATH_INFO: `/v3/projects/552f476e981743d0a30a73b2b4a657bb/users/3e6995bdd3d3431b9a8adcee11f39f8c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:00.379452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552f476e981743d0a30a73b2b4a657bb, user_id=3e6995bdd3d3431b9a8adcee11f39f8c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:00.383107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:00.429879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1050/2081] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:00 2022] PUT /identity/v3/projects/552f476e981743d0a30a73b2b4a657bb/users/3e6995bdd3d3431b9a8adcee11f39f8c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:00.438000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:00.438651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:00.439114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:00.492587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] MFA Rules not processed for user `3e6995bdd3d3431b9a8adcee11f39f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:00.494795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:00.606134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:00.628215 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1032/2082] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:00.931148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:00.932867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:01.009477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:01.162140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20deb8d-1cc2-4343-99fb-88c7f2cfc102 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:01.171977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:01.172713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:01.173018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:01.173420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:01.184881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:01.186736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:01.211207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1051/2083] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:00 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:01.252761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:01.288866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c672756-09e2-417a-b9ce-481b416cd382 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:01.306302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:01.307292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:01.307727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:01.308151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:01.313734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:01.494243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:01.499898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:01.528237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1033/2084] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:01.545820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:01.551021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:01.663711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:01.800444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477570f-2885-4fdb-bed0-c36faf7ca429 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:01.813195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:01.814618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:01.814905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:01.815179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] PATH_INFO: `/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:01.821296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8c708b4c0d4ba7b625d1e43be9c8aa)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:01.827961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:01.919385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf5a88-61f3-42ec-993c-67fdb045acc8 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:01.925974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:01.927181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:01.927616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:01.928210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] PATH_INFO: `/v3/users/3e0a4336a8a0444c9a99d18e539082a2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:01.945728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0a4336a8a0444c9a99d18e539082a2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:01.960441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:02.006437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8c708b4c0d4ba7b625d1e43be9c8aa', 'request_id': 'req-d4923690-1617-4377-bcb4-34c10f7ab29f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.022789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8c708b4c0d4ba7b625d1e43be9c8aa', 'request_id': 'req-d4923690-1617-4377-bcb4-34c10f7ab29f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.056591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8c708b4c0d4ba7b625d1e43be9c8aa', 'request_id': 'req-d4923690-1617-4377-bcb4-34c10f7ab29f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.088756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0a4336a8a0444c9a99d18e539082a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.089768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0a4336a8a0444c9a99d18e539082a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.102616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] The token cache is being invalidate because project da8c708b4c0d4ba7b625d1e43be9c8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:02.102949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.108576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4923690-1617-4377-bcb4-34c10f7ab29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.113309 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1052/2085] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:01 2022] DELETE /identity/v3/projects/da8c708b4c0d4ba7b625d1e43be9c8aa => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:02.121899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0a4336a8a0444c9a99d18e539082a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.123378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5b8-57ba-4be0-9def-686c294a9a69 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.124027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0a4336a8a0444c9a99d18e539082a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.127969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5b8-57ba-4be0-9def-686c294a9a69 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.129523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5b8-57ba-4be0-9def-686c294a9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.150854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9121667e-45f0-4e37-a56f-db5bf56632c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0a4336a8a0444c9a99d18e539082a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:02.196669 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1034/2086] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:01 2022] DELETE /identity/v3/users/3e0a4336a8a0444c9a99d18e539082a2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:02.203946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.204718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.205593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.216278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0814b5b8-57ba-4be0-9def-686c294a9a69 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:02.219986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0814b5b8-57ba-4be0-9def-686c294a9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:02.263977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:02.267954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:02.280985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:02.301379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:02.417859 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1035/2087] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:02.453114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1053/2088] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:02.458696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:02.465051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:02.467925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.469170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.477831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.566149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:02.572829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:02.612199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1054/2089] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:02.614605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:02.624733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738cb3c-ffe8-452a-87d5-5636de2b11ce None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:02.628604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:02.629445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.629879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.630256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.655451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681236a6-3a54-4020-8008-7a514b2d8e67 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:02.673742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8253-c790-4379-8329-761db74199ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:02.674171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:02.674381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8253-c790-4379-8329-761db74199ea admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.674666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8253-c790-4379-8329-761db74199ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.674944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e8253-c790-4379-8329-761db74199ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.675609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8253-c790-4379-8329-761db74199ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:02.675912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8253-c790-4379-8329-761db74199ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:02.680825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:02.690521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e8253-c790-4379-8329-761db74199ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:02.698200 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1036/2090] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:02.753329 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1055/2091] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:02.755100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:02.774439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6210d5-d711-40a9-9c85-698af8a0bfa3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:02.790057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:02.790731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:02.791679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:02.791869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:02.792496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:02.794445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:02.883259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1037/2092] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:02 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:02.884411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8253-c790-4379-8329-761db74199ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:02.901509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e8253-c790-4379-8329-761db74199ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:03.105287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:03.106423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:03.106657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:03.107035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:03.108095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:03.117622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:03.187123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:03.187704 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1056/2093] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:02 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:03.222350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69362b-8bfb-44b8-af3a-b9c02cd9608f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:03.241984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:03.242619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:03.242900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:03.243177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:03.243838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:03.258201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:03.282642 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1038/2094] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:03.286572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:03.321009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218998df-4328-4fdd-bcca-d9c23c68ac93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:03.336456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:03.343552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:03.347806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:03.348241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:03.349089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:03.360784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465c78a-3029-49fd-bd94-0511e33cda7d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:03.414986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:03.429237 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1057/2095] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:03.431202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f860fb-af3c-43c8-80ae-d55d29de61ef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:03.443524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:03.446620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:03.447242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:03.447673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] PATH_INFO: `/v3/projects/a43a15d33c0e46a6ac391e12b70e5f53/users/33e40e9dc1284124a6daa6549d41e04d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:03.488297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43a15d33c0e46a6ac391e12b70e5f53, user_id=33e40e9dc1284124a6daa6549d41e04d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:03.501928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:03.549664 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1039/2096] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:03 2022] PUT /identity/v3/projects/a43a15d33c0e46a6ac391e12b70e5f53/users/33e40e9dc1284124a6daa6549d41e04d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:03.568975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:03.570090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:03.570472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:03.729495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] MFA Rules not processed for user `33e40e9dc1284124a6daa6549d41e04d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:03.735953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:04.001340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1058/2097] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:04.004963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.240230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:04.252982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc674c4-7c00-49eb-96d7-5b335c0d2dea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:04.267572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:04.268677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.269162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.269746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.270549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:04.275741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:04.338532 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1040/2098] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:04 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:04.342201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.371588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6773-5c0a-42b0-bcc6-54c87376acb3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:04.434830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:04.589627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:04.590193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.590463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.590729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.591423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:04.593381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:04.622675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.644495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:04.670759 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1059/2099] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:04 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:04.673469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d413c-dd2d-4375-a19f-9ee49c1f8902 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:04.675046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.695189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:04.696081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.696451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.696792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] PATH_INFO: `/v3/users/f01c86c8f32c4035a71dd59fc55eccdc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.698875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01c86c8f32c4035a71dd59fc55eccdc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:04.700913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:04.714175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76767-69fd-4d13-9ba7-a5602c3cfb32 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:04.731731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:04.732450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.732715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.733561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.734185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:04.737186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:04.766527 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1060/2100] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:04.768531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.804596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea394d94-b96b-4547-91bb-e67bd04473a2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:04.815896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01c86c8f32c4035a71dd59fc55eccdc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:04.816667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01c86c8f32c4035a71dd59fc55eccdc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:04.821052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:04.821745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.822020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.822290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] PATH_INFO: `/v3/projects/d97ad842918d4bcd8418405b594f2c6d/users/48fffa0932534c94a74061f055f6accd/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.844937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01c86c8f32c4035a71dd59fc55eccdc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:04.846085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01c86c8f32c4035a71dd59fc55eccdc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:04.860248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a66379e3-8d1e-43b0-9b34-67341c3e2ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01c86c8f32c4035a71dd59fc55eccdc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:04.866886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97ad842918d4bcd8418405b594f2c6d, user_id=48fffa0932534c94a74061f055f6accd, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:04.874114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:04.903279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1041/2101] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:04 2022] DELETE /identity/v3/users/f01c86c8f32c4035a71dd59fc55eccdc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:04.908272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:04.908812 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1061/2102] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:04 2022] PUT /identity/v3/projects/d97ad842918d4bcd8418405b594f2c6d/users/48fffa0932534c94a74061f055f6accd/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:04.912764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:04.914726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:04.915293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:04.924253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:05.011082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:05.011082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:05.111873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372af8dd-482c-47da-a811-d5d966a046dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:05.233178 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1042/2103] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:05.260802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:05.260802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:05.349896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:05.352798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.353525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.354390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:05.356475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:05.363562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:05.410702 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1062/2104] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:05.413952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:05.420079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:05.456100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed454-6b64-45e7-88b0-33b5eabf8b8c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:05.463760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:05.465167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.465661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.466073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] PATH_INFO: `/v3/projects/d14b7c39a6c447bdb4d0ee6993d83941` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:05.467747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14b7c39a6c447bdb4d0ee6993d83941)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:05.469958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:05.510365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a61a78-0186-495b-8f50-10d516ae61df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:05.519860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:05.524735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:05.525393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.525670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.525942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:05.588718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:05.590784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14b7c39a6c447bdb4d0ee6993d83941', 'request_id': 'req-b5daaf87-d06f-4e93-9c0c-cdf2552904da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:05.597740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:05.603317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14b7c39a6c447bdb4d0ee6993d83941', 'request_id': 'req-b5daaf87-d06f-4e93-9c0c-cdf2552904da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:05.630724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:05.639213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14b7c39a6c447bdb4d0ee6993d83941', 'request_id': 'req-b5daaf87-d06f-4e93-9c0c-cdf2552904da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:05.661555 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1043/2105] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:05.663236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:05.681850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46918-f7c1-4f0a-9bca-22e257d1165e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:05.687649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] The token cache is being invalidate because project d14b7c39a6c447bdb4d0ee6993d83941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:05.688467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:05.691747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:05.701887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1063/2106] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:05 2022] DELETE /identity/v3/projects/d14b7c39a6c447bdb4d0ee6993d83941 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:05.703653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:05.705706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:05.889556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:05.890392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.890849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.891121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] PATH_INFO: `/v3/projects/d97ad842918d4bcd8418405b594f2c6d/users/48fffa0932534c94a74061f055f6accd/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:05.895109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97ad842918d4bcd8418405b594f2c6d, user_id=48fffa0932534c94a74061f055f6accd, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:05.906739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c326333-e67a-46c7-8af3-e9f7532211e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:05.912337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daaf87-d06f-4e93-9c0c-cdf2552904da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:05.921248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:05.924124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.924551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.924839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] PATH_INFO: `/v3/users/3e6995bdd3d3431b9a8adcee11f39f8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:05.937567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6995bdd3d3431b9a8adcee11f39f8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:05.940317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:05.965623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1044/2107] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:05 2022] PUT /identity/v3/projects/d97ad842918d4bcd8418405b594f2c6d/users/48fffa0932534c94a74061f055f6accd/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:05.979820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:05.980107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:05.980387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:06.084078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] MFA Rules not processed for user `48fffa0932534c94a74061f055f6accd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:06.085822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:06.092742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6995bdd3d3431b9a8adcee11f39f8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:06.124478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6995bdd3d3431b9a8adcee11f39f8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:06.126480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6995bdd3d3431b9a8adcee11f39f8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:06.144939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6995bdd3d3431b9a8adcee11f39f8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:06.150833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6995bdd3d3431b9a8adcee11f39f8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:06.200421 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1064/2108] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:05 2022] DELETE /identity/v3/users/3e6995bdd3d3431b9a8adcee11f39f8c => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:06.321323 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1045/2109] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:06.357086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:06.358532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:06.402476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:06.523626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e70c4-22f5-4a1d-81d7-2a6d9d6194d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:06.541967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:06.542884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:06.543264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:06.543652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:06.728589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:06.737052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:06.771136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1065/2110] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:07.088382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:07.090323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:07.344358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604e7af-95d4-4fc4-8981-b10e89233585 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:07.367200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:07.370967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:07.371254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:07.371531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:07.377313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:07.438511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:07.681023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:07.683238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:07.692151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:07.699960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:07.757967 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1046/2111] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:07.820275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5bc5d-f2d6-418a-9874-bb26bf835b4a service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:07.825345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:07.826915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:07.827207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:07.827476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] PATH_INFO: `/v3/users/33e40e9dc1284124a6daa6549d41e04d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:07.829526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e40e9dc1284124a6daa6549d41e04d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:07.831458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:07.914049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:07.916195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:07.937689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ea8a5-0080-47da-9b8a-8b844b711259 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:07.945704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:07.946907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:07.947489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:07.947934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] PATH_INFO: `/v3/projects/db104ba093c34a81b677c769995db538` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:07.952450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=db104ba093c34a81b677c769995db538)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:07.983222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:08.002802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e40e9dc1284124a6daa6549d41e04d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.026349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e40e9dc1284124a6daa6549d41e04d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.028566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e40e9dc1284124a6daa6549d41e04d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.034010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:08.063204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e40e9dc1284124a6daa6549d41e04d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.068569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-deb8c4eb-8288-4c87-99d7-2257a6040c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e40e9dc1284124a6daa6549d41e04d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.116254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db104ba093c34a81b677c769995db538', 'request_id': 'req-a98c9472-e940-4e31-92da-e611305bdaff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.155541 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1066/2112] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:07 2022] DELETE /identity/v3/users/33e40e9dc1284124a6daa6549d41e04d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:08.159287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db104ba093c34a81b677c769995db538', 'request_id': 'req-a98c9472-e940-4e31-92da-e611305bdaff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.160550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:08.161131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:08.161630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:08.178846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db104ba093c34a81b677c769995db538', 'request_id': 'req-a98c9472-e940-4e31-92da-e611305bdaff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.195942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] The token cache is being invalidate because project db104ba093c34a81b677c769995db538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:08.196461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.197953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.200791 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1047/2113] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:07 2022] DELETE /identity/v3/projects/db104ba093c34a81b677c769995db538 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:08.204917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:08.207255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:08.250162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:08.262673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:08.395820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9472-e940-4e31-92da-e611305bdaff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:08.561230 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1067/2114] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:08.606466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:08.608072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:08.624969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:08.719205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:08.741704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:08.746708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:08.747535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] PATH_INFO: `/v3/users/35cd83eb603e464fbb8a54ea8e7562cc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:08.754938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cd83eb603e464fbb8a54ea8e7562cc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:08.763511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:08.870256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2271f-6769-4d91-8502-9cd0927f1412 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:08.885854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:08.894757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:08.897609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:08.897997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:08.926877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cd83eb603e464fbb8a54ea8e7562cc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.928563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cd83eb603e464fbb8a54ea8e7562cc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.950154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cd83eb603e464fbb8a54ea8e7562cc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.952382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:08.954228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cd83eb603e464fbb8a54ea8e7562cc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:08.955991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:08.981607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06758e07-1c06-4d5f-bd35-03918ed87f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cd83eb603e464fbb8a54ea8e7562cc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.021846 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1068/2115] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:09.080711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1048/2116] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:08 2022] DELETE /identity/v3/users/35cd83eb603e464fbb8a54ea8e7562cc => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:09.159863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:09.166942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:09.199392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b93f01-07e2-4bf8-b515-7fee7b9d0d88 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:09.436867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:09.437820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:09.438274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:09.439480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] PATH_INFO: `/v3/projects/552f476e981743d0a30a73b2b4a657bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:09.441314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552f476e981743d0a30a73b2b4a657bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:09.450056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:09.493712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:09.587220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552f476e981743d0a30a73b2b4a657bb', 'request_id': 'req-577c200e-10fa-4db1-86a5-87f6c9cff700'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.612528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552f476e981743d0a30a73b2b4a657bb', 'request_id': 'req-577c200e-10fa-4db1-86a5-87f6c9cff700'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.629355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552f476e981743d0a30a73b2b4a657bb', 'request_id': 'req-577c200e-10fa-4db1-86a5-87f6c9cff700'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.656494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] The token cache is being invalidate because project 552f476e981743d0a30a73b2b4a657bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:09.656855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.661135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-577c200e-10fa-4db1-86a5-87f6c9cff700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:09.665928 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1069/2117] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:09 2022] DELETE /identity/v3/projects/552f476e981743d0a30a73b2b4a657bb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:09.670989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35a43-de66-4cd8-bd26-5663fe9e002c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:09.672034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35a43-de66-4cd8-bd26-5663fe9e002c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:09.672423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea35a43-de66-4cd8-bd26-5663fe9e002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:09.732027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6ea35a43-de66-4cd8-bd26-5663fe9e002c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:09.734748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ea35a43-de66-4cd8-bd26-5663fe9e002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:09.935484 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1049/2118] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:09.955833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:09.956332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:09.958151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:09.974284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:09.975224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:09.976287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.016278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:10.017596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:10.025045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:10.029598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:10.070358 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1070/2119] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:10.074177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.087385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46441622-3db0-4d60-939f-4dc02ec2c8bd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.102171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.103046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.103672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.104122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.105053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:10.106113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.113200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.149456 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1071/2120] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:10.152618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.182152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b03ab-9795-40d4-9cad-dee3c9d52cf9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.192262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1050/2121] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:10.198951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.200319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.202041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.203232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.207670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.221068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.245638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.248801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:10.257853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:10.336801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1072/2122] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:10 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:10.338758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.472656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cf466-659f-4774-95c5-2974dd6adc51 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.503853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257b3f-45ff-4335-bb87-6daf6256663f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.518604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.519502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.519997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.520419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.521769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.526030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.574001 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1073/2123] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:10 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:10.578562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.603233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bcbe2-e0d9-4056-b73e-6c540978d3ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.615501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.616219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.616498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.616758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.617443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.619074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.651833 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1074/2124] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:10.653537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.661367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.664838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.665427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.666478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.682357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036de9c-40af-44c0-8186-5e370b70ce2c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.698966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.699586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.699860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.700131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.700775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.702617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.739483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1075/2125] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:10.739965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.763154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550604-e740-4e91-87db-f4dc2b2c7d8f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.784478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:10.785188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.785463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.785765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] PATH_INFO: `/v3/projects/c1615e4a1ea345b4ac972f3a3cb08f2b/users/0c29841aaaee47c8ac0bde44c50105dc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.839499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1615e4a1ea345b4ac972f3a3cb08f2b, user_id=0c29841aaaee47c8ac0bde44c50105dc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.843022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c2b2f-e527-4c40-96b4-51071298009d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.847415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:10.848578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:10.871883 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1051/2126] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:02:10.872851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:10.877141 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1076/2127] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:10 2022] PUT /identity/v3/projects/c1615e4a1ea345b4ac972f3a3cb08f2b/users/0c29841aaaee47c8ac0bde44c50105dc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:10.884453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:10.884796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:10.885117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:10.887121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:10.910173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:10.936767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634073-b904-4f5f-8734-ac9ef748648d service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:10.947772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] MFA Rules not processed for user `0c29841aaaee47c8ac0bde44c50105dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:10.948900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:11.069489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:11.110290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.110953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.111227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.111496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] PATH_INFO: `/v3/projects/4786529b79604001b63927fa21b25908` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.115932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4786529b79604001b63927fa21b25908)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.118023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.158539 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1077/2128] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:11.159485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.206131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b2fd-b8b4-4f7c-aff4-faa2f3c08978 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.239585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.240285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.240568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.240842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.247697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.249912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.282508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4786529b79604001b63927fa21b25908', 'request_id': 'req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:11.296800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4786529b79604001b63927fa21b25908', 'request_id': 'req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:11.336675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4786529b79604001b63927fa21b25908', 'request_id': 'req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:11.342447 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1078/2129] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:11 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:11.347183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.372706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] The token cache is being invalidate because project 4786529b79604001b63927fa21b25908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:11.373077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:11.374842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c4f9de71-9e8a-4f38-b46f-97267f9e4b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:11.379651 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1052/2130] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:10 2022] DELETE /identity/v3/projects/4786529b79604001b63927fa21b25908 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:11.385643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481c6ab-0307-4d32-af26-d388c9d5b03d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.385928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481c6ab-0307-4d32-af26-d388c9d5b03d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.386211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481c6ab-0307-4d32-af26-d388c9d5b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.436065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a481c6ab-0307-4d32-af26-d388c9d5b03d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:11.440311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a481c6ab-0307-4d32-af26-d388c9d5b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:11.538646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef56cb-04bc-4c44-8875-f532226c697a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.548620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.550891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.551360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.551785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.561240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.568152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.627108 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1079/2131] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:11 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:11.631051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.635819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:11.685365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4fb7-83fa-46e2-ab93-e6f44b90bf44 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.696220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1053/2132] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:11.697679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807444-4be2-486e-909a-bf77f0480223 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.697964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807444-4be2-486e-909a-bf77f0480223 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.698451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807444-4be2-486e-909a-bf77f0480223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.703663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.704625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.706192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.706820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.708172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.711978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.746074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1080/2133] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:11.747311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.756321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-88807444-4be2-486e-909a-bf77f0480223 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:11.759297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88807444-4be2-486e-909a-bf77f0480223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:11.773649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee09f-2a09-4be0-ab1c-b9983688637e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.785877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1054/2134] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:11.787839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807444-4be2-486e-909a-bf77f0480223 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.793853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.794921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.795356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.795777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] PATH_INFO: `/v3/projects/1b35ef71883643ecb60ab2adaf04d643/users/c0fd25fdf6154d42a06be866e4d47712/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.803521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807444-4be2-486e-909a-bf77f0480223 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.818580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:11.819360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.819724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.820002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.820656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:11.820957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.822752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.834714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b35ef71883643ecb60ab2adaf04d643, user_id=c0fd25fdf6154d42a06be866e4d47712, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:11.841192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbc861-7d14-4e29-9491-481ea04f7619 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:11.878397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1081/2135] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:11 2022] PUT /identity/v3/projects/1b35ef71883643ecb60ab2adaf04d643/users/c0fd25fdf6154d42a06be866e4d47712/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:11.880243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:11.880744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:11.881539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:11.891946 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1055/2136] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:11.891946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:11.921315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb9a78-80c3-497c-81ca-832184159d15 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:11.931693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:11.933360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:11.963252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:12.062237 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1082/2137] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:12.073631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:12.093428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:12.093887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.094164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.094432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.095075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:12.096681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba6b7b-49e4-4324-95b4-63280103cd16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:12.101734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:12.135049 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1056/2138] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:12.145410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.145724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.146003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.221410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:12.222642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:12.228578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26826d0-5b04-4c94-8cda-db32b6fef2aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:12.236410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:12.237411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.237699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.237977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.238840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:12.243429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:12.251360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1057/2139] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:12.252275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:12.289674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2874476-ac08-4858-84e6-15c05d9eed97 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:12.311691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:12.312466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.312750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.322436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] PATH_INFO: `/v3/projects/1b35ef71883643ecb60ab2adaf04d643/users/c0fd25fdf6154d42a06be866e4d47712/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.339390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b35ef71883643ecb60ab2adaf04d643, user_id=c0fd25fdf6154d42a06be866e4d47712, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:12.342193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f943a1a-29d7-4a52-80be-fc7a7aa04215 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:12.389805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1083/2141] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:12 2022] POST /identity/v3/projects => generated 379 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:12.389991 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1058/2141] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:12 2022] PUT /identity/v3/projects/1b35ef71883643ecb60ab2adaf04d643/users/c0fd25fdf6154d42a06be866e4d47712/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:12.392478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.394875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:12.407649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.408586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.424531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:12.560155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] MFA Rules not processed for user `c0fd25fdf6154d42a06be866e4d47712`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:12.562077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:12.611133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f94053-699f-4106-b907-0fa38a857cb7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:12.625588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:12.626757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.627202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.627624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.832139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:12.877656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1059/2142] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:12.878768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:12.908493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:12.910559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b9724-6e24-4f6c-a9e1-d7eec30fb59b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:12.936972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1084/2143] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:12.938538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:12.938781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:12.939126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:12.986302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] MFA Rules not processed for user `0c29841aaaee47c8ac0bde44c50105dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:12.987528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:13.066486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd90b1-9f88-4bcc-b54c-3aaed8173362 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:13.087238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:13.088875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.091826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.092379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.093294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:13.095461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:13.144901 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1060/2144] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:12 2022] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:13.145708 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1085/2145] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:13.150792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.156717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.159110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:13.179317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c31a-a8f4-4afe-9760-0bd0c97438b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:13.189050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335555c1-6dde-4db6-b2f6-06f5e5cb0f0f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:13.194267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:13.195252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.196328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.197160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.198551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:13.202282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:13.207422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:13.208425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.209038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.213243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.217592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:13.236315 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1086/2146] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:13.239863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.245456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:13.247324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:13.265612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1061/2147] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:13.277960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a378f-9e85-4b4f-8756-a9fada31cd5e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:13.296624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:13.296624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.300458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.301377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.302078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:13.307516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7cdfb-48d0-4f9b-80c2-e254c2b5d85b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:13.340974 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1087/2148] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:13.342634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.371928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1b81-06ab-4e39-9fde-ac26eddb7e77 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:13.392664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:13.393378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.393654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.394098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] PATH_INFO: `/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb/users/e99069439abe4f61b37c34ffe98d8b7c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.430835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3857b7f90a764b2da93cdc4b27ec2ffb, user_id=e99069439abe4f61b37c34ffe98d8b7c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:13.435501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:13.476603 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1062/2149] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:13 2022] PUT /identity/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb/users/e99069439abe4f61b37c34ffe98d8b7c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:13.478170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:13.478579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:13.478964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:13.616501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] MFA Rules not processed for user `e99069439abe4f61b37c34ffe98d8b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:13.620882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:13.899279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1088/2150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:13.900533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.917198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:13.920238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:13.966192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:14.091930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:14.116677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e91fa9-7be0-406a-952e-cd11d356e3da None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.123151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.123808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.124083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.124609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] PATH_INFO: `/v3/projects/a43a15d33c0e46a6ac391e12b70e5f53` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.133533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43a15d33c0e46a6ac391e12b70e5f53)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.135796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.156755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb319c15-28b3-4386-b444-9e274aae4d91 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.189806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.190569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.192011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.194029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.194863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.203644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.274657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43a15d33c0e46a6ac391e12b70e5f53', 'request_id': 'req-3687bf7b-aa33-40ec-952b-123b501d4199'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.279815 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1063/2151] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:13 2022] POST /identity/v3/projects => generated 379 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:14.284708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.292214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43a15d33c0e46a6ac391e12b70e5f53', 'request_id': 'req-3687bf7b-aa33-40ec-952b-123b501d4199'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.319060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43a15d33c0e46a6ac391e12b70e5f53', 'request_id': 'req-3687bf7b-aa33-40ec-952b-123b501d4199'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.348957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] The token cache is being invalidate because project a43a15d33c0e46a6ac391e12b70e5f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:14.352442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.355885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.361786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1089/2152] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:13 2022] DELETE /identity/v3/projects/a43a15d33c0e46a6ac391e12b70e5f53 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:14.372563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.383100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:14.484940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0a7b8-f382-425b-8198-cb63a09fcad3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.491857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.492560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.492838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.493503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.494392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.496644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640a589-7101-4726-8a45-3512a9965cd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.546656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1064/2153] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:14 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:14.548588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.548885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.550315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.551673 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1065/2154] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:14.560245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.565506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:14.573510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687bf7b-aa33-40ec-952b-123b501d4199 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.589667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543809ce-df2e-45f8-bba3-b1d414ce77e8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.590793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.591469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.591773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.592014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] PATH_INFO: `/v3/users/48fffa0932534c94a74061f055f6accd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.593280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fffa0932534c94a74061f055f6accd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.595378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.600841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.601778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.602222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.602684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.603494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.609913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dd871-3440-4aa6-891a-bd53e6a267ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.626442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1066/2155] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:14.631323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.631841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.632501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.665941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:14.668830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:14.735433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fffa0932534c94a74061f055f6accd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.750302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fffa0932534c94a74061f055f6accd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.751190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fffa0932534c94a74061f055f6accd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.767026 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1067/2156] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:02:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:14.768538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.776301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fffa0932534c94a74061f055f6accd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.778929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fffa0932534c94a74061f055f6accd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:14.808161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2711-9628-471d-a2e3-aa80dda14e14 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:14.816410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:14.817129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:14.817464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:14.818544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] PATH_INFO: `/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89/users/d9e5f2aec6c5429cb79fac1067af7d7f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:14.850243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf33d336f3d4ae08ebefbb5b61dcd89, user_id=d9e5f2aec6c5429cb79fac1067af7d7f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:14.853744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1090/2157] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:14 2022] DELETE /identity/v3/users/48fffa0932534c94a74061f055f6accd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:14.895146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:14.929378 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1068/2158] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:14 2022] PUT /identity/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89/users/d9e5f2aec6c5429cb79fac1067af7d7f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:14.936916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.939501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:14.950549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:14.950891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:14.953688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:14.972736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:15.145770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168e44-b6d8-46c4-abfb-85d925af7702 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:15.180349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513604-8b4f-4e99-bce2-95a267443af8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:15.203596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:15.204360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.204844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.205306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.219233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:15.268306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:15.271324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ac65c-950d-4f2f-aa0f-a8aa0c5120f3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:15.298565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1069/2159] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:15.371730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.372393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.372871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.403219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:15.404669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.404981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.406478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.407022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:15.416268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:15.449423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] MFA Rules not processed for user `19e2cb9474fb47a6b3f3793c7f162caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:15.450925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:15.460352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1091/2160] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:15.463005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:15.495641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af607eb4-28e7-43ee-a38a-db862de1281d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:15.508773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:15.510513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.511962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.512270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] PATH_INFO: `/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89/users/d9e5f2aec6c5429cb79fac1067af7d7f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.518151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf33d336f3d4ae08ebefbb5b61dcd89, user_id=d9e5f2aec6c5429cb79fac1067af7d7f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:15.533861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22955-b8ad-489c-97de-36259b749c20 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:15.567285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1092/2161] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:15 2022] PUT /identity/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89/users/d9e5f2aec6c5429cb79fac1067af7d7f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:15.579103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.579429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.579718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.643801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] MFA Rules not processed for user `d9e5f2aec6c5429cb79fac1067af7d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:15.645262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:15.706233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1070/2162] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:15.716377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:15.719120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:15.753376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb128-cd22-459d-bd49-b8e451dd58df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:15.946408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:15.947343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:15.947626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:15.947889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:15.950508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:15.958161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:15.969961 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1093/2163] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:15.971960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:15.982469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.010498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eadb44-c74f-4dac-a584-cf1e96a8c410 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.044840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.044840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.044840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.044840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] PATH_INFO: `/v3/projects/d97ad842918d4bcd8418405b594f2c6d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.046900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97ad842918d4bcd8418405b594f2c6d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.046900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.070640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:16.127077 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1071/2164] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:15 2022] POST /identity/v3/projects => generated 395 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:16.132191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.178744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97ad842918d4bcd8418405b594f2c6d', 'request_id': 'req-5d78f093-5365-4b8f-9849-8eb065072b70'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:16.190616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97ad842918d4bcd8418405b594f2c6d', 'request_id': 'req-5d78f093-5365-4b8f-9849-8eb065072b70'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:16.199608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97ad842918d4bcd8418405b594f2c6d', 'request_id': 'req-5d78f093-5365-4b8f-9849-8eb065072b70'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:16.223581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:16.225136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] The token cache is being invalidate because project d97ad842918d4bcd8418405b594f2c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:16.225713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:16.226900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:16.228607 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1094/2165] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:15 2022] DELETE /identity/v3/projects/d97ad842918d4bcd8418405b594f2c6d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:16.232535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.232944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.352980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb713e6-8133-412a-a6ac-dbd64c1cb196 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.375287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f093-5365-4b8f-9849-8eb065072b70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.383414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.384144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.384426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.384725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.386982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.501778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.502926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.503507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.504532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.507100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.508174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.509795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.509992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2881b95-228d-4b49-9c2e-56f5c4b7c752 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.522541 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1095/2166] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:16.540465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28989f5-5235-4f96-9b8c-09466ba9820c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.543056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28989f5-5235-4f96-9b8c-09466ba9820c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.543451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28989f5-5235-4f96-9b8c-09466ba9820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.547244 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1072/2167] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:16 2022] POST /identity/v3/users => generated 304 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:16.558588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.566964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.610244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b625b-9c9b-48e9-9bbb-3d7c747773d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.619734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a28989f5-5235-4f96-9b8c-09466ba9820c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:16.623384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a28989f5-5235-4f96-9b8c-09466ba9820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.634203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.637103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.637604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.637889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.639991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.641906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.646645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1096/2168] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:16.654602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1ce7-2569-4ad7-bcb4-de18d982e2ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.655838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1ce7-2569-4ad7-bcb4-de18d982e2ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.656323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd1ce7-2569-4ad7-bcb4-de18d982e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.700810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1073/2169] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:16.700810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.724485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-67cd1ce7-2569-4ad7-bcb4-de18d982e2ba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:16.727458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa3f0-8160-4ead-8ace-ed529a17f305 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.731789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67cd1ce7-2569-4ad7-bcb4-de18d982e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.733605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.734632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.735082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.735506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] PATH_INFO: `/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8/users/40e9628b43bc45958644160c3a8e943d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.761922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a6afd133f34c0caf0d2933249fd8a8, user_id=40e9628b43bc45958644160c3a8e943d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.764302 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1097/2170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:16.764903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.766041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45e7c-1ab3-4a6e-ab23-32a48f166eb6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.766501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45e7c-1ab3-4a6e-ab23-32a48f166eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.767229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45e7c-1ab3-4a6e-ab23-32a48f166eb6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.774416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1098/2171] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:16.775549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45e7c-1ab3-4a6e-ab23-32a48f166eb6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.786361 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1074/2172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:16 2022] PUT /identity/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8/users/40e9628b43bc45958644160c3a8e943d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:16.787916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:16.796197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:16.798064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45e7c-1ab3-4a6e-ab23-32a48f166eb6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.835447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:16.930318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.930951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.931236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.931509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.932173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:16.932477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.936816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:16.962320 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1099/2173] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:16.962320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:16.984784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7a8f-1e29-48e3-b9fa-1c18c1611d6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:16.993235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:16.993917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:16.994202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:16.994475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:16.996219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:16.998164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.015461 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1100/2174] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:17.017529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.035056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d93d13-1040-4694-b9dc-4e64ebf026a5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.043924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.044758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.045193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.045665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.046651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.049721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.072626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.094317 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1101/2175] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:17 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:17.096137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.135647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:17.291632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab460e-4626-461b-ba19-c10351cb66f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.297908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.298961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.299958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.300471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] PATH_INFO: `/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8/users/40e9628b43bc45958644160c3a8e943d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.302635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a6afd133f34c0caf0d2933249fd8a8, user_id=40e9628b43bc45958644160c3a8e943d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.305341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.311045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb5493-d3d2-4021-81d5-66300cb84ba4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.323716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1102/2176] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:17 2022] PUT /identity/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8/users/40e9628b43bc45958644160c3a8e943d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:17.323716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.511015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940197f7-5b3d-4246-a5a6-1cf3fd7ed2b4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.511713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e5f2aec6c5429cb79fac1067af7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf33d336f3d4ae08ebefbb5b61dcd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.513820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.514304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.514722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] PATH_INFO: `/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.520116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: Authorizing `identity:get_project(project_id=3857b7f90a764b2da93cdc4b27ec2ffb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.527012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.527012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.527012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.527012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.529528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.529767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.534896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.547256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1075/2177] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:16 2022] GET /identity/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb => generated 379 bytes in 758 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:17.585478 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1103/2178] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:17 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:17.587434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.590121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.602747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:17.613718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53279bd9-e40d-4134-b5e4-bcaaae9e4125 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.626607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.627959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.629092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.629522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.631551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.634714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.663949 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1104/2179] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:17.667904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.713478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb528db-8f25-4fac-b82d-6562a6aacc78 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.744014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.745293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.745578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.746316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.746789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.757671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.805036 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1105/2180] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:17.806180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:17.817096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140072e4-2c24-4b5d-bde5-17f88388ac5c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.834248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.835062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.835447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.836507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.840453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:17.843432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ef5fb-466d-4050-9d5c-63a1c322dc5f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:17.857663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:17.860863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.861360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.861857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] PATH_INFO: `/v3/projects/32ade5f58ea543ceb17c4bb5d230705f/users/ab2aa9c224654cfbbc1559ed58556ad5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:17.908516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ade5f58ea543ceb17c4bb5d230705f, user_id=ab2aa9c224654cfbbc1559ed58556ad5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:17.911719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886baf1-0d17-49fc-9f7a-36c51b714e7a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:17.956176 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1106/2181] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:17 2022] PUT /identity/v3/projects/32ade5f58ea543ceb17c4bb5d230705f/users/ab2aa9c224654cfbbc1559ed58556ad5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:17.961317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:17.961827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:17.962483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:18.007378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:18.008404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:18.048348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:18.050462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53997-bee6-4951-9de7-7f2bc9494ea7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:18.077082 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1076/2182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:18.172977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1107/2183] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:18.211604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:18.212839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:18.213402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:18.217525 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1077/2184] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:18.217812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:18.219650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:18.227075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:18.234790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:18.432488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237505b-4fb5-4a77-8701-b357048683f5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:18.443617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:18.444249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:18.444524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:18.444795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:18.469717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:18.471341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:18.494299 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1108/2185] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:18.528800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:18.746192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d358804-9fd7-4e30-b5b6-0e12c316ad6c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:18.759790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9e5f2aec6c5429cb79fac1067af7d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf33d336f3d4ae08ebefbb5b61dcd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:18.760499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:18.760776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:18.761067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] PATH_INFO: `/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:18.765398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: Authorizing `identity:get_project(project_id=3857b7f90a764b2da93cdc4b27ec2ffb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:18.767762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac2dd8-dbc8-4703-a96d-038fd276822c tempest-FlavorsAccessTestJSON-1191685341 tempest-FlavorsAccessTestJSON-1191685341-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:18.785840 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1078/2186] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:18 2022] GET /identity/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb => generated 379 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:19.381817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:19.384364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:19.410410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb23-0a35-49d7-b957-29cc036a7192 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:19.425241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:19.426303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:19.426779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:19.427275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] PATH_INFO: `/v3/users/e99069439abe4f61b37c34ffe98d8b7c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:19.428984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99069439abe4f61b37c34ffe98d8b7c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:19.431826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:19.524514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99069439abe4f61b37c34ffe98d8b7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:19.540509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99069439abe4f61b37c34ffe98d8b7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:19.542484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99069439abe4f61b37c34ffe98d8b7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:19.547432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:19.558939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99069439abe4f61b37c34ffe98d8b7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:19.560943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99069439abe4f61b37c34ffe98d8b7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:19.609162 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1109/2187] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:19 2022] DELETE /identity/v3/users/e99069439abe4f61b37c34ffe98d8b7c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:19.617839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:19.618361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:19.618476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:19.663431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:19.666531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:19.782831 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1079/2188] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:20.430285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:20.433051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:20.535470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0a87-14bd-4b95-823c-846c3ef0323e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:20.540622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:20.541366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:20.541832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:20.542177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:20.632155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:20.634706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:20.689704 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1110/2189] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:22.429410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:22.431779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:22.466670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f615-b400-4da2-aa36-e7fb81f652b1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:22.499221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:22.503358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:22.506610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:22.507192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] PATH_INFO: `/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:22.515135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3857b7f90a764b2da93cdc4b27ec2ffb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:22.525132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:22.652069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:22.674099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3857b7f90a764b2da93cdc4b27ec2ffb', 'request_id': 'req-5d8ebce9-937f-4027-b831-a5621044130c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:22.695676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3857b7f90a764b2da93cdc4b27ec2ffb', 'request_id': 'req-5d8ebce9-937f-4027-b831-a5621044130c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:22.707373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3857b7f90a764b2da93cdc4b27ec2ffb', 'request_id': 'req-5d8ebce9-937f-4027-b831-a5621044130c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:22.736639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] The token cache is being invalidate because project 3857b7f90a764b2da93cdc4b27ec2ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:22.737364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:22.738143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:22.739963 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1080/2190] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:22 2022] DELETE /identity/v3/projects/3857b7f90a764b2da93cdc4b27ec2ffb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:22.744161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:22.758484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d5de-2219-49bf-ba83-3bd8a5e69a82 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:22.886476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:22.887193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:22.887548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:22.888668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] PATH_INFO: `/v3/users/d9e5f2aec6c5429cb79fac1067af7d7f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:22.889422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e5f2aec6c5429cb79fac1067af7d7f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:22.904713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:23.007604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e5f2aec6c5429cb79fac1067af7d7f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:23.021840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e5f2aec6c5429cb79fac1067af7d7f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:23.023900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e5f2aec6c5429cb79fac1067af7d7f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:23.037724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e5f2aec6c5429cb79fac1067af7d7f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:23.039183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4886ab1f-3c60-4fa9-a430-72752787a9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e5f2aec6c5429cb79fac1067af7d7f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:23.060391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:23.082667 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1111/2191] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:22 2022] DELETE /identity/v3/users/d9e5f2aec6c5429cb79fac1067af7d7f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:25.151054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:25.153214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:25.204769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ebce9-937f-4027-b831-a5621044130c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:25.340215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:25.341208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:25.343018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:25.343434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] PATH_INFO: `/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:25.347985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf33d336f3d4ae08ebefbb5b61dcd89)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:25.358479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:25.450218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf33d336f3d4ae08ebefbb5b61dcd89', 'request_id': 'req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:25.469860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf33d336f3d4ae08ebefbb5b61dcd89', 'request_id': 'req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:25.487035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf33d336f3d4ae08ebefbb5b61dcd89', 'request_id': 'req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:25.508967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] The token cache is being invalidate because project ecf33d336f3d4ae08ebefbb5b61dcd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:25.509637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:25.510853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ab023ef7-c39e-4fa4-a548-2d23eceae0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:25.519778 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1081/2192] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:25 2022] DELETE /identity/v3/projects/ecf33d336f3d4ae08ebefbb5b61dcd89 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:25.524042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:25.524669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:25.524669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:25.598534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:25.600742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:25.800532 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1112/2193] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:25.814864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:25.815259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:25.815661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:25.857842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:25.859261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:25.884862 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1082/2194] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:25.887845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:25.904646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948018d-acba-44b4-ab78-beaf4c3f7eb1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:25.920074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:25.921953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:25.921953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:25.921953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:25.921953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:25.922332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:25.934394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:25.957527 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1113/2195] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:25.960483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:25.971642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcb2ba-eeec-4dc3-8baa-981507ded3fc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:25.991661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:25.992765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:25.992765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:25.993211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:25.993964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:25.996015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:26.059411 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1083/2196] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:25 2022] POST /identity/v3/projects => generated 395 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:26.060941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:26.086244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31ef-2ddd-4c64-8d3c-4d09e5649636 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:26.224520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:26.225695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:26.226140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:26.227744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:26.229341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:26.235244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:26.274177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1114/2197] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:26 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:26.274948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:26.294007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8734c4-fcfd-4936-88b0-7f8a1f805909 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:26.309189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:26.309934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:26.310317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:26.310716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:26.311478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:26.316174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:26.354585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1084/2198] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:02:26.362412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:26.382327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b674b3b-7213-407f-a6e4-e3cd81a44a70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:26.396870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:26.398510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:26.399956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:26.400238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:26.401344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:26.408248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4803b2-82e8-403f-92f3-2df8fd3ef4b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:26.457715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1115/2199] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:26.459320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:26.476671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab8ced-41ac-48e6-bd9c-eb744fe724fb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:26.496782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:26.498597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:26.498989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:26.499362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] PATH_INFO: `/v3/projects/a340d34f7e7b44c4aa647fd7bff319f8/users/1d4959d2844b42779f1f15aaca375094/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:26.534788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:26.544833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a340d34f7e7b44c4aa647fd7bff319f8, user_id=1d4959d2844b42779f1f15aaca375094, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:26.550480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:26.581518 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1085/2200] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:26 2022] PUT /identity/v3/projects/a340d34f7e7b44c4aa647fd7bff319f8/users/1d4959d2844b42779f1f15aaca375094/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:26.595242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:26.603836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:26.604430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:26.658837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] MFA Rules not processed for user `1d4959d2844b42779f1f15aaca375094`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:26.668906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:26.779488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:26.827128 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1116/2201] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:26.828295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.004915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06639f8-b8d0-429e-a664-17652212318b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.015548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.016687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.016982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.017290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.018545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.022461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.079335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.080690 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1086/2202] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:26 2022] POST /identity/v3/projects => generated 391 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:27.097854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfa056-b29b-4415-b9ac-fb8df34cf155 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.286226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.287532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.287917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.288313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.289108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.292587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.346484 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1117/2203] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:27 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:27.347759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.371356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec79381-a48a-48da-98c5-0490ce10af70 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.377756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.378383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.378701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.378972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.379621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.386508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.419669 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1087/2204] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:27.420455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.448243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435978-6d5d-41ba-bc15-cfe5fd85c1bd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.465874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.466751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.467136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.467519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] PATH_INFO: `/v3/projects/6315301625544772a2ea4994f6b14bde/users/4efe54e12864454e8fb917d8df607391/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.496443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6315301625544772a2ea4994f6b14bde, user_id=4efe54e12864454e8fb917d8df607391, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.499383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.530945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1118/2205] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:27 2022] PUT /identity/v3/projects/6315301625544772a2ea4994f6b14bde/users/4efe54e12864454e8fb917d8df607391/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:27.534807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.558337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4afad3-a6a8-494f-9aff-e1945e387bdd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.717710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.718600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.719215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.721426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.722384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.729912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87c9eb-c8e2-44b3-bf9f-7c9e42fc94e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.760890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1088/2206] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:27.765109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:27.782606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f667fed-5dd8-4d96-9dcf-0878c7c62c41 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:27.797949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:27.799483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.799787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.800060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] PATH_INFO: `/v3/projects/6315301625544772a2ea4994f6b14bde/users/4efe54e12864454e8fb917d8df607391/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.804278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6315301625544772a2ea4994f6b14bde, user_id=4efe54e12864454e8fb917d8df607391, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:27.813287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:27.842909 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1119/2207] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:27 2022] PUT /identity/v3/projects/6315301625544772a2ea4994f6b14bde/users/4efe54e12864454e8fb917d8df607391/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:27.856731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:27.857204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:27.857548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:27.910746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] MFA Rules not processed for user `4efe54e12864454e8fb917d8df607391`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:27.912870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:28.012076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:28.055203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1089/2208] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:28.069993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:28.071914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:28.249399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a2d6d-5a6b-467b-9d0b-a7d97c147721 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:28.268477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:28.269198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:28.269501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:28.269840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:28.297426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:28.299043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc6cd9-9ad6-4561-9772-b7b8f3ec9262 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:28.310716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1120/2209] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:28.657448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:28.894850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3519ab-199a-4eb7-91bb-6e5c740f149e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:28.917195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:28.917899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:28.918186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:28.918465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] PATH_INFO: `/v3/users/1d4959d2844b42779f1f15aaca375094` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:28.922181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4959d2844b42779f1f15aaca375094)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:28.932438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:29.052685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4959d2844b42779f1f15aaca375094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:29.053788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4959d2844b42779f1f15aaca375094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:29.068366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4959d2844b42779f1f15aaca375094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:29.070265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4959d2844b42779f1f15aaca375094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:29.089150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4959d2844b42779f1f15aaca375094'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:29.124230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1090/2210] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:28 2022] DELETE /identity/v3/users/1d4959d2844b42779f1f15aaca375094 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:29.128814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b9be-43fa-4aaa-8fe9-efc53b8432b0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:29.129319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b9be-43fa-4aaa-8fe9-efc53b8432b0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:29.129402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598b9be-43fa-4aaa-8fe9-efc53b8432b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:29.163790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4598b9be-43fa-4aaa-8fe9-efc53b8432b0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:29.165105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4598b9be-43fa-4aaa-8fe9-efc53b8432b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:29.264325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:29.352903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1121/2211] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:29.385265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:29.387717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:29.525697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bb40-b2bc-41af-b066-dbc55c14217e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:29.546727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:29.547479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:29.547877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:29.548246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:29.572599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:29.574730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc22a-a36c-4d1d-933a-64afbdc40f44 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:29.598120 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1091/2212] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:31.124861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:31.126825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:31.127612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:31.210230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] MFA Rules not processed for user `40e9628b43bc45958644160c3a8e943d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:31.213626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:31.413124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1122/2213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:31.423788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:31.424651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:31.425265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:31.462193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:31.490403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] MFA Rules not processed for user `19e2cb9474fb47a6b3f3793c7f162caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:31.495276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:31.690246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:31.691942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:31.733342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922868d-edf2-41ad-8569-98efd3159314 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:31.744961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:31.746756 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1092/2214] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:31.747897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:31.748342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:31.755363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:31.755568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] PATH_INFO: `/v3/projects/a340d34f7e7b44c4aa647fd7bff319f8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:31.755697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:31.757804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a340d34f7e7b44c4aa647fd7bff319f8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:31.762804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:31.904790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a340d34f7e7b44c4aa647fd7bff319f8', 'request_id': 'req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:31.920351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a340d34f7e7b44c4aa647fd7bff319f8', 'request_id': 'req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:31.942077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a340d34f7e7b44c4aa647fd7bff319f8', 'request_id': 'req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:31.970527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] The token cache is being invalidate because project a340d34f7e7b44c4aa647fd7bff319f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:31.970527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:31.971216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:31.977232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1123/2215] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:31 2022] DELETE /identity/v3/projects/a340d34f7e7b44c4aa647fd7bff319f8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:31.982051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:31.985291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:31.986021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611178e-b86c-4cbc-9e48-6e63abbc068a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:32.081112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:32.137819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6e0fe-c442-4c4f-b8c3-082370ba45b5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:32.153944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:32.154947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:32.155057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:32.155290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] PATH_INFO: `/v3/users/4efe54e12864454e8fb917d8df607391` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:32.156472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4efe54e12864454e8fb917d8df607391)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:32.158439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:32.248916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:32.250394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:32.251634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:32.252365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:32.259006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:32.359508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4efe54e12864454e8fb917d8df607391'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:32.378224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4efe54e12864454e8fb917d8df607391'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:32.378758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4efe54e12864454e8fb917d8df607391'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:32.397743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4efe54e12864454e8fb917d8df607391'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:32.397997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4efe54e12864454e8fb917d8df607391'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:32.420448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:32.468499 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1124/2216] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:31 2022] DELETE /identity/v3/users/4efe54e12864454e8fb917d8df607391 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:32.474251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:32.478525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b7b8-1f4b-4c6e-bff2-b4117f87455e service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:32.523505 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1093/2217] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:34.012724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:34.015233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:34.226359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed0c27-e64c-435b-8f2e-9c9e9752716a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:34.232828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:34.233730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:34.234891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:34.235377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] PATH_INFO: `/v3/projects/6315301625544772a2ea4994f6b14bde` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:34.238039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6315301625544772a2ea4994f6b14bde)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:34.242532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:34.385536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6315301625544772a2ea4994f6b14bde', 'request_id': 'req-93953ad0-e62a-4c47-b51a-a47ca6495654'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:34.397532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6315301625544772a2ea4994f6b14bde', 'request_id': 'req-93953ad0-e62a-4c47-b51a-a47ca6495654'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:34.403204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:34.411911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6315301625544772a2ea4994f6b14bde', 'request_id': 'req-93953ad0-e62a-4c47-b51a-a47ca6495654'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:34.434935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] The token cache is being invalidate because project 6315301625544772a2ea4994f6b14bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:34.436107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:34.440587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-93953ad0-e62a-4c47-b51a-a47ca6495654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:34.443803 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1125/2218] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:34 2022] DELETE /identity/v3/projects/6315301625544772a2ea4994f6b14bde => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:34.449074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:34.450250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:34.450669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:34.497250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:34.498788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:34.720154 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1094/2219] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:34.728888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:34.729265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:34.729544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:34.787177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:34.788422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:34.828129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:34.828335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1126/2220] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:34.864922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc53f7-8630-4dd8-b5d1-32f74c96c58f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:34.872299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:34.872919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:34.873295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:34.873567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:34.874225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:34.874526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:34.877831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:34.904235 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1095/2221] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:02:34.908539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:34.925817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557193-a35b-4c82-928d-64cc4e936766 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:34.946926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:34.955924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:34.956234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:34.956510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:34.957205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:34.959672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:35.030540 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1127/2222] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:34 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:35.031662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:35.049840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c635a-f295-454c-8a28-a6b8f2a47b80 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:35.220804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:35.221613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.221959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.222321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.222975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:35.225906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:35.292884 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1096/2223] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:35 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:02:35.296752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:35.351020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262301b9-178b-4889-9f59-be6297f5e2f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:35.382771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:35.383384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.383703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.384019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.384790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:35.386582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:35.412789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:35.414152 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1128/2224] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:35.429140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b141-40c6-4a08-b120-bc6c3fdf63e3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:35.458936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:35.459565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.461497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.462311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.463620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:35.471722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96edba-95e6-466b-ae2a-e5f3adbdc1dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:35.525910 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1097/2225] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:02:35.528742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:35.544290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eff791-9dbe-4172-8233-6e46d6c88e49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:35.567547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:35.568939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.569500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.569991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] PATH_INFO: `/v3/projects/c79a9ff5ef814ca0b3459cd4bb882520/users/61a67b1245654a9ea0cf1cb768238492/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.628600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79a9ff5ef814ca0b3459cd4bb882520, user_id=61a67b1245654a9ea0cf1cb768238492, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:35.670621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbca80a-4997-4ecd-a73f-3485c3e0ce66 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:35.719564 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1129/2226] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:35 2022] PUT /identity/v3/projects/c79a9ff5ef814ca0b3459cd4bb882520/users/61a67b1245654a9ea0cf1cb768238492/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:35.731855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.732481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.733061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.791031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:35.792200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:35.793549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:35.825775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] MFA Rules not processed for user `61a67b1245654a9ea0cf1cb768238492`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:35.828429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:35.901810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] MFA Rules not processed for user `ab2aa9c224654cfbbc1559ed58556ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:35.906866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:36.001220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:36.070272 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1098/2227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:36.077510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.126553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1130/2228] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:36.133316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.146637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:36.377670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907e96-eb27-4c75-ba70-ec2be3c73b73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.393865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.418039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.418381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.418694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.419464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.428510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.438137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e089-2edf-453f-8f80-0241e7704ba8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.453726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.454765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.455256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.455762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.456627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.459885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca73c8-b9c9-4ac3-806e-72cc82e6607f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.512822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:36.531107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1131/2229] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:36 2022] POST /identity/v3/projects => generated 369 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:36.532686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.533423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.533961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.559432 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1099/2230] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:36 2022] POST /identity/v3/projects => generated 383 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:02:36.560463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.583554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] MFA Rules not processed for user `2afa642202234799a50a8460a3b6d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:36.585275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:36.742992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9da-75ef-48db-98b2-39c89eda11ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.749430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1132/2231] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:36.750733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.760668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.762769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.763041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.763316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.769094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.777895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.783240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581466b9-0a8f-40bc-a564-3657dd55e732 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.799351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.799979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.800260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.801989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.804617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.809481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.829067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1100/2232] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:36 2022] POST /identity/v3/users => generated 291 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:36.832847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.859538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff241-2666-4c84-8e3e-69a2a23ece50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.862933 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1133/2233] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:36 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:36.867328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.881047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06bb55-7cbd-43a4-9926-0610e5b632c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.882036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.882860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.883288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.883774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.884569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.886370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.887870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.888609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.889259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.889597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.890387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.902811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:36.918048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1101/2234] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:02:36.918996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.929262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1134/2235] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:02:36.935596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266a558-8408-46d1-81ce-446f109f25f0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.936126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:36.947906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.948706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.949588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.949588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] PATH_INFO: `/v3/projects/91c98a50654447c8b30bbb5783c54e33/users/cff9aa4b18a046e48392df7ed9120d01/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:36.968601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8f44c-fbac-481f-9669-478768077426 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:36.977516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:36.979217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c98a50654447c8b30bbb5783c54e33, user_id=cff9aa4b18a046e48392df7ed9120d01, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:36.987034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:36.987630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:36.988143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] PATH_INFO: `/v3/projects/ac1f71328d1142db836d66fc6ecafa57/users/3f911b106b0e4ab694e8119f59f3198f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.004073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.016468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1f71328d1142db836d66fc6ecafa57, user_id=3f911b106b0e4ab694e8119f59f3198f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:37.021352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.053970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1102/2236] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:36 2022] PUT /identity/v3/projects/91c98a50654447c8b30bbb5783c54e33/users/cff9aa4b18a046e48392df7ed9120d01/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:37.056428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:37.063906 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1135/2237] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:36 2022] PUT /identity/v3/projects/ac1f71328d1142db836d66fc6ecafa57/users/3f911b106b0e4ab694e8119f59f3198f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:37.066166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:37.123925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:37.220362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2795-b784-495f-8791-ade1f728ea21 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:37.292786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf345e2b-90cc-45fb-8c57-c831e0405b69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:37.314756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:37.316075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:37.316676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:37.316676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.320034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:37.323829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.358600 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1136/2238] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:02:37.361097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:37.375014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:37.375921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:37.376516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:37.377014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.377864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:37.380757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.396070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e4c4-3965-46b5-b42a-1f3e78ade494 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:37.396926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1103/2239] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:37.411808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:37.412513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:37.412791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:37.413089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] PATH_INFO: `/v3/projects/ac1f71328d1142db836d66fc6ecafa57/users/3f911b106b0e4ab694e8119f59f3198f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.416903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:37.417737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1f71328d1142db836d66fc6ecafa57, user_id=3f911b106b0e4ab694e8119f59f3198f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:37.419918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5e980-6d8a-43f9-ab8d-5decea383464 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.457474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1137/2240] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:37 2022] PUT /identity/v3/projects/ac1f71328d1142db836d66fc6ecafa57/users/3f911b106b0e4ab694e8119f59f3198f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:37.460352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:37.461249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:37.461538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.467121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f8a31-0a34-4a25-b3bb-c26ad42eef2d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:37.516021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] MFA Rules not processed for user `3f911b106b0e4ab694e8119f59f3198f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:37.517304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:37.567189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:37.669252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:37.670067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:37.670350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:37.670620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] PATH_INFO: `/v3/projects/91c98a50654447c8b30bbb5783c54e33/users/cff9aa4b18a046e48392df7ed9120d01/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:37.673085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1138/2241] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:37.674689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c98a50654447c8b30bbb5783c54e33, user_id=cff9aa4b18a046e48392df7ed9120d01, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:37.684160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:37.707202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1104/2242] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:37 2022] PUT /identity/v3/projects/91c98a50654447c8b30bbb5783c54e33/users/cff9aa4b18a046e48392df7ed9120d01/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:38.272085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:38.273726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:38.461729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e1cc-1df1-4569-adcb-165c2ed5dc01 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:38.615505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:38.617781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:38.619512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:38.619811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:38.775381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:38.790103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:38.791847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b895102-ddfd-4a30-b8e0-6dd2a2cfb74f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:38.805912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1139/2243] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:40.874439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:41.079783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04eb4a-7de3-4c96-8e18-6b9dba5dfd64 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:41.087078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:41.087857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:41.088244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:41.088625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] PATH_INFO: `/v3/users/61a67b1245654a9ea0cf1cb768238492` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:41.090546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a67b1245654a9ea0cf1cb768238492)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:41.092932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:41.094918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:41.238454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a67b1245654a9ea0cf1cb768238492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:41.240243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a67b1245654a9ea0cf1cb768238492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:41.263311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a67b1245654a9ea0cf1cb768238492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:41.265734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a67b1245654a9ea0cf1cb768238492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:41.284463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a67b1245654a9ea0cf1cb768238492'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:41.337777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1105/2244] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:40 2022] DELETE /identity/v3/users/61a67b1245654a9ea0cf1cb768238492 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:41.339459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:41.339926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:41.340028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:41.381068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:41.384402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:41.597767 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1140/2245] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:41.717618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:41.720513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:41.963810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4f2b8-c506-4478-916d-3537c215a9a5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:41.991002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:41.991868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:41.992323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:41.992744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:42.027158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:42.030361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:42.070393 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1106/2246] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:42.828121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:42.831288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:43.041435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:43.044524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:43.069940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1615adc-98c2-49a6-a3eb-d3db58b7d8b1 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:43.078224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:43.080102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:43.080573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:43.081527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:43.083489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc58034-cf39-49d9-98d6-66a25b120ba1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:43.085055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:43.095508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:43.096151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:43.096432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:43.096702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:43.098628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:43.204817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:43.208966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:43.225805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1141/2247] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:43.286640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:43.288315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:43.321669 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1107/2248] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:44.274566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:44.279075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:44.350188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9d8c2-bd2a-4e75-9d16-ef401a7582ef service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:44.405276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:44.413641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:44.416219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:44.416504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] PATH_INFO: `/v3/projects/c79a9ff5ef814ca0b3459cd4bb882520` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:44.423353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79a9ff5ef814ca0b3459cd4bb882520)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:44.425422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:44.528571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:44.631815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79a9ff5ef814ca0b3459cd4bb882520', 'request_id': 'req-2c641086-fb3c-4d4f-8277-929b293da3c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:44.644607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79a9ff5ef814ca0b3459cd4bb882520', 'request_id': 'req-2c641086-fb3c-4d4f-8277-929b293da3c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:44.653294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79a9ff5ef814ca0b3459cd4bb882520', 'request_id': 'req-2c641086-fb3c-4d4f-8277-929b293da3c1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:44.674186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] The token cache is being invalidate because project c79a9ff5ef814ca0b3459cd4bb882520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:44.674663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:44.679447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c641086-fb3c-4d4f-8277-929b293da3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:44.681512 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1142/2249] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:44 2022] DELETE /identity/v3/projects/c79a9ff5ef814ca0b3459cd4bb882520 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:44.685348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:44.703047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903922b8-81ec-4df8-bdc7-82e912ca8c28 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:44.761531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:44.890108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:44.890762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:44.891033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:44.891301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] PATH_INFO: `/v3/users/3f911b106b0e4ab694e8119f59f3198f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:44.892539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f911b106b0e4ab694e8119f59f3198f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:44.899038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:45.009713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f911b106b0e4ab694e8119f59f3198f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:45.010543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f911b106b0e4ab694e8119f59f3198f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:45.027478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f911b106b0e4ab694e8119f59f3198f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:45.030000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f911b106b0e4ab694e8119f59f3198f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:45.046656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f911b106b0e4ab694e8119f59f3198f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:45.096047 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1108/2250] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:44 2022] DELETE /identity/v3/users/3f911b106b0e4ab694e8119f59f3198f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:45.443629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:45.448024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:45.448277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:45.524011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] MFA Rules not processed for user `0c29841aaaee47c8ac0bde44c50105dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:45.525425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:45.679910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1143/2251] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:46.840850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:46.842349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.004774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:47.006274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.046963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef976e1-0d59-4c4c-b4ea-10c2341d5e42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:47.066054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:47.068651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.071065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.071931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] PATH_INFO: `/v3/projects/ac1f71328d1142db836d66fc6ecafa57` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.078133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1f71328d1142db836d66fc6ecafa57)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:47.087815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:47.167967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51f5a2-3adb-49c4-9d0d-4b58b6e9b390 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:47.197742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:47.198404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.198670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.199055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] PATH_INFO: `/v3/users/e087a69e4fcf42849e275585aa0b9da6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.202044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e087a69e4fcf42849e275585aa0b9da6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:47.203999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:47.259286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:47.281034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1f71328d1142db836d66fc6ecafa57', 'request_id': 'req-f5a9af43-d54a-4a1b-9e01-04aa807b354f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.301374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1f71328d1142db836d66fc6ecafa57', 'request_id': 'req-f5a9af43-d54a-4a1b-9e01-04aa807b354f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.310847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e087a69e4fcf42849e275585aa0b9da6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.315282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:47.321365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e087a69e4fcf42849e275585aa0b9da6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.322164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e087a69e4fcf42849e275585aa0b9da6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.335162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e087a69e4fcf42849e275585aa0b9da6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.335915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5869e64e-47a4-41c3-9f7f-293d244d7d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e087a69e4fcf42849e275585aa0b9da6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.342098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1f71328d1142db836d66fc6ecafa57', 'request_id': 'req-f5a9af43-d54a-4a1b-9e01-04aa807b354f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.371300 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1144/2252] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:47 2022] DELETE /identity/v3/users/e087a69e4fcf42849e275585aa0b9da6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:47.376006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e7c5-fd07-4460-a7ab-0354b9d0c1e6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.376560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e7c5-fd07-4460-a7ab-0354b9d0c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.377019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8e7c5-fd07-4460-a7ab-0354b9d0c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.384082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] The token cache is being invalidate because project ac1f71328d1142db836d66fc6ecafa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:47.384385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.387949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5a9af43-d54a-4a1b-9e01-04aa807b354f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:47.391093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1109/2253] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:46 2022] DELETE /identity/v3/projects/ac1f71328d1142db836d66fc6ecafa57 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:47.398221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.398553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.398767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.424841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3ce8e7c5-fd07-4460-a7ab-0354b9d0c1e6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:47.426698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3ce8e7c5-fd07-4460-a7ab-0354b9d0c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.456103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:47.461300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.560515 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1145/2254] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:47.638147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1110/2255] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:47.647160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.647639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.647999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.658154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:47.659990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.713099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:47.715886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:47.740571 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1146/2256] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:47.745528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:47.772901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1fb9-aba4-4600-99bd-1435ee0b038f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:47.783524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:47.786549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.786987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.788253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.800636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:47.803216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:47.805937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:47.817334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b4be-2805-41df-aaa7-5f11969e1ddc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:47.840581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:47.841602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.843034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.843529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.857754 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1147/2257] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:47.873979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:47.889189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a91bb-def0-49f2-b01d-fee49fb08caf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:47.899083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:47.899972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:47.900349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:47.900720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:47.901748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:47.903199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:47.905254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:47.908049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:47.949535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1111/2258] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:47.975195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1148/2259] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:47 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:47.979728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.005023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df650c-2fa1-49f8-99d8-b8f6dc99b13d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:48.140480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:48.141257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.141639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.142035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.142775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:48.147884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:48.189425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1112/2260] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:47 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:48.193653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.210243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab745-e1d3-44bc-91c7-92d00d6b6efe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:48.241749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:48.244820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.245230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.246153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.248059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:48.252008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:48.284442 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1149/2261] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:48.289874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.295159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:48.303521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ada67-31e1-4515-b980-3781d775cac1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:48.328155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:48.328824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.329069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.329697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.329988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:48.331848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a444d-d5c3-445c-9f1c-5c1e3991bac8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:48.362883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.368798 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1113/2262] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:48.379750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3f4b-4824-4b43-a593-26e652d4341c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:48.397836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:48.398787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.399214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.399678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] PATH_INFO: `/v3/projects/b683b367a3ba4ab487cd5b2f43559d72/users/534523ee5586447babd2bba72ed54d48/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.438452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b683b367a3ba4ab487cd5b2f43559d72, user_id=534523ee5586447babd2bba72ed54d48, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:48.441101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:48.464533 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1150/2263] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:48 2022] PUT /identity/v3/projects/b683b367a3ba4ab487cd5b2f43559d72/users/534523ee5586447babd2bba72ed54d48/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:48.483403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.484195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.484617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.530149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] MFA Rules not processed for user `534523ee5586447babd2bba72ed54d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:48.531424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:48.696676 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1114/2264] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:48.700949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.789670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:48.808187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3d92f-fe8b-4847-addd-1abfbf1fc6ae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:48.814195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:48.815058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:48.815487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:48.815898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:48.817407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:48.819838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:48.902106 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1151/2265] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:48 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:02:48.906392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:48.925385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91e6a6-4d59-4bb6-bd8d-efb9e5b42943 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.085873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.086620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.087002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.087393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.089256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.095460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.177048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1115/2266] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:48 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:02:49.181246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:49.220916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6901b6-f026-4dbb-9c5e-9a6eb1722942 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.247022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.248210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.248693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.249194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.250209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.253240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.266580 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1152/2267] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:49.271662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:49.286305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fb92-3b67-44ea-9090-8e2f042923ef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.294679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.296179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.296692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.297353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] PATH_INFO: `/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6/users/29cd0c3924c448a394267149b69b2221/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.329120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c962f7b4774ee5bfcaf423d19fe9a6, user_id=29cd0c3924c448a394267149b69b2221, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.334500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.362169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1116/2268] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:49 2022] PUT /identity/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6/users/29cd0c3924c448a394267149b69b2221/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:49.363891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:49.380325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee8703-df68-4706-821f-e5bda6593959 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.480053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.481218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.481633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.482006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.482851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.485533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecad88-4ac1-42b4-9d18-45287fdf6e52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.526287 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1153/2269] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:49.527300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:49.565498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05fe33-0377-457e-8a03-276b484e4e30 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.575277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.575952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.576233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.576504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] PATH_INFO: `/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6/users/29cd0c3924c448a394267149b69b2221/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.591204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c962f7b4774ee5bfcaf423d19fe9a6, user_id=29cd0c3924c448a394267149b69b2221, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.593251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.616744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1117/2270] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:49 2022] PUT /identity/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6/users/29cd0c3924c448a394267149b69b2221/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:49.629182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.629619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.630065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.684080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] MFA Rules not processed for user `29cd0c3924c448a394267149b69b2221`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:49.684953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:49.913744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1154/2271] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:49.915832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:49.933215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149a6d2-986f-4254-9c9a-1eddcec58931 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:49.946860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:49.947756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:49.948233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:49.948703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:49.949601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:49.950123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:49.951955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:49.983083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1118/2272] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:49.987568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:50.003763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf315c-b930-4890-9f24-feaaf677f0df None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:50.015314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:50.033762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:50.034097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:50.034416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:50.036274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:50.038456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:50.088687 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1155/2273] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:49 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:50.090104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:50.109043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f67ab1-42f8-4bc5-9681-fa9d358008a5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:50.146219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:50.237321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:50.237952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:50.239923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:50.240265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:50.241865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:50.242181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:50.250152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001aa1d-1f10-4e7a-9584-c22814d9b2e3 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:50.275036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1119/2274] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:50.286672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:50.289007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:50.357343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:50.503846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef2c1-fe19-44fd-a8ed-43aab1fbb792 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:50.522963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:50.523926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:50.524357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:50.525388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:50.540923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:50.543531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:50.559270 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1156/2275] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:50.585729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:50.586401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:50.587026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:50.593346 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1120/2276] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:50.599802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:50.626232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:50.639110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49f59c-deca-4968-bbc8-57e796c82f4d service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:50.653554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:50.656106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:50.656471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:50.657434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects/c02471b95dd04d82bcd2fef070fe1d59` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:50.661384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:get_project(project_id=c02471b95dd04d82bcd2fef070fe1d59)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:50.668044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e172-8d1c-4572-8bc4-f59dd3dbe277 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:50.677555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1157/2277] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:50 2022] GET /identity/v3/projects/c02471b95dd04d82bcd2fef070fe1d59 => generated 369 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:51.105623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:51.108390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:51.286386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaceb-0404-4af2-8ba7-f855c088e64a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.286386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaceb-0404-4af2-8ba7-f855c088e64a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.286386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaceb-0404-4af2-8ba7-f855c088e64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.307854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51f788-6f74-4464-a55f-b57769f2a732 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:51.338491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:51.342574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.342861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.345199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] PATH_INFO: `/v3/projects/d3a3257e135e42b4848850358a05cd5f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.352339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a3257e135e42b4848850358a05cd5f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:51.356768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:51.375530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-18bbaceb-0404-4af2-8ba7-f855c088e64a None None] MFA Rules not processed for user `40da67f39f4d4a6fb25ea033b0f14071`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:51.382685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18bbaceb-0404-4af2-8ba7-f855c088e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:51.498856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a3257e135e42b4848850358a05cd5f', 'request_id': 'req-18fc366a-ad34-4485-85af-16b8d29b900c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.516036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a3257e135e42b4848850358a05cd5f', 'request_id': 'req-18fc366a-ad34-4485-85af-16b8d29b900c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.528753 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1158/2278] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:51.529914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a3257e135e42b4848850358a05cd5f', 'request_id': 'req-18fc366a-ad34-4485-85af-16b8d29b900c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.530232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587249-60cd-4e14-8838-63dd9979212d None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.530527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587249-60cd-4e14-8838-63dd9979212d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.531038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587249-60cd-4e14-8838-63dd9979212d None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.533385 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1159/2279] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:51.539627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587249-60cd-4e14-8838-63dd9979212d None None] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:51.542370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42587249-60cd-4e14-8838-63dd9979212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:51.565355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] The token cache is being invalidate because project d3a3257e135e42b4848850358a05cd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:51.565754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.567829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.575100 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1121/2280] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:51 2022] DELETE /identity/v3/projects/d3a3257e135e42b4848850358a05cd5f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:51.576960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:51.581744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:51.683904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:51.701423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587249-60cd-4e14-8838-63dd9979212d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:51.724541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc366a-ad34-4485-85af-16b8d29b900c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:51.736584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:51.739407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.739965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.740771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] PATH_INFO: `/v3/users/ba8180d7d8f440e5af23666047126124` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.743214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8180d7d8f440e5af23666047126124)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:51.746239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:51.857029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:51.891626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8180d7d8f440e5af23666047126124'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.892389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8180d7d8f440e5af23666047126124'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.901701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8180d7d8f440e5af23666047126124'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.902454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8180d7d8f440e5af23666047126124'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.907721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587249-60cd-4e14-8838-63dd9979212d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:51.918516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-593c8b44-0d63-41fe-bdf5-1c85d2f61de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8180d7d8f440e5af23666047126124'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:51.919856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:51.920767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.921076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.921349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects/c02471b95dd04d82bcd2fef070fe1d59` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.923734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:get_project(project_id=c02471b95dd04d82bcd2fef070fe1d59)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:51.926045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960705-873f-470a-bb55-959c00c2447b tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:51.927946 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1160/2281] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:51 2022] GET /identity/v3/projects/c02471b95dd04d82bcd2fef070fe1d59 => generated 369 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:02:51.928986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.929279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.929546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.955816 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1122/2282] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:51 2022] DELETE /identity/v3/users/ba8180d7d8f440e5af23666047126124 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:51.957942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29403-1089-47d6-ba3f-9a4ffd26b3b3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:51.958374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29403-1089-47d6-ba3f-9a4ffd26b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:51.959367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29403-1089-47d6-ba3f-9a4ffd26b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:51.979640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:51.980913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:51.999444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4fd29403-1089-47d6-ba3f-9a4ffd26b3b3 None None] MFA Rules not processed for user `cff9aa4b18a046e48392df7ed9120d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:52.002070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4fd29403-1089-47d6-ba3f-9a4ffd26b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:52.138117 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1161/2283] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:52.138795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:52.140130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:52.143084 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1123/2284] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:52.155005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:52.155441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:52.155817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:52.202070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] MFA Rules not processed for user `ab2aa9c224654cfbbc1559ed58556ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:52.208314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:52.332145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:52.377644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b94e1-12cc-4535-a3c3-da0a6ec8fd29 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:52.390319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1124/2285] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:52.393471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:52.402846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:52.403298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:52.413710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:52.414559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:52.415731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:52.416781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:52.416907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:52.423561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:52.456637 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1162/2286] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:52.462112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:52.501317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c88c-eb41-46c3-8461-de23af121849 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:52.522600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:52.525593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:52.525984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:52.528396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:52.531652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:52.535853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:52.587338 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1163/2287] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:52 2022] POST /identity/v3/users => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:52.593579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:52.608801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc6b4-1fee-4cfe-8800-9bd12b7b245b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:52.619218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272f6a-aaf7-48da-b644-9437dc1d6ba8 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:52.625305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:52.626431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:52.626819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:52.627196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:52.636042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:52.636684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:52.637315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:52.637596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:52.638395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:52.638712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:52.644243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:52.649797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:52.651542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:52.675946 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1125/2288] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:02:52.682311 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1164/2289] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:53.250353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:53.252242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:53.329184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:53.331517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:53.443393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678284dc-75a3-4a9b-9013-61406c47d0be service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:53.458223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:53.458994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:53.460245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:53.460645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:53.462693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:53.508658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:53.516195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:53.518095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32daa2ba-c1d6-4bb2-a0cd-ac4e640c2518 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:53.550320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1126/2290] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:53.564390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:53.564820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:53.565211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:53.566823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1127/2291] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:53.573490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67529057-c719-440c-a27a-7c06bd459bd5 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:53.577495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:53.580490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:53.609161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:53.627771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05368b5-b0e4-4f65-85ba-8915aac6385b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:53.635672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:53.636492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:53.636974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:53.637531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects/c02471b95dd04d82bcd2fef070fe1d59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:53.639092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:get_project(project_id=c02471b95dd04d82bcd2fef070fe1d59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:53.641615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173429d-b5cc-48f9-80fa-1f4863198226 tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:53.663579 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1128/2292] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:53 2022] GET /identity/v3/projects/c02471b95dd04d82bcd2fef070fe1d59 => generated 369 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:02:53.673686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:53.681860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:53.682930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:53.683183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] PATH_INFO: `/v3/projects/591e8468e3d84735b18c3f67a6c83b34` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:53.714774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591e8468e3d84735b18c3f67a6c83b34)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:53.716903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:53.865581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591e8468e3d84735b18c3f67a6c83b34', 'request_id': 'req-06aa0f52-c6f5-4dac-8726-cecccc2ff473'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:53.879913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591e8468e3d84735b18c3f67a6c83b34', 'request_id': 'req-06aa0f52-c6f5-4dac-8726-cecccc2ff473'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:53.896879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591e8468e3d84735b18c3f67a6c83b34', 'request_id': 'req-06aa0f52-c6f5-4dac-8726-cecccc2ff473'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:53.951802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] The token cache is being invalidate because project 591e8468e3d84735b18c3f67a6c83b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:53.960806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:53.961635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06aa0f52-c6f5-4dac-8726-cecccc2ff473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:53.963418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1165/2293] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:53 2022] DELETE /identity/v3/projects/591e8468e3d84735b18c3f67a6c83b34 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:53.968714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:53.969059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:53.969346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.032450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:54.038957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:54.209854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:54.249967 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1129/2294] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:54.261073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.261073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.261073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.321235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:54.325477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:54.348439 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1166/2295] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:54.352462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.371834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282fb96-1b0e-48cc-9667-61c14c85bf4a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.385334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.385967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.386232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.387189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.387849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:02:54.388165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:54.389799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df8018-5403-4bc5-8b09-53e2307f520b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:54.456887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1130/2296] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:54.462678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.475947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d9aa-4345-43f5-bb7a-de5f0e7bc72c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.479899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.480183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.480782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.482308 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1131/2297] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:02:54.487553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:02:54.490495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:54.490857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.491734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.492389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.492915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.494050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:54.496599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:54.554940 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1167/2298] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:54 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:54.560564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.703350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354162-742a-45f4-8e4c-0d536140eb00 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.715119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.715942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.716794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.718199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:54.718698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.719081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.721107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:54.723782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:54.792519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1168/2299] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:54 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:54.792519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.813190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42262cd0-715f-4f36-8c85-e64defdb2b5b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.828646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.829494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.830012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.831130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.832454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:54.837598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:54.859585 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1169/2300] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:54.861920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.887169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9cf3-f331-4581-a8d5-05a7f3c127ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.892484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606faad-ae7d-45ad-b757-1dff0aa2fc50 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.899742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.901454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.902197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.903221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.904539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:54.907876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:54.927797 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1170/2301] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:54.936105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:54.966167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f5803-091e-405c-a93c-9fd1eca7b10b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:54.981083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.982217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.982646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.983076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] PATH_INFO: `/v3/projects/6331acc801404531ad94b7ee7664bebe/users/e43668b02a784329b9c73993ed6a927e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.996445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:54.996445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:54.996445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:54.997163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects/c02471b95dd04d82bcd2fef070fe1d59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:54.997927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:get_project(project_id=c02471b95dd04d82bcd2fef070fe1d59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:55.000452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:55.013705 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1132/2302] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:02:54 2022] GET /identity/v3/projects/c02471b95dd04d82bcd2fef070fe1d59 => generated 369 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:02:55.025726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6331acc801404531ad94b7ee7664bebe, user_id=e43668b02a784329b9c73993ed6a927e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:55.030598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afa67a-f9cd-4b83-97e3-c3f2210f79a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:55.058875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:55.062488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:55.074347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d555028-05ea-40e0-9d33-ad8770f0992a tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:55.086860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1171/2303] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:54 2022] PUT /identity/v3/projects/6331acc801404531ad94b7ee7664bebe/users/e43668b02a784329b9c73993ed6a927e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:55.090839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:55.091417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:55.091660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:55.141729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:55.161969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] MFA Rules not processed for user `e43668b02a784329b9c73993ed6a927e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:55.163360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:55.224852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:55.225690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:55.227013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:55.227420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/users/3cbe69ad68f4478fa4c9b83e1ac171a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:55.263619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3cbe69ad68f4478fa4c9b83e1ac171a6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:55.271454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:55.335114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1172/2304] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:02:55.337023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:55.358944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbe69ad68f4478fa4c9b83e1ac171a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.360261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbe69ad68f4478fa4c9b83e1ac171a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.368619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbe69ad68f4478fa4c9b83e1ac171a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.369673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbe69ad68f4478fa4c9b83e1ac171a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.384566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbe69ad68f4478fa4c9b83e1ac171a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.433083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1133/2305] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:55 2022] DELETE /identity/v3/users/3cbe69ad68f4478fa4c9b83e1ac171a6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:55.436878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:55.438675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:55.472011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e573-0588-43db-86ee-7cdc12ddb7fa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:55.569133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1d0a2-4230-4828-961d-7c1d22a065ca tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:55.577470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29cd0c3924c448a394267149b69b2221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60c962f7b4774ee5bfcaf423d19fe9a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:55.578126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:55.578407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:55.578679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] PATH_INFO: `/v3/projects/c02471b95dd04d82bcd2fef070fe1d59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:55.580462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c02471b95dd04d82bcd2fef070fe1d59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:55.584017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:55.593123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:55.593764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:55.594014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:55.594286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:55.595009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:55.596907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:55.656734 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1173/2306] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:02:55 2022] POST /identity/v3/projects => generated 375 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:55.661254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:55.663539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:55.676692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:55.688729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02471b95dd04d82bcd2fef070fe1d59', 'request_id': 'req-856ee638-6668-4b25-bb63-f83b220d603c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.707945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02471b95dd04d82bcd2fef070fe1d59', 'request_id': 'req-856ee638-6668-4b25-bb63-f83b220d603c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.718589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:55.720684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02471b95dd04d82bcd2fef070fe1d59', 'request_id': 'req-856ee638-6668-4b25-bb63-f83b220d603c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.749338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] The token cache is being invalidate because project c02471b95dd04d82bcd2fef070fe1d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:02:55.749976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.750853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:55.752759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1134/2307] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:02:55 2022] DELETE /identity/v3/projects/c02471b95dd04d82bcd2fef070fe1d59 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:55.761165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:55.765652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:55.841271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19d40e-90a9-4182-a992-d2e32eb70925 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:55.983204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ee638-6668-4b25-bb63-f83b220d603c tempest-QuotasAdminTestV257-1637373967 tempest-QuotasAdminTestV257-1637373967-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.002734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.003575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.006237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.006657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] PATH_INFO: `/v3/users/534523ee5586447babd2bba72ed54d48` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.010587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.011226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.011507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.011782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.012437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.014418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.015286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=534523ee5586447babd2bba72ed54d48)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.017401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.094991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1174/2308] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:02:55 2022] POST /identity/v3/users => generated 294 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:02:56.100020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:56.107530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:56.133029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55a78f-886c-414a-b32f-1aab14d7a4c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.149859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.150531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.150811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.151086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.151976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.156276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.170908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534523ee5586447babd2bba72ed54d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:56.179585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534523ee5586447babd2bba72ed54d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:56.187183 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1175/2309] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:56.188723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:56.208548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153c14-6f7a-4977-8e88-7675e6b79f0c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.225809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.226792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.227226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.227672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] PATH_INFO: `/v3/projects/29b43f140cdf45e78f949164ff8db458/users/6ca23351ac7143d0a1ac7968f3d32215/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.243594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534523ee5586447babd2bba72ed54d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:56.253272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534523ee5586447babd2bba72ed54d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:56.268870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b43f140cdf45e78f949164ff8db458, user_id=6ca23351ac7143d0a1ac7968f3d32215, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.277746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.293973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6adfe47-5af1-4adc-903a-020847b3d15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534523ee5586447babd2bba72ed54d48'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:02:56.309082 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1176/2310] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:56 2022] PUT /identity/v3/projects/29b43f140cdf45e78f949164ff8db458/users/6ca23351ac7143d0a1ac7968f3d32215/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:56.315792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:56.321308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:56.357873 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1135/2311] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:02:55 2022] DELETE /identity/v3/users/534523ee5586447babd2bba72ed54d48 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:02:56.362026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.362660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.364313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.409298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:56.412030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:56.607723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119ead-ff0a-4adf-a228-fc57f7dff9fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.638618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:56.704640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:56.721290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1136/2312] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:56.741842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:56.743764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:56.829901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.831533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.833399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.833829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.836013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.840009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.869544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1177/2313] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 555 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:02:56.876218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:56.896967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb836b1-081d-49c5-9072-1ae853a2d278 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.905516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:56.906840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.912087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.913426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] PATH_INFO: `/v3/projects/29b43f140cdf45e78f949164ff8db458/users/6ca23351ac7143d0a1ac7968f3d32215/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:56.919208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b43f140cdf45e78f949164ff8db458, user_id=6ca23351ac7143d0a1ac7968f3d32215, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:56.923446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c393ff-4093-4296-b7ea-402a28ac57f3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:56.962641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94909-5829-4396-bd8e-663b7bb7fb7c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:56.970780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1178/2314] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:02:56 2022] PUT /identity/v3/projects/29b43f140cdf45e78f949164ff8db458/users/6ca23351ac7143d0a1ac7968f3d32215/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:02:56.983882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee325ca-2125-4e3f-8fd2-bd544d2bd926 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:56.984861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee325ca-2125-4e3f-8fd2-bd544d2bd926 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:56.985185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee325ca-2125-4e3f-8fd2-bd544d2bd926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:57.098758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bee325ca-2125-4e3f-8fd2-bd544d2bd926 None None] MFA Rules not processed for user `6ca23351ac7143d0a1ac7968f3d32215`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:57.102850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bee325ca-2125-4e3f-8fd2-bd544d2bd926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:57.127222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:57.127850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:57.128129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:57.130100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:57.218586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1179/2315] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:57.220317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:57.220671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:57.220955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:57.252239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] MFA Rules not processed for user `e43668b02a784329b9c73993ed6a927e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:57.254326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:57.342899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1180/2316] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:57.370044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:57.372478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:57.390695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:57.394735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deea87a-e998-4d50-82f8-7e7813a83c08 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:57.418519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1137/2317] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:02:57.470518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:57.528101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9172e97-682e-4707-baf6-deffec0bf714 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:57.534771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:57.536381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:57.536682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:57.536929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:57.538871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:57.556446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:57.558272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d772045-aeda-4b3a-8ede-59c322663a5b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:57.596403 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1181/2318] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:02:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:02:58.246347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:58.246584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:58.246874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:58.305341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] MFA Rules not processed for user `e43668b02a784329b9c73993ed6a927e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:58.308101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:58.352165 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1138/2319] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:02:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:59.162689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:59.163675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:59.163973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:59.215260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:02:59.216511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:59.370569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1182/2320] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:02:59.385463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:02:59.387059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:02:59.539204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:02:59.585800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775fd4-b42e-4254-88ff-34dded006307 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:02:59.597153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:02:59.598686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:02:59.598968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:02:59.599243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:02:59.612916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:02:59.615963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:02:59.635170 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1139/2321] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:02:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:03:00.373958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:00.375570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:00.409538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ee0b5-d205-4fe9-8b3f-fec7e1cee433 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:00.439367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:00.440032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:00.440304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:00.440570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] PATH_INFO: `/v3/projects/b683b367a3ba4ab487cd5b2f43559d72` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:00.445229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b683b367a3ba4ab487cd5b2f43559d72)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:00.460518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:00.630721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b683b367a3ba4ab487cd5b2f43559d72', 'request_id': 'req-28684989-ae3d-4cdb-8706-67c2b3671850'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:00.657654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b683b367a3ba4ab487cd5b2f43559d72', 'request_id': 'req-28684989-ae3d-4cdb-8706-67c2b3671850'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:00.675868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b683b367a3ba4ab487cd5b2f43559d72', 'request_id': 'req-28684989-ae3d-4cdb-8706-67c2b3671850'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:00.709650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] The token cache is being invalidate because project b683b367a3ba4ab487cd5b2f43559d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:03:00.710153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:00.711132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:00.716790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1183/2322] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:00 2022] DELETE /identity/v3/projects/b683b367a3ba4ab487cd5b2f43559d72 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:00.720876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:00.755304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c9f4-0dcc-4665-8859-0fc401ff357d service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:01.079440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:01.080596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:01.081241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:01.082022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] PATH_INFO: `/v3/users/29cd0c3924c448a394267149b69b2221` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:01.083997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cd0c3924c448a394267149b69b2221)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:01.086913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:01.268490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cd0c3924c448a394267149b69b2221'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:01.271064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cd0c3924c448a394267149b69b2221'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:01.298017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cd0c3924c448a394267149b69b2221'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:01.300082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cd0c3924c448a394267149b69b2221'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:01.328481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e50cb4c-bbc4-42ab-92d7-c974908aa48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cd0c3924c448a394267149b69b2221'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:01.378753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1140/2323] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:03:00 2022] DELETE /identity/v3/users/29cd0c3924c448a394267149b69b2221 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:02.418343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:02.420470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:02.441620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28684989-ae3d-4cdb-8706-67c2b3671850 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:02.601173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:02.619909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:02.620567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:02.620862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:02.621181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] PATH_INFO: `/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:02.626103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c962f7b4774ee5bfcaf423d19fe9a6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:02.632884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:02.751321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c962f7b4774ee5bfcaf423d19fe9a6', 'request_id': 'req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:02.759564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c962f7b4774ee5bfcaf423d19fe9a6', 'request_id': 'req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:02.767362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c962f7b4774ee5bfcaf423d19fe9a6', 'request_id': 'req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:02.792505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] The token cache is being invalidate because project 60c962f7b4774ee5bfcaf423d19fe9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:03:02.793705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:02.794664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e56b02f-8bb2-4ce1-a00e-90ed44abea0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:02.797911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1184/2324] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:02 2022] DELETE /identity/v3/projects/60c962f7b4774ee5bfcaf423d19fe9a6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:02.805382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:02.806407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:02.807111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:02.838672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:02.840372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:02.970958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:03.002383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.002658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.002932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.003487 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1141/2325] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:03.044879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:03.046266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:03.065142 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1185/2326] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:03.067591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.085873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7a0d-6093-4e2e-8af7-9a83346e28e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.111748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.112933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.113870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.114431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.118973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:03:03.119926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.122599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.176089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.176929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1142/2327] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:03:03.189166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb822-0d8f-4e40-8197-4074584a1d4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.201835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.202720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.203094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.203360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.204088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.209295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.257606 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1186/2328] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:03:03 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:03:03.265088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.299830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495539-50e7-4489-8fb2-50eae0f36eb0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.478179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.479316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.479794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.480469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.481405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.489408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.544689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.545526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1143/2329] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:03:03 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:03:03.562452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cfc96-8482-4d55-96bd-8a4e245ab8a5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.580043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.581328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.582812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.583277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.583972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.588016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.612639 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1187/2330] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:03:03.616263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.638283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5c95-db15-4fe0-80a5-ead053969f06 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.683066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.683902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.684331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.686529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.688885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.692115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8e1bb-ad9d-4cd3-b6a6-42e35561f645 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.714250 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1144/2331] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:03.718793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:03.736167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a5a0-7a87-43f4-8c2f-21635b7eaab8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:03.750786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:03.753539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.754896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.755567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] PATH_INFO: `/v3/projects/902ac9b38b6047649a7da0d7238011df/users/88f461717faa455195e73e6c5920951b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.803497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902ac9b38b6047649a7da0d7238011df, user_id=88f461717faa455195e73e6c5920951b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:03.813479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:03.838780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1188/2332] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:03:03 2022] PUT /identity/v3/projects/902ac9b38b6047649a7da0d7238011df/users/88f461717faa455195e73e6c5920951b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:03:03.853623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:03.854630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:03.855132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:03.914313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] MFA Rules not processed for user `88f461717faa455195e73e6c5920951b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:03.915824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:04.118834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1145/2333] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:11.709543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:11.711284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:11.975197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d65-8a2c-4c6b-b166-6090bec03f11 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:12.000305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:12.002169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:12.003129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:12.003129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:12.019231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:12.022081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f847fbc-de01-4399-b097-8f026ea7ff3d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:12.038822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1189/2334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:12.058119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:12.091445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809c9e4-9c0e-469d-8797-1fa97ec7b39b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:12.104158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:12.104827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:12.105110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:12.105643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:12.114805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:12.322254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:12.363686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:12.414323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:12.442743 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1146/2335] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:12.485405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1526f3-5f5d-47ed-bb37-adbc9971d628 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:12.485694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1526f3-5f5d-47ed-bb37-adbc9971d628 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:12.485970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1526f3-5f5d-47ed-bb37-adbc9971d628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:12.516812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:12.535961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-de1526f3-5f5d-47ed-bb37-adbc9971d628 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:12.542583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de1526f3-5f5d-47ed-bb37-adbc9971d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:12.689041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1190/2336] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:12.795472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:12.796925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:12.979607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33354-278d-4610-9b1a-0e5b2af03bb3 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:12.998042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:12.998682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:12.998959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:12.999228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:13.019533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:13.021212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:13.041760 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1147/2337] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:03:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:03:14.347442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:14.347924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:14.348026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:14.384547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:14.386880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:14.440328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:14.492146 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1191/2338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:14.575466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ace0a-c04f-4d02-b874-5246c5494ae5 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:14.581868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:14.582872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:14.583316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:14.583810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] PATH_INFO: `/v3/users/88f461717faa455195e73e6c5920951b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:14.585738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f461717faa455195e73e6c5920951b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:14.587974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:14.657354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f461717faa455195e73e6c5920951b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:14.658377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f461717faa455195e73e6c5920951b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:14.667471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f461717faa455195e73e6c5920951b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:14.668207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f461717faa455195e73e6c5920951b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:14.677956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0b483f48-a299-4c80-9704-a2fa30379cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f461717faa455195e73e6c5920951b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:14.688585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:14.691128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:14.698551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:14.716027 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1148/2339] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:03:14 2022] DELETE /identity/v3/users/88f461717faa455195e73e6c5920951b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:14.717970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:14.718600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:14.718949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:14.746072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:14.748200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:14.820587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a0ac4-d7e6-407d-8281-78bdd4cb4649 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:14.896231 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1149/2340] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:14.904935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:14.906685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:14.942970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:14.962829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:14.964381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:14.965030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:14.965576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:14.970301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:14.993913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:14.996806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:15.012282 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1192/2341] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:03:15.033424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47275fd4-036f-4896-a6e2-e37c3034ccdc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:15.040003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:15.040624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.041162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.041580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.054387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:15.056039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6ca0-f83c-403f-86f1-a94cee8a9c07 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:15.072772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1150/2342] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:03:15.553845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:15.555444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:15.575139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282868b0-2b6e-47c3-b012-216d6a7defa5 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:15.581012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:15.582540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.583058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.583495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] PATH_INFO: `/v3/projects/902ac9b38b6047649a7da0d7238011df` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.584822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902ac9b38b6047649a7da0d7238011df)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:15.586898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:15.639123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902ac9b38b6047649a7da0d7238011df', 'request_id': 'req-01d3ce73-fe3e-4926-a729-f78043a3cec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:15.646448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902ac9b38b6047649a7da0d7238011df', 'request_id': 'req-01d3ce73-fe3e-4926-a729-f78043a3cec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:15.654328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902ac9b38b6047649a7da0d7238011df', 'request_id': 'req-01d3ce73-fe3e-4926-a729-f78043a3cec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:15.675965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] The token cache is being invalidate because project 902ac9b38b6047649a7da0d7238011df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:03:15.676415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:15.677180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-01d3ce73-fe3e-4926-a729-f78043a3cec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:15.678939 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1193/2343] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:15 2022] DELETE /identity/v3/projects/902ac9b38b6047649a7da0d7238011df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:15.683865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.684384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.684384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.705303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:15.706563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:15.781261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1151/2344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:15.788752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.789077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.789359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.826191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:15.827424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:15.838735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1194/2345] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:15.843059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:15.853927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfc6b-53cc-4ba9-aec8-da3e67f2a599 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:15.859193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:15.859852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.860135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.860408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.861156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:03:15.861427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:15.863529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:15.875766 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1152/2346] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:03:15.880714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:15.890168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dd815-d90f-4024-a46b-3b91b621820c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:15.895948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:15.896666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:15.897607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:15.897607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:15.898033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:15.900023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:15.949349 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1195/2347] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:03:15 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:03:15.951430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:15.962814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa51ad-3293-4eaf-b81f-c2e610e8080b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:15.991215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:16.036767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:16.037084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.037351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.037619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.038258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:16.040680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:16.066262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1153/2348] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:03:15 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:03:16.070249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:16.081217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22bcf2-6a55-4d62-9d05-b03497b84ebf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:16.087180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:16.087804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.088164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.088333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.088971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:16.090651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:16.103051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1196/2349] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:16.112614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:16.124261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca04e-1e05-431b-9b2d-5283f79a1df6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:16.130628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:16.131277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.131555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.131833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.132497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:16.134401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b698a8-a182-4c2c-af4b-60a863a09902 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:16.149032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1154/2350] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:16.151032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:16.161644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65192-6792-4b83-9059-dd3b025fa552 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:16.166766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:16.167444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.167718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.167989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] PATH_INFO: `/v3/projects/fd26b2e375084d72a31f6e39b420da8c/users/7f02637b1935426280f2ad6bcfa61b26/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.184272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd26b2e375084d72a31f6e39b420da8c, user_id=7f02637b1935426280f2ad6bcfa61b26, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:16.186851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2f20-d77e-40eb-9c14-c6b63b6f33ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:16.201595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1197/2351] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:03:16 2022] PUT /identity/v3/projects/fd26b2e375084d72a31f6e39b420da8c/users/7f02637b1935426280f2ad6bcfa61b26/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:16.212826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.213133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.213407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.243920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] MFA Rules not processed for user `7f02637b1935426280f2ad6bcfa61b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:16.245180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:16.313857 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1155/2352] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:16.384594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:16.384940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:16.385244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:16.405148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] MFA Rules not processed for user `7f02637b1935426280f2ad6bcfa61b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:16.406403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:16.413976 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1198/2353] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:17.226809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:17.228329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:17.303580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11923c8-79a5-4fac-bf00-26105598a76e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:17.308924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:17.309556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:17.309827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:17.310241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:17.318342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:17.319923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8db82-fbe0-442e-9e25-197207a321f9 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:17.329261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1156/2354] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:21.342957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:21.358447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ff475-b60b-4f38-8f04-93392a37240e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:21.366130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:21.366130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:21.366130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:21.366130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:21.367688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:21.431116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:21.433808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:21.435625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4a776-bf57-4b18-87e4-3cc5afe9d780 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:21.447543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1199/2355] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:21.951959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:21.951959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:21.951959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:21.953593 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1157/2356] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:03:21.963614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe766-1b1f-49c9-aae1-4e1c640c5283 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:21.964052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe766-1b1f-49c9-aae1-4e1c640c5283 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:21.964176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe766-1b1f-49c9-aae1-4e1c640c5283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:22.006504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bfabe766-1b1f-49c9-aae1-4e1c640c5283 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:22.007997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bfabe766-1b1f-49c9-aae1-4e1c640c5283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:22.045868 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1200/2357] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:03:22.085997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:22.089187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:22.179081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:22.266313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f0c3e-79ba-4e2f-a343-e89cd2dcc40f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:22.270914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:22.271644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:22.272024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:22.272766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:22.283250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:22.285455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:22.296788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1158/2358] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:22.329292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a1e9-805a-4b89-ac0f-12c9ee05f7d1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:22.329576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a1e9-805a-4b89-ac0f-12c9ee05f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:22.329849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a1e9-805a-4b89-ac0f-12c9ee05f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:22.352569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3fc4a1e9-805a-4b89-ac0f-12c9ee05f7d1 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:22.366826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3fc4a1e9-805a-4b89-ac0f-12c9ee05f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:22.382792 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1201/2359] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:22.400887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:22.417284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fda76-9c26-460e-ace5-f8b1a3f5ab82 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:22.436171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:22.439895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:22.442101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:22.443082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:22.455350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:22.458119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c559a9-90e5-498e-bc40-36cb21222655 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:22.469226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1159/2360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:25.113501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:25.114385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:25.114702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:25.116968 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1202/2361] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:03:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:03:25.122695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8d0d-2e64-457b-a8d1-f61a7edd4d34 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:25.123190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8d0d-2e64-457b-a8d1-f61a7edd4d34 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:25.123285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb8d0d-2e64-457b-a8d1-f61a7edd4d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:25.151763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2bdb8d0d-2e64-457b-a8d1-f61a7edd4d34 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:25.152942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2bdb8d0d-2e64-457b-a8d1-f61a7edd4d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:25.164025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1160/2362] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:25.178075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:25.179912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:25.194188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ca36d-a04c-47d3-b5e7-48375cfb30c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:25.198370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:25.199131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:25.199628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:25.200106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:25.211663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:25.213492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:25.227143 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1203/2363] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:03:25.247558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ea13-0a81-456f-9ab1-f9f01b3e38fe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:25.248286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ea13-0a81-456f-9ab1-f9f01b3e38fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:25.248704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048ea13-0a81-456f-9ab1-f9f01b3e38fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:25.269569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f048ea13-0a81-456f-9ab1-f9f01b3e38fe None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:25.271904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f048ea13-0a81-456f-9ab1-f9f01b3e38fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:25.286605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1161/2364] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:25.301344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:25.319116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d2f70-237c-4534-8831-649e91b4697a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:25.325617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:25.326479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:25.327094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:25.327899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:25.340539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:25.343369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:25.357371 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1204/2365] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:30.501118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a4f5-1e6b-49d6-9f92-edab2e3473c4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:30.501935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a4f5-1e6b-49d6-9f92-edab2e3473c4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:30.502438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942a4f5-1e6b-49d6-9f92-edab2e3473c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:30.524078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8942a4f5-1e6b-49d6-9f92-edab2e3473c4 None None] MFA Rules not processed for user `e43668b02a784329b9c73993ed6a927e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:30.525651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8942a4f5-1e6b-49d6-9f92-edab2e3473c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:30.591271 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1162/2366] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:35.351018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=20 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:40.487948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:40.489553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:40.558554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb06a3-1f81-4587-8cf7-e9663645cfd7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:40.563296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:40.563855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:40.564126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:40.564433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] PATH_INFO: `/v3/users/0c29841aaaee47c8ac0bde44c50105dc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:40.565768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c29841aaaee47c8ac0bde44c50105dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:40.567859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:40.584830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=54 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:40.620278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c29841aaaee47c8ac0bde44c50105dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:40.628914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c29841aaaee47c8ac0bde44c50105dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:40.629801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c29841aaaee47c8ac0bde44c50105dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:40.637535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c29841aaaee47c8ac0bde44c50105dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:40.638302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c29841aaaee47c8ac0bde44c50105dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:40.656263 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1205/2367] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:03:40 2022] DELETE /identity/v3/users/0c29841aaaee47c8ac0bde44c50105dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:03:40.661471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:40.661753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:40.662024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:40.680844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:40.682347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:40.752315 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1163/2368] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:03:40.763399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:40.764801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:40.835864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aa21-5229-47f4-83da-a32bdafb38df admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:40.839772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:40.840515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:40.840895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:40.841303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:40.852467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:40.854147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:40.865758 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1206/2369] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:03:41.086212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:41.087602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:41.101312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369493b-8bdd-496b-8a5e-eff6dae48ec7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:41.110312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:41.111260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.117805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.118699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] PATH_INFO: `/v3/projects/c1615e4a1ea345b4ac972f3a3cb08f2b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.120048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1615e4a1ea345b4ac972f3a3cb08f2b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:41.122113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:41.181246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'request_id': 'req-09a89f09-d404-49a7-bfbe-c5deecd8c14e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.190922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'request_id': 'req-09a89f09-d404-49a7-bfbe-c5deecd8c14e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.199349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1615e4a1ea345b4ac972f3a3cb08f2b', 'request_id': 'req-09a89f09-d404-49a7-bfbe-c5deecd8c14e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.212963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] The token cache is being invalidate because project c1615e4a1ea345b4ac972f3a3cb08f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:03:41.213293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.213963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.216064 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1164/2370] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:41 2022] DELETE /identity/v3/projects/c1615e4a1ea345b4ac972f3a3cb08f2b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:41.220372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:41.233273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d17-9433-4477-bf5e-1ad10f110475 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:41.258726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:41.310476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:41.311141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.311422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.311962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] PATH_INFO: `/v3/users/c0fd25fdf6154d42a06be866e4d47712` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.313223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fd25fdf6154d42a06be866e4d47712)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:41.315672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:41.375413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fd25fdf6154d42a06be866e4d47712'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.384958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fd25fdf6154d42a06be866e4d47712'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.385661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fd25fdf6154d42a06be866e4d47712'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.393096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fd25fdf6154d42a06be866e4d47712'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.393606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bf3c3b4-4b05-486a-a1c5-e91537c22af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fd25fdf6154d42a06be866e4d47712'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.411632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1207/2371] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:03:41 2022] DELETE /identity/v3/users/c0fd25fdf6154d42a06be866e4d47712 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:41.633128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:41.634832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:41.668088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a89f09-d404-49a7-bfbe-c5deecd8c14e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:41.733867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:41.734544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.734818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.735087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] PATH_INFO: `/v3/projects/1b35ef71883643ecb60ab2adaf04d643` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.736842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b35ef71883643ecb60ab2adaf04d643)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:41.739610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:41.773498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:41.792813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b35ef71883643ecb60ab2adaf04d643', 'request_id': 'req-0023ccb0-cd27-41d0-82fb-b38d9400a16d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.800545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b35ef71883643ecb60ab2adaf04d643', 'request_id': 'req-0023ccb0-cd27-41d0-82fb-b38d9400a16d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.807318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b35ef71883643ecb60ab2adaf04d643', 'request_id': 'req-0023ccb0-cd27-41d0-82fb-b38d9400a16d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.818898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] The token cache is being invalidate because project 1b35ef71883643ecb60ab2adaf04d643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:03:41.819189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.819835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0023ccb0-cd27-41d0-82fb-b38d9400a16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:03:41.821334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1165/2372] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:03:41 2022] DELETE /identity/v3/projects/1b35ef71883643ecb60ab2adaf04d643 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:41.826231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.826707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.826809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.850164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:41.851373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:41.912841 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1208/2373] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:41.920470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.920683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.920953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.945130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:41.946323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:41.954544 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1166/2374] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:41.959444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:41.969461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a29d9e-68f4-4a3a-aea3-0a0a0b74eb7f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:41.975386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:41.975991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:41.976264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:41.976552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:41.977205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:03:41.977518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:41.979103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:41.995446 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1209/2375] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:03:41.996792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.006717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3dbe3-9488-4ba8-af58-07c38bedc832 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.011600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.012466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.012805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.013169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.013993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.015979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.049336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1167/2376] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:03:41 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:03:42.053499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.071567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495097b8-b4c3-4cfc-b5a1-3eb589044424 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.110097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:42.147500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.148112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.148387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.148654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.149353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.151263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.176936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1210/2377] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:03:42.178377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.195328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d530b2c-0e8e-419d-bc49-98f6282bf7c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.199976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.200606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.200882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.201179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.201811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.203382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.218269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1168/2378] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:42.219669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.231695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09104-247c-4498-8138-6a002d6c1c1e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.236578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.237230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.237504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.237771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.238499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.240106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42788c80-a792-45ac-9d2c-3273fd9ac2a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.250072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1211/2379] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:42.254641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.264898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db9c5c-af93-4992-88b7-711c7b31170c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.270110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.270750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.271022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.271288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] PATH_INFO: `/v3/projects/8df69999b99949399425279771c6b144/users/7053f2f36beb4afd87463bf4acb0502d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.286735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df69999b99949399425279771c6b144, user_id=7053f2f36beb4afd87463bf4acb0502d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.289376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.302881 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1169/2380] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:03:42 2022] PUT /identity/v3/projects/8df69999b99949399425279771c6b144/users/7053f2f36beb4afd87463bf4acb0502d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:03:42.313629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339fce-9136-40cc-bbc0-d813a5ca7e94 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.313987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339fce-9136-40cc-bbc0-d813a5ca7e94 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.314832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339fce-9136-40cc-bbc0-d813a5ca7e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.347413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-32339fce-9136-40cc-bbc0-d813a5ca7e94 None None] MFA Rules not processed for user `7053f2f36beb4afd87463bf4acb0502d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:42.349222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32339fce-9136-40cc-bbc0-d813a5ca7e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:42.437697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1212/2381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:42.442958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.485293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.485683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.486061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.506724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] MFA Rules not processed for user `19e2cb9474fb47a6b3f3793c7f162caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:42.508677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:42.518416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995273b-1a06-40f2-af13-a7d4e42099bc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.523269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.523935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.524212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.524479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.525134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.527087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.569769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1170/2382] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/projects => generated 395 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:03:42.575608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.581027 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1213/2383] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:42.625782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:42.652573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9e846-6421-42cd-83ca-d46e25a983b4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.657431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.658238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.658522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.658941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.659419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.661349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.688446 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1171/2384] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/users => generated 304 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:03:42.692915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.704762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf9f1f-6075-4f35-b4fe-dbf07b8df37d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.709746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.711389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.711751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.712098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.713608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.714527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.729029 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1214/2385] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:42.733462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.751382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e065c-14d6-4a6c-9e26-174c975e5eec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.757670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.759173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.759173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.759173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] PATH_INFO: `/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5/users/5082645f3205483a836322821a164d59/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.777037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=847ce7ae851e4f2c8a67cc2f191bd5d5, user_id=5082645f3205483a836322821a164d59, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.779841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.794263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1172/2386] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:03:42 2022] PUT /identity/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5/users/5082645f3205483a836322821a164d59/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:03:42.798235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.810227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda50c62-727b-4107-809a-8db887f4946a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.852698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:42.887056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.887704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.887984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.888279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.888930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.890651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee534-ded9-49f8-b1e3-d22fa050fe62 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.901247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1215/2387] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:03:42.905147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:42.915537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2c650-a582-4a61-8cb8-4b6b2d88f94e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:42.920570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:42.921254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.921531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.921854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] PATH_INFO: `/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5/users/5082645f3205483a836322821a164d59/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.924509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=847ce7ae851e4f2c8a67cc2f191bd5d5, user_id=5082645f3205483a836322821a164d59, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:42.927477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f723d8-6057-461c-8bff-c24fe63076cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:42.938792 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1173/2388] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:03:42 2022] PUT /identity/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5/users/5082645f3205483a836322821a164d59/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:03:42.950783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:42.951070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:42.951344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:42.979794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] MFA Rules not processed for user `5082645f3205483a836322821a164d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:42.981384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:43.058953 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1216/2389] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:03:43.074458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:43.074812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:43.075019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:43.115886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] MFA Rules not processed for user `7053f2f36beb4afd87463bf4acb0502d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:43.118656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:43.242855 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1174/2390] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:43.340420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:43.342062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:43.496406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5335-8222-43d7-a3b1-0d74b3e7eb49 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:43.504007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:43.504769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:43.505208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:43.505442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:43.516567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:43.519146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08148140-b108-4813-a3ec-4ae444c3ed1c service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:43.532171 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1217/2391] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:47.325907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:47.327411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:47.398356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8290a-df7a-477f-aefb-a4ac5d389653 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:47.403279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:47.403889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:47.404171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:47.404439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:47.406177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:47.417880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:47.419466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:47.430109 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1175/2392] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:48.681122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197c9e-aa23-4e88-9fe7-10cb610a0cde None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:48.681558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197c9e-aa23-4e88-9fe7-10cb610a0cde None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:48.681558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd197c9e-aa23-4e88-9fe7-10cb610a0cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:48.702731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd197c9e-aa23-4e88-9fe7-10cb610a0cde None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:48.703447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd197c9e-aa23-4e88-9fe7-10cb610a0cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:48.745750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:48.779256 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1218/2393] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:48.787399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:48.789353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:48.824919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:03:48.895808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a720-5444-4cc0-9ae3-ec874d3920b0 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:48.901965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:48.902582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:48.902852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:48.904469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:48.916102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:48.917829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:48.941233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1176/2394] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:03:49.339509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:49.340037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:49.340402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:49.371332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] MFA Rules not processed for user `ab2aa9c224654cfbbc1559ed58556ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:03:49.372598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:49.484269 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1219/2395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:03:50.300976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:50.303315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:50.328184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697afd-845f-4965-a57b-962d242ceaf9 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:50.339629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:50.340673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:50.341425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:50.342031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:50.344497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:50.360425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:50.364572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd318d5-9806-432e-aab5-77a72d84983e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:50.385444 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1177/2396] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:03:51.569858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:03:51.571895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:51.602601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fceead6-4d9d-40dd-8b08-57dd29e08927 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:03:51.612450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:03:51.613546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:03:51.614055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:03:51.614690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:03:51.617382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:03:51.783213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:03:51.785425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:03:51.808829 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1220/2397] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:00.374394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=28 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:01.795072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=63 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:02.710606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4327-6569-4a7e-b4e7-b037d4b0c0fb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:02.711098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4327-6569-4a7e-b4e7-b037d4b0c0fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:02.711200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e4327-6569-4a7e-b4e7-b037d4b0c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:02.731347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d18e4327-6569-4a7e-b4e7-b037d4b0c0fb None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:02.732536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d18e4327-6569-4a7e-b4e7-b037d4b0c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:02.740683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1178/2398] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:04:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:02.754642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:02.767937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bb87f-4413-4373-a40c-33ce1f33ea7b service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:02.773776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:02.774346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:02.774619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:02.774886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:02.786172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:02.788771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:02.798540 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1221/2399] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:12.726065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:12.794643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:13.814577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:13.815549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:13.816031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:13.858530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:13.859849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:13.883610 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1179/2400] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:13.915490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:13.932110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436555-a714-4322-bc59-d26d175aeb8e service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:13.947390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:13.948010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:13.948286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:13.948556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:13.966357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:13.968304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea3e28-bb6b-44b6-914b-783b1ccc35ad service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:13.980690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1222/2401] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:15.111944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:15.192699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3efd9-2eb5-42da-b668-baed09c632c8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:15.201231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:15.202156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:15.204073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:15.204597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] PATH_INFO: `/v3/users/7053f2f36beb4afd87463bf4acb0502d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:15.206954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7053f2f36beb4afd87463bf4acb0502d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:15.209587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:15.284827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7053f2f36beb4afd87463bf4acb0502d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:15.285533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7053f2f36beb4afd87463bf4acb0502d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:15.305921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7053f2f36beb4afd87463bf4acb0502d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:15.306785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7053f2f36beb4afd87463bf4acb0502d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:15.325307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7053f2f36beb4afd87463bf4acb0502d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:15.374367 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1180/2402] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:04:15 2022] DELETE /identity/v3/users/7053f2f36beb4afd87463bf4acb0502d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:15.379599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:15.380142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:15.380239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:15.407995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:15.410553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:15.562330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1223/2403] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:15.572802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:15.574449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:15.689129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d1fbd-5f4c-466b-9237-9ed739acc69a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:15.694883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:15.695898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:15.696620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:15.698478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:15.737231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:15.739668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:15.764341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1181/2404] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:16.155903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:16.158202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:16.184203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93b08-d419-4526-a815-ecab4a13f818 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:16.206678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:16.207343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:16.207619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:16.207887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] PATH_INFO: `/v3/projects/8df69999b99949399425279771c6b144` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:16.211340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df69999b99949399425279771c6b144)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:16.213270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:16.343840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df69999b99949399425279771c6b144', 'request_id': 'req-5263591f-c604-463f-843e-ab1c5f78b9de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.361812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df69999b99949399425279771c6b144', 'request_id': 'req-5263591f-c604-463f-843e-ab1c5f78b9de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.373930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df69999b99949399425279771c6b144', 'request_id': 'req-5263591f-c604-463f-843e-ab1c5f78b9de'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.397355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] The token cache is being invalidate because project 8df69999b99949399425279771c6b144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:04:16.398089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.400441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.402253 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1224/2405] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:16 2022] DELETE /identity/v3/projects/8df69999b99949399425279771c6b144 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:16.406348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:16.418813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbd409-9153-4cd4-8744-8b28795b8d35 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:16.463891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:16.535889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:16.536633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:16.536912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:16.537248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] PATH_INFO: `/v3/users/5082645f3205483a836322821a164d59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:16.538486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5082645f3205483a836322821a164d59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:16.540624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:16.627290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5082645f3205483a836322821a164d59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.628630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5082645f3205483a836322821a164d59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.637435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5082645f3205483a836322821a164d59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.638123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5082645f3205483a836322821a164d59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.648836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08541a1b-ed5a-4248-92a6-a150d324d5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5082645f3205483a836322821a164d59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:16.682049 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1182/2406] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:04:16 2022] DELETE /identity/v3/users/5082645f3205483a836322821a164d59 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:17.101209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:17.103613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:17.121090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263591f-c604-463f-843e-ab1c5f78b9de admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:17.195953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:17.196657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:17.196937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:17.197284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] PATH_INFO: `/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:17.198453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=847ce7ae851e4f2c8a67cc2f191bd5d5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:17.200387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:17.220830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:17.276954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847ce7ae851e4f2c8a67cc2f191bd5d5', 'request_id': 'req-4866afc6-d7dd-4557-b0aa-0ae05792d51c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:17.296733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847ce7ae851e4f2c8a67cc2f191bd5d5', 'request_id': 'req-4866afc6-d7dd-4557-b0aa-0ae05792d51c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:17.307153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847ce7ae851e4f2c8a67cc2f191bd5d5', 'request_id': 'req-4866afc6-d7dd-4557-b0aa-0ae05792d51c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:17.342007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] The token cache is being invalidate because project 847ce7ae851e4f2c8a67cc2f191bd5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:04:17.343173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:17.348282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4866afc6-d7dd-4557-b0aa-0ae05792d51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:17.351289 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1225/2407] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:17 2022] DELETE /identity/v3/projects/847ce7ae851e4f2c8a67cc2f191bd5d5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:17.356373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:17.357912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:17.358392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:17.389912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:17.391829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:17.482950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1183/2408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:17.556028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:17.556620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:17.556715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:17.589875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:17.591413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:17.604716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1226/2409] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:17.607005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:17.635423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c7d2-8ce1-4b23-90e3-8929cef03249 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:17.654661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:17.655295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:17.655599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:17.655871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:17.656569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:04:17.658629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:17.665429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:17.701702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1184/2410] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:04:17.703379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:17.716214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e776-19a1-4d2c-9502-ce68f64e1b01 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:17.733651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:17.734316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:17.734624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:17.735137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:17.735907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:17.738979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:17.821943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1227/2411] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:04:17 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:17.823132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:17.848091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281e90f-4ded-4bf1-8202-cd1b84e44b2a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:17.912844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:18.032656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:18.035002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.037260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.037743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.041049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:18.050575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:18.103349 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1185/2412] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:04:17 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:18.107339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:18.124192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549e9f-af87-4c8b-9e4e-998faaeaf5eb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:18.136382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:18.137083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.137368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.137647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.138314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:18.145538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:18.164196 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1228/2413] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:18.167817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:18.193353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7db575-8475-4ca0-9690-d85497fbf942 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:18.207729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:18.208203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.208486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.208758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.209448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:18.211048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ba56f-0e87-45df-9e36-1fc9a6d7600b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:18.248064 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1186/2414] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:18.249255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:18.264597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331aaee-efba-46f7-b578-fbf2d4a3338c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:18.272389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:18.274463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.274463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.274463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] PATH_INFO: `/v3/projects/d2403e8edc2342558e73717f3775349f/users/e9c0f65996074f78b5f9b859c1282dbe/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.323512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2403e8edc2342558e73717f3775349f, user_id=e9c0f65996074f78b5f9b859c1282dbe, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:18.329348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:18.382697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1229/2415] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:04:18 2022] PUT /identity/v3/projects/d2403e8edc2342558e73717f3775349f/users/e9c0f65996074f78b5f9b859c1282dbe/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:18.384348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11dcd-681f-470d-8fe8-158b097d3bf7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.384636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11dcd-681f-470d-8fe8-158b097d3bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.384933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea11dcd-681f-470d-8fe8-158b097d3bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.431995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7ea11dcd-681f-470d-8fe8-158b097d3bf7 None None] MFA Rules not processed for user `e9c0f65996074f78b5f9b859c1282dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:18.433796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ea11dcd-681f-470d-8fe8-158b097d3bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:18.568706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1187/2416] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:18.575044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:18.578458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:18.702139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16565b-b453-4588-9af1-961482639a7b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:18.709132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:18.709991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.710519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.710908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:18.725221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:18.727007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:18.753821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1230/2417] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:18.970351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b723-1dfa-4d39-8629-52554cf9fdae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:18.970568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b723-1dfa-4d39-8629-52554cf9fdae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:18.970811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b723-1dfa-4d39-8629-52554cf9fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:19.004313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-edb8b723-1dfa-4d39-8629-52554cf9fdae None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:19.005714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-edb8b723-1dfa-4d39-8629-52554cf9fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:19.084122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1188/2418] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:19.104075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:19.106322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:19.139429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:19.206946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3cd09-c46c-4506-b247-8d705c8f24b4 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:19.213059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:19.213743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:19.214082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:19.214410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:19.225693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:19.227933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fede7-6d80-4bc9-a299-74778fc34dc1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:19.239167 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1231/2419] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:19.398178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:19.398599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:19.399001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:19.431056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] MFA Rules not processed for user `e9c0f65996074f78b5f9b859c1282dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:19.432569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:19.447568 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1189/2420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:19.900146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:19.900653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:19.900775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:19.921929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:19.923958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:19.931285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1232/2421] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:19.954205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:19.967141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755529ee-91ff-47be-b6a5-f5501c205c73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:19.972947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aae37-df46-4853-9857-da5691422157 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:19.973849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aae37-df46-4853-9857-da5691422157 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:19.974357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aae37-df46-4853-9857-da5691422157 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:19.974842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aae37-df46-4853-9857-da5691422157 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:19.985620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aae37-df46-4853-9857-da5691422157 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:19.987593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aae37-df46-4853-9857-da5691422157 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:19.997931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1190/2422] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:20.165952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:20.334132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18128a-5763-4c4f-9154-ea3324b87b41 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:20.354511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:20.355850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:20.355850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:20.356036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] PATH_INFO: `/v3/users/e9c0f65996074f78b5f9b859c1282dbe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:20.358814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c0f65996074f78b5f9b859c1282dbe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:20.361329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:20.455119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c0f65996074f78b5f9b859c1282dbe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:20.467338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c0f65996074f78b5f9b859c1282dbe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:20.467338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c0f65996074f78b5f9b859c1282dbe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:20.476236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c0f65996074f78b5f9b859c1282dbe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:20.477061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c0f65996074f78b5f9b859c1282dbe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:20.505340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1233/2423] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:04:20 2022] DELETE /identity/v3/users/e9c0f65996074f78b5f9b859c1282dbe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:20.509686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281659-9a4c-42ae-aea5-8920c8ce7eab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:20.509948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281659-9a4c-42ae-aea5-8920c8ce7eab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:20.510413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c281659-9a4c-42ae-aea5-8920c8ce7eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:20.555961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c281659-9a4c-42ae-aea5-8920c8ce7eab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:20.558796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c281659-9a4c-42ae-aea5-8920c8ce7eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:20.576815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:20.660462 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1191/2424] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:20.672071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:20.674477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:20.706833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:20.707110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:20.707380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:20.710450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:20.743070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:20.744298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:20.767442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a13997-2b13-4a54-afe3-c4f431856d40 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:20.772467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:20.773126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:20.773408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:20.773683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:20.785482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:20.786995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:20.811415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1234/2425] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:20.851932 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1192/2426] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:20.865935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:20.867828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:21.005449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec946-7d72-47dc-b7f2-4f11a2c37040 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:21.028738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:21.029409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:21.029685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:21.031121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:21.050994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:21.052795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122bd6a-0b4e-4edb-b922-4b59e4b7de1f service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:21.064695 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1235/2427] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:21.162076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:21.163305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:21.205267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b664fb7-f0c7-4561-a0be-36546f3f5e0c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:21.231453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:21.232307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:21.232685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:21.233150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] PATH_INFO: `/v3/projects/d2403e8edc2342558e73717f3775349f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:21.234471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2403e8edc2342558e73717f3775349f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:21.240961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:21.428859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2403e8edc2342558e73717f3775349f', 'request_id': 'req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:21.470289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2403e8edc2342558e73717f3775349f', 'request_id': 'req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:21.487149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2403e8edc2342558e73717f3775349f', 'request_id': 'req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:21.515307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] The token cache is being invalidate because project d2403e8edc2342558e73717f3775349f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:04:21.515701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:21.523660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4cfa1e1-a77c-4bfd-8f11-790b47bad0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:21.527321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1193/2428] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:21 2022] DELETE /identity/v3/projects/d2403e8edc2342558e73717f3775349f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:21.531919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:21.532206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:21.532456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:21.576583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:21.577863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:21.834332 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1236/2429] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:21.842733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:21.843007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:21.843265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:21.882379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:21.883994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:21.908380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1194/2430] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:21.915346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:21.928005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a648259-43b9-4e7b-a127-9ae17ae58ef3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:21.941304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:21.942015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:21.942348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:21.942697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:21.943429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:04:21.943823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:21.945692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:21.990456 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1237/2431] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:04:21.991538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:22.007874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b91e8-8fd2-4754-8826-cb8a0f99b5a2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:22.023146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:22.025368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.025642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.025906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.035013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:22.037386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:22.106286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1195/2432] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:04:21 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:22.114174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:22.149952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55751fe-d5ab-4f9a-b3e4-5f0b51c9e4d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:22.263110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:22.298552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:22.299193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.299553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.299826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.300480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:22.302783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:22.363084 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1238/2433] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:04:22 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:04:22.368171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:22.384806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead0e4-a428-4b25-a821-312862d98357 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:22.401181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:22.402034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.402311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.402939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.404761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:22.409170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:22.436473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1196/2434] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:22.441339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:22.460117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65fcce-3867-44df-a8b3-8beafa5e5a3f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:22.472674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:22.473622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.473622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.473875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.474548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:22.476971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ae271-dc2c-46a0-9a20-8b6c98fe05b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:22.503680 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1239/2435] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:22.507683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:22.514750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:22.527405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c44f09-39ea-4d12-a6eb-8e462ad7937f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:22.543957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:22.544891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.545802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.546075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] PATH_INFO: `/v3/projects/622e293fd27c4fefaefa16a297b82250/users/16753a3e3f3a4fd08bacb4fad50960cb/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.592373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=622e293fd27c4fefaefa16a297b82250, user_id=16753a3e3f3a4fd08bacb4fad50960cb, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:22.599130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:22.636628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c129ed-2fc7-4dc0-9b86-29f06fffbd17 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:22.636829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c129ed-2fc7-4dc0-9b86-29f06fffbd17 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:22.637962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c129ed-2fc7-4dc0-9b86-29f06fffbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:22.638857 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1197/2436] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:04:22 2022] PUT /identity/v3/projects/622e293fd27c4fefaefa16a297b82250/users/16753a3e3f3a4fd08bacb4fad50960cb/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:22.775331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b7c129ed-2fc7-4dc0-9b86-29f06fffbd17 None None] MFA Rules not processed for user `16753a3e3f3a4fd08bacb4fad50960cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:22.776614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7c129ed-2fc7-4dc0-9b86-29f06fffbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:23.011767 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1240/2437] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:27.321851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:27.323568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:27.403905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd115c3-8422-48b2-8c89-e1f1216ccfca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:27.408140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:27.409083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:27.409533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:27.409976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:27.424088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:27.425900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:27.438546 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1198/2438] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:27.678710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf283-f9b8-4326-a993-5838682c481f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:27.679327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf283-f9b8-4326-a993-5838682c481f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:27.679327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ecf283-f9b8-4326-a993-5838682c481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:27.701599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-94ecf283-f9b8-4326-a993-5838682c481f None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:27.702848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-94ecf283-f9b8-4326-a993-5838682c481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:27.788212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1241/2439] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:04:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:27.796257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:27.797894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:27.925030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1354514-c802-4ed1-8d58-629a464dde33 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:27.935070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:27.935820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:27.936210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:27.936485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:27.970166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:27.972806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2f17d-0ff7-44fc-a6fe-136c116b24ec service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:27.989231 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1199/2440] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:30.707402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873d6f-a0f4-46d3-ab59-d53f2547799a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:30.708298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873d6f-a0f4-46d3-ab59-d53f2547799a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:30.708757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873d6f-a0f4-46d3-ab59-d53f2547799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:30.749152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-73873d6f-a0f4-46d3-ab59-d53f2547799a None None] MFA Rules not processed for user `ab2aa9c224654cfbbc1559ed58556ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:30.752014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73873d6f-a0f4-46d3-ab59-d53f2547799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:30.837381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1242/2441] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:30.933981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:30.934814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:30.935263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:30.948691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:30.949166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:30.949636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:30.957488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:30.981993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:30.986106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:30.991585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] MFA Rules not processed for user `19e2cb9474fb47a6b3f3793c7f162caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:30.993326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:30.998379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1200/2442] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:31.018090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:31.039353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c21314-d785-4659-bd13-b8e224b2420c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:31.045289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:31.045906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:31.046187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:31.046457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:31.059001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:31.060611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f957b-aa18-4738-9828-fa1410fbf6df service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:31.070902 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1201/2443] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:31.093131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1243/2444] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:34.961979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b3a-026e-4e68-ba32-91a79562aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:34.962486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b3a-026e-4e68-ba32-91a79562aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:34.962589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce779b3a-026e-4e68-ba32-91a79562aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:34.983318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ce779b3a-026e-4e68-ba32-91a79562aaa7 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:34.985421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce779b3a-026e-4e68-ba32-91a79562aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:34.992711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1202/2445] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:04:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:35.005091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:35.009653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.010027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.010371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.017487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07250e7f-51ef-48be-9517-af93c26aa5f3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:35.022405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:35.023009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.023287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.023559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.030528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:35.032552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:35.032673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:35.034344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:35.039816 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1203/2446] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:35.042779 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1244/2447] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:04:35.058022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:35.070935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deae11-867a-4c61-b9c6-bcd682b4cc1b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:35.079234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:35.079845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.080231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.080455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.089205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:35.090769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8045edf-cd64-423b-9f1b-c78f7ec0acd9 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:35.100051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1204/2448] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:04:35.276702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:35.359368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28e615-6aca-4503-b778-1addc36f9327 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:35.365847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:35.366770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.367223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.367705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] PATH_INFO: `/v3/users/16753a3e3f3a4fd08bacb4fad50960cb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.369379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16753a3e3f3a4fd08bacb4fad50960cb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:35.371801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:35.471338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16753a3e3f3a4fd08bacb4fad50960cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:35.482397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16753a3e3f3a4fd08bacb4fad50960cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:35.485921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16753a3e3f3a4fd08bacb4fad50960cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:35.495098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16753a3e3f3a4fd08bacb4fad50960cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:35.496013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16753a3e3f3a4fd08bacb4fad50960cb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:35.515902 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1245/2449] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:04:35 2022] DELETE /identity/v3/users/16753a3e3f3a4fd08bacb4fad50960cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:35.520898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a14d-0b39-41d9-8a70-d1e7a73cdf88 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.521273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a14d-0b39-41d9-8a70-d1e7a73cdf88 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.521543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a14d-0b39-41d9-8a70-d1e7a73cdf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.542079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7165a14d-0b39-41d9-8a70-d1e7a73cdf88 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:35.544033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7165a14d-0b39-41d9-8a70-d1e7a73cdf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:35.567208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:35.612359 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1205/2450] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:35.623173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:35.625383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:35.643252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:35.667454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9ae2-9cb3-4f30-a2f7-71a54a1793e8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.667821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9ae2-9cb3-4f30-a2f7-71a54a1793e8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.668199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9ae2-9cb3-4f30-a2f7-71a54a1793e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.693388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1cbf9ae2-9cb3-4f30-a2f7-71a54a1793e8 None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:35.694614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1cbf9ae2-9cb3-4f30-a2f7-71a54a1793e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:35.714841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d178-a8ce-4f3d-ba50-33c627a6d4f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:35.723053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:35.723691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:35.723968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:35.724239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:35.738460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:35.739929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:35.755522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1246/2451] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:35.766599 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1206/2452] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:36.138242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.139742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:36.153608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7f219-1fe4-49ae-b9b6-31e6b56de408 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.160176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.160914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.161295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.161640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] PATH_INFO: `/v3/projects/622e293fd27c4fefaefa16a297b82250` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.162872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=622e293fd27c4fefaefa16a297b82250)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.164901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.219313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622e293fd27c4fefaefa16a297b82250', 'request_id': 'req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:36.226363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622e293fd27c4fefaefa16a297b82250', 'request_id': 'req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:36.232910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622e293fd27c4fefaefa16a297b82250', 'request_id': 'req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:36.248271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] The token cache is being invalidate because project 622e293fd27c4fefaefa16a297b82250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:04:36.248588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:36.249267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87ac00a7-7e5f-449e-b41c-0fd0b15abd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:36.251071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1247/2453] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:36 2022] DELETE /identity/v3/projects/622e293fd27c4fefaefa16a297b82250 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:36.255911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.256400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.256493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.276360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:36.277639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:36.358511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1207/2454] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:36.366783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.367078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.367354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.392669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:36.394040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:36.405520 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1248/2455] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:36.409681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.420476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c948-4985-4243-8d54-c9dfc8be3062 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.428791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.432007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.432298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.432568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.433975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:04:36.434288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.436857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.452669 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1208/2456] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:04:36.459485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.476759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de9fc5-c239-48af-8a8b-37f57acc69b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.484151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.485840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.486275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.487506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.488127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.490103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.539332 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1249/2457] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:04:36 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:04:36.540673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.552958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485c0f9-4881-4e6b-97aa-e79583e2865c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.645106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.645976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.646279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.646544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.647164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.649283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.658819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:36.685480 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1209/2458] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:04:36 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:36.690314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.704609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2c41-a76e-403e-a127-f5db3c6c2583 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.710392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.711092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.711365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.711632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.712289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.714028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.724911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1250/2459] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:04:36.728911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.739554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde4b9-7d0f-4729-b569-95af948db14d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.744288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.744885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.745254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.745540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.746226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.748112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6be9-5a67-485f-b676-d07a95c4b926 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.758769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1210/2460] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:36.763423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.775493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba53cbc-3b0b-4e91-9bf4-03bee62076f7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.780336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.781177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.781522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.781861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] PATH_INFO: `/v3/projects/22e9d50ee0c04ad58b4f851a619b58c1/users/e11f56c35f4845b181e465224cf05a84/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.797515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e9d50ee0c04ad58b4f851a619b58c1, user_id=e11f56c35f4845b181e465224cf05a84, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:36.800209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:36.814499 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1251/2461] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:04:36 2022] PUT /identity/v3/projects/22e9d50ee0c04ad58b4f851a619b58c1/users/e11f56c35f4845b181e465224cf05a84/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:04:36.819761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.820044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.820313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:36.840864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:36.842197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:36.903105 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1211/2462] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:36.912951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:36.915014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:36.964741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:36.987456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40aa39-c5ab-4088-94d2-427caea8841e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:36.991395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:36.992050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:36.992333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:36.992606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:37.003101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:37.004539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7eef-b786-4174-8e6a-7c60572fbbb9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:37.016240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1252/2463] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:41.093728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:41.093728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:41.115938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6bfd-4f28-45ec-8555-c5f594870be7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:41.120921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:41.121919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:41.122611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:41.123027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] PATH_INFO: `/v3/users/7f02637b1935426280f2ad6bcfa61b26` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:41.124794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f02637b1935426280f2ad6bcfa61b26)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:41.127186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:41.204479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f02637b1935426280f2ad6bcfa61b26'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:41.205739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f02637b1935426280f2ad6bcfa61b26'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:41.213316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f02637b1935426280f2ad6bcfa61b26'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:41.214003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f02637b1935426280f2ad6bcfa61b26'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:41.222821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f02637b1935426280f2ad6bcfa61b26'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:41.286477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:41.287855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:41.288127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:41.295894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1212/2464] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:04:41 2022] DELETE /identity/v3/users/7f02637b1935426280f2ad6bcfa61b26 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:41.323134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:41.325065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:41.404538 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1253/2465] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:41.419567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:41.421050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:41.547835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863b9e-f28f-413c-94dd-a69799809499 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:41.551726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:41.552601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:41.552920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:41.553264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:41.562088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:41.567107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:41.569466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc39d-42aa-4865-82df-f09c291a84aa service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:41.589364 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1213/2466] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:42.009523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.011037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:42.027787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8e7cc-473d-49e1-9206-c074d00ccce4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.034110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.034780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.035058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.035330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] PATH_INFO: `/v3/projects/fd26b2e375084d72a31f6e39b420da8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.037162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd26b2e375084d72a31f6e39b420da8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.039656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.114062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd26b2e375084d72a31f6e39b420da8c', 'request_id': 'req-5795f4b3-872a-44d4-8e65-740127824710'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:42.125458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd26b2e375084d72a31f6e39b420da8c', 'request_id': 'req-5795f4b3-872a-44d4-8e65-740127824710'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:42.141680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd26b2e375084d72a31f6e39b420da8c', 'request_id': 'req-5795f4b3-872a-44d4-8e65-740127824710'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:42.184347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] The token cache is being invalidate because project fd26b2e375084d72a31f6e39b420da8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:04:42.185195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:42.186072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5795f4b3-872a-44d4-8e65-740127824710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:04:42.188822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1254/2467] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:04:42 2022] DELETE /identity/v3/projects/fd26b2e375084d72a31f6e39b420da8c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:42.194057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.194554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.194662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.237888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:42.239204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:42.322871 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1214/2468] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:42.329977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.330890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.331345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.355989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:42.357831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:42.370271 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1255/2469] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:42.371533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.383934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f24fd6-aaf6-4735-a5e7-f1db686ce2e6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.388748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.389528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.389892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.390239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.390889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:04:42.391711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.393437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.414163 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1215/2470] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:04:42.418997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.428618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f529a-be28-4d8b-806a-aaf67171a3aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.435360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.436216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.436492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.437312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.438213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.440086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.476761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1256/2471] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:04:42 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:42.478002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.490149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189142d0-27e7-4807-997e-181dc5c8741f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.566267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.567066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.567434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.567818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.568535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.570695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.598141 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1216/2472] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:04:42 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:04:42.602740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.614675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2740c2-535c-4f0b-bb65-e0fa3532d120 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.620886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.621944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.622461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.622900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.624015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.626857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.643481 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1257/2473] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:42.645466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.656569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5022a9-11b6-4189-821e-767f26f79944 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.661678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.662428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.662805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.663185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.663934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.665714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404f25-3517-49e8-98e6-2d519b602be9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.679797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1217/2474] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:04:42.684065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.696061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249e73-449b-4a32-8406-013bed771fac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.701479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.702150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.702969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.703234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] PATH_INFO: `/v3/projects/c0ce650ca228469c984583f0d0ae7b20/users/6ca1e616c6044c07b3985ab39407f204/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.720734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce650ca228469c984583f0d0ae7b20, user_id=6ca1e616c6044c07b3985ab39407f204, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.723946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.733788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:42.740136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1258/2475] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:04:42 2022] PUT /identity/v3/projects/c0ce650ca228469c984583f0d0ae7b20/users/6ca1e616c6044c07b3985ab39407f204/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:04:42.745646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88898da-dcd1-4a8c-bf54-65649bd39cd8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.745963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88898da-dcd1-4a8c-bf54-65649bd39cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.746203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88898da-dcd1-4a8c-bf54-65649bd39cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.767805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b88898da-dcd1-4a8c-bf54-65649bd39cd8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:42.769455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b88898da-dcd1-4a8c-bf54-65649bd39cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:42.826402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:04:42.841043 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1218/2476] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:42.851922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:42.853713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:42.918501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58ad9b-2a58-45f8-9c73-011c7f87801e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:42.922959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:42.923925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:42.924331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:42.924708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:42.936007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:42.937624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123d103-766c-4876-a5ff-49fc5211d804 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:42.948943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1259/2477] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:49.161704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:49.162272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:49.162373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:49.199247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] MFA Rules not processed for user `e11f56c35f4845b181e465224cf05a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:49.200502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:49.359930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1219/2478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:49.361258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40365b9-26b9-41e4-9045-321177238c89 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:49.362417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40365b9-26b9-41e4-9045-321177238c89 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:49.362900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40365b9-26b9-41e4-9045-321177238c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:49.389248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f40365b9-26b9-41e4-9045-321177238c89 None None] MFA Rules not processed for user `e11f56c35f4845b181e465224cf05a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:49.391726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f40365b9-26b9-41e4-9045-321177238c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:49.400237 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1260/2479] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:04:49.628871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:49.631122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:49.734158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a03dac-8fa1-4914-b5b5-966cc3b23c85 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:49.741056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:49.741788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:49.742167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:49.742673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:49.763177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:49.764951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80374b2-bf50-4b79-b30c-7dd8c8a2e24b service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:49.784540 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1220/2480] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:04:51.788074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:51.788551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:51.788661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:51.851475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] MFA Rules not processed for user `6ca1e616c6044c07b3985ab39407f204`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:51.852929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:52.008212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1261/2481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:52.019605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a4c3-7067-46a4-ab34-38ccbf48f57b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:52.019605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a4c3-7067-46a4-ab34-38ccbf48f57b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:52.020228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a4c3-7067-46a4-ab34-38ccbf48f57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:52.041871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f1e4a4c3-7067-46a4-ab34-38ccbf48f57b None None] MFA Rules not processed for user `6ca1e616c6044c07b3985ab39407f204`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:04:52.043104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f1e4a4c3-7067-46a4-ab34-38ccbf48f57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:52.054709 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1221/2482] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:04:52.069524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:04:52.071216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:04:52.094876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bffe1-5dc7-4aa9-9833-f942af77069b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:04:52.113981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:04:52.114641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:04:52.115102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:04:52.115530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:04:52.125498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:04:52.128057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:04:52.143629 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1262/2483] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:04:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:02.035801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=69 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:02.135935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=68 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:05.291074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee6dc-6269-4371-b18e-2fdf41c20653 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:05.291635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee6dc-6269-4371-b18e-2fdf41c20653 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:05.291635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee6dc-6269-4371-b18e-2fdf41c20653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:05.328318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-02cee6dc-6269-4371-b18e-2fdf41c20653 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:05.331859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02cee6dc-6269-4371-b18e-2fdf41c20653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:05.458920 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1222/2484] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:05:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:05.477021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:05.483567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:05.659964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115b2b-a8c0-42e7-84db-19d4d50334fc service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:05.666554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:05.667280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:05.667626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:05.667968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:05.702217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:05.704095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3281c-0e46-488f-b601-052b3e7c7d38 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:05.726283 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1263/2485] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:07.931261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859647-260e-4786-881a-164b025f969f None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:07.931797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859647-260e-4786-881a-164b025f969f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:07.931797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859647-260e-4786-881a-164b025f969f None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:07.933413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1223/2486] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:05:07.984874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:07.985810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:07.986239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:08.030652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:08.032484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:08.147572 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1264/2487] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:08.216597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68859647-260e-4786-881a-164b025f969f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:08.219680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68859647-260e-4786-881a-164b025f969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:08.237553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68859647-260e-4786-881a-164b025f969f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:08.245774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:08.248538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:08.249091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:08.249583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:08.276860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:08.278717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:08.310581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1224/2488] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:17.475558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:17.477049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:17.502454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98c28-59e8-457c-949d-8cf333442c5b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:17.509171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:17.510402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:17.510901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:17.511475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] PATH_INFO: `/v3/users/2afa642202234799a50a8460a3b6d36c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:17.513998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2afa642202234799a50a8460a3b6d36c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:17.516487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:17.605616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2afa642202234799a50a8460a3b6d36c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:17.617296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2afa642202234799a50a8460a3b6d36c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:17.618249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2afa642202234799a50a8460a3b6d36c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:17.639270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2afa642202234799a50a8460a3b6d36c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:17.641413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2afa642202234799a50a8460a3b6d36c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:17.665722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:17.683561 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1265/2489] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:17 2022] DELETE /identity/v3/users/2afa642202234799a50a8460a3b6d36c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:17.950889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:17.980623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c87c1-12ae-4bcf-ac1a-29eda29c5ecb service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:18.252262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:18.252903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:18.253214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:18.253485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] PATH_INFO: `/v3/projects/06acce18eb064040a95fb5c282c07109` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:18.254634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06acce18eb064040a95fb5c282c07109)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:18.256521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:18.358798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06acce18eb064040a95fb5c282c07109', 'request_id': 'req-9e300c3b-b93b-40fe-baf5-68261b1f773f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.373570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06acce18eb064040a95fb5c282c07109', 'request_id': 'req-9e300c3b-b93b-40fe-baf5-68261b1f773f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.385196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06acce18eb064040a95fb5c282c07109', 'request_id': 'req-9e300c3b-b93b-40fe-baf5-68261b1f773f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.423481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] The token cache is being invalidate because project 06acce18eb064040a95fb5c282c07109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:18.423481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.428216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.434232 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1225/2490] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:17 2022] DELETE /identity/v3/projects/06acce18eb064040a95fb5c282c07109 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:18.434768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:18.437029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:18.454973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2f80-bfc8-49b8-bdae-2eb849d3fd2a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:18.554677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:18.555708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:18.555987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:18.557732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] PATH_INFO: `/v3/users/06effc1273fb4008a44d94a9810fecb1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:18.562283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=06effc1273fb4008a44d94a9810fecb1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:18.565840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:18.671340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06effc1273fb4008a44d94a9810fecb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.714423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06effc1273fb4008a44d94a9810fecb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.715654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06effc1273fb4008a44d94a9810fecb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.725981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06effc1273fb4008a44d94a9810fecb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.727100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05403deb-cdcf-4acd-b246-e062512d2ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06effc1273fb4008a44d94a9810fecb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:18.755908 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1266/2491] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:18 2022] DELETE /identity/v3/users/06effc1273fb4008a44d94a9810fecb1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:19.090256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:19.093050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:19.140820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300c3b-b93b-40fe-baf5-68261b1f773f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:19.197118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:19.267496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:19.268323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:19.269211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:19.269586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] PATH_INFO: `/v3/projects/68ecb18282074deea9baeabd0495ae68` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:19.271682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ecb18282074deea9baeabd0495ae68)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:19.275992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:19.405859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ecb18282074deea9baeabd0495ae68', 'request_id': 'req-0c72fa46-e7aa-4b16-b800-d324b96bd45c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:19.424938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ecb18282074deea9baeabd0495ae68', 'request_id': 'req-0c72fa46-e7aa-4b16-b800-d324b96bd45c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:19.436498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ecb18282074deea9baeabd0495ae68', 'request_id': 'req-0c72fa46-e7aa-4b16-b800-d324b96bd45c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:19.462376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] The token cache is being invalidate because project 68ecb18282074deea9baeabd0495ae68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:19.462671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:19.464696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c72fa46-e7aa-4b16-b800-d324b96bd45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:19.468633 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1226/2492] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:19 2022] DELETE /identity/v3/projects/68ecb18282074deea9baeabd0495ae68 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:19.473511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:19.473795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:19.474068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:19.517176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:19.521207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:19.683745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:19.684263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:19.684702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:19.690948 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1267/2493] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:19.727336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:19.730174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:19.758102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1227/2494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:19.761734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:19.779563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f4b7a-2e12-45d7-845e-8e39e91bae7b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:19.793092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:19.793092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:19.793092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:19.793092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:19.795974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:19.795974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:19.795974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:19.840860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1268/2495] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:19.840972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:19.862369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8eec7d-2d0b-4d27-9250-320abe740035 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:19.874444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:19.875083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:19.875364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:19.875638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:19.876282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:19.883023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:19.944961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:19.957564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1228/2496] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:19 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:19.958405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:19.971491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def6ee0-3bd0-4ed5-930d-1fbcc2c29869 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:20.218321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:20.219090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.220168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.220702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.224947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:20.227291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:20.273596 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1269/2497] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:19 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:20.278158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:20.292561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d329ae-79c0-495b-9fa3-eed406da2c42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:20.300288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:20.301957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.302439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.305899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.305899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:20.307572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:20.346022 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1229/2498] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:20.347240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:20.363906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fc5c-502d-4012-83fa-b945a16b9a9e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:20.369062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:20.369817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.370227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.371386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.371386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:20.374638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13090-d800-45e1-ba13-cfbf963e1a68 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:20.389643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1270/2499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:05:20.393197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:20.415491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda67e1-5605-4394-9100-e44e9b313f86 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:20.429421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:20.430102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.430377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.430654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] PATH_INFO: `/v3/projects/4bcd652ad41d49718e4cee60d29df1df/users/633b3f27a5cc41cf8a93ed0d9f9527b5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.491979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcd652ad41d49718e4cee60d29df1df, user_id=633b3f27a5cc41cf8a93ed0d9f9527b5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:20.500894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:20.531183 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1230/2500] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:20 2022] PUT /identity/v3/projects/4bcd652ad41d49718e4cee60d29df1df/users/633b3f27a5cc41cf8a93ed0d9f9527b5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:20.541684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.541999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.542276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.604865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] MFA Rules not processed for user `633b3f27a5cc41cf8a93ed0d9f9527b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:20.606624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:20.741465 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1271/2501] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:20.746094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:20.846516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:20.879245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9a3c8-fdcb-4869-a67d-001a3b605710 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:20.900076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:20.900709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:20.901003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:20.901295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:20.901936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:20.909770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:20.984503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1231/2502] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:20 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:20.988746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.024978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250b60-23d2-48f2-9c8e-1378d449a154 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:21.205739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:21.208657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.209984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.210363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.211861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:21.215994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:21.273029 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1272/2503] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:20 2022] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:21.276889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.294112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfcd55-7428-42b9-8194-e1393ce6c5c7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:21.322024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:21.323292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.323732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.337508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.342773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:21.345101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:21.370861 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1232/2504] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:21.376059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.381503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:21.393160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b20e-4f14-491f-a961-d2ab959b89a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:21.408803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286f08-685b-4695-958e-645e81020313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:21.412553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286f08-685b-4695-958e-645e81020313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.413289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286f08-685b-4695-958e-645e81020313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.413895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286f08-685b-4695-958e-645e81020313 admin admin] PATH_INFO: `/v3/projects/9309c803f778417cb3236aeaf5daeb3b/users/dabf9ef47bc7463cbb6f9db5e3492fee/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.458349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286f08-685b-4695-958e-645e81020313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9309c803f778417cb3236aeaf5daeb3b, user_id=dabf9ef47bc7463cbb6f9db5e3492fee, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:21.465126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286f08-685b-4695-958e-645e81020313 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:21.506785 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1273/2505] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:21 2022] PUT /identity/v3/projects/9309c803f778417cb3236aeaf5daeb3b/users/dabf9ef47bc7463cbb6f9db5e3492fee/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:21.510703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.526226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ddb58-0596-4746-9e1b-0a5b63924409 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:21.644013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:21.644657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.644939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.645244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.646353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:21.648929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35375f6-b13d-42ee-89da-a307ade70db7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:21.663598 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1233/2506] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:21.667509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286f08-685b-4695-958e-645e81020313 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.683736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286f08-685b-4695-958e-645e81020313 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:21.690205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:21.691040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.691389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.691968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] PATH_INFO: `/v3/projects/9309c803f778417cb3236aeaf5daeb3b/users/dabf9ef47bc7463cbb6f9db5e3492fee/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.694685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9309c803f778417cb3236aeaf5daeb3b, user_id=dabf9ef47bc7463cbb6f9db5e3492fee, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:21.697545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:21.721092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1274/2507] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:21 2022] PUT /identity/v3/projects/9309c803f778417cb3236aeaf5daeb3b/users/dabf9ef47bc7463cbb6f9db5e3492fee/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:21.725984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:21.725984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:21.726255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:21.797551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] MFA Rules not processed for user `dabf9ef47bc7463cbb6f9db5e3492fee`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:21.798878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:21.947261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1234/2508] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:21.969043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:21.971277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:22.037466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:22.039000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:22.228242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:22.291508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73493866-6a5f-4367-9ca6-4c23d9f45ca0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:22.323826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:22.328262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b61899-88cc-4161-90c0-56fcebb96d12 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:22.333330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:22.333855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:22.334296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:22.375355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:22.377752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:22.378209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:22.379043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:22.379512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] PATH_INFO: `/v3/users/e43668b02a784329b9c73993ed6a927e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:22.380761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece3b3c-71cc-48c4-a043-89e7e56ef0b1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:22.396412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43668b02a784329b9c73993ed6a927e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:22.406566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:22.422683 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1275/2509] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:22.511144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43668b02a784329b9c73993ed6a927e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:22.511848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43668b02a784329b9c73993ed6a927e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:22.539937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43668b02a784329b9c73993ed6a927e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:22.543047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43668b02a784329b9c73993ed6a927e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:22.558287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43668b02a784329b9c73993ed6a927e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:22.611653 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1235/2510] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:22 2022] DELETE /identity/v3/users/e43668b02a784329b9c73993ed6a927e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:05:22.615098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:22.615098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:22.615098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:22.643657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:22.644869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:22.778387 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1276/2511] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:22.829572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:22.831262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:22.975126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216fcd2-04eb-48ac-96d6-dd87f089ab14 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:22.984904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:22.986097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:22.986097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:22.986450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:22.998865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:23.001230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c692a92-6c91-497b-8779-757f20480ba5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:23.032224 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1236/2512] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:23.165472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:23.166928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:23.196888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b0b96-1cd0-43b4-917b-f1175da34a59 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:23.203235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:23.204169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:23.204601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:23.205086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] PATH_INFO: `/v3/users/633b3f27a5cc41cf8a93ed0d9f9527b5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:23.206524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633b3f27a5cc41cf8a93ed0d9f9527b5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:23.208651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:23.300525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:23.304144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633b3f27a5cc41cf8a93ed0d9f9527b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:23.319626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633b3f27a5cc41cf8a93ed0d9f9527b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:23.320346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633b3f27a5cc41cf8a93ed0d9f9527b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:23.335011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633b3f27a5cc41cf8a93ed0d9f9527b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:23.337144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633b3f27a5cc41cf8a93ed0d9f9527b5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:23.378723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1277/2513] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:23 2022] DELETE /identity/v3/users/633b3f27a5cc41cf8a93ed0d9f9527b5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:23.383882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:23.384424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:23.384424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:23.438189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:23.449644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:23.589031 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1237/2514] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:23.599018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:23.600610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:23.742517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1dfbc-6b04-4fd8-9e55-6fb193d056e1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:23.749879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:23.750546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:23.750807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:23.751080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:23.791191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:23.792649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:23.811250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:23.812686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:23.815025 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1278/2515] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:23.834906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c35c8e-f8de-435d-b348-a373dccbca8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:23.846027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:23.847300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:23.847300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:23.847300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] PATH_INFO: `/v3/projects/6331acc801404531ad94b7ee7664bebe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:23.850018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6331acc801404531ad94b7ee7664bebe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:23.851939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:23.853948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:23.988955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6331acc801404531ad94b7ee7664bebe', 'request_id': 'req-c3ba36d5-514f-4746-a802-bf75b44204d2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.005758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6331acc801404531ad94b7ee7664bebe', 'request_id': 'req-c3ba36d5-514f-4746-a802-bf75b44204d2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.017510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6331acc801404531ad94b7ee7664bebe', 'request_id': 'req-c3ba36d5-514f-4746-a802-bf75b44204d2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.032162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] The token cache is being invalidate because project 6331acc801404531ad94b7ee7664bebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:24.032459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.033649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.036387 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1238/2516] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:23 2022] DELETE /identity/v3/projects/6331acc801404531ad94b7ee7664bebe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:05:24.040623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:24.055320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec0e72-e331-4486-bc0d-5ebbfbfcb086 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:24.258390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:24.265363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:24.265697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:24.266177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] PATH_INFO: `/v3/users/6ca23351ac7143d0a1ac7968f3d32215` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:24.268307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca23351ac7143d0a1ac7968f3d32215)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:24.270867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:24.396020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca23351ac7143d0a1ac7968f3d32215'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.412670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca23351ac7143d0a1ac7968f3d32215'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.414266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca23351ac7143d0a1ac7968f3d32215'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.430047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca23351ac7143d0a1ac7968f3d32215'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.431947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca23351ac7143d0a1ac7968f3d32215'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:24.446749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:24.507934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1279/2517] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:24 2022] DELETE /identity/v3/users/6ca23351ac7143d0a1ac7968f3d32215 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:24.977390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:24.978995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:25.006648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba36d5-514f-4746-a802-bf75b44204d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:25.171366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:25.172387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:25.172772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:25.173798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] PATH_INFO: `/v3/projects/4bcd652ad41d49718e4cee60d29df1df` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:25.175320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcd652ad41d49718e4cee60d29df1df)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:25.178766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:25.343407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcd652ad41d49718e4cee60d29df1df', 'request_id': 'req-f78104cc-4848-49a1-a7bf-f8573bd62841'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.361439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcd652ad41d49718e4cee60d29df1df', 'request_id': 'req-f78104cc-4848-49a1-a7bf-f8573bd62841'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.376726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcd652ad41d49718e4cee60d29df1df', 'request_id': 'req-f78104cc-4848-49a1-a7bf-f8573bd62841'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.390675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:25.393049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:25.406440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] The token cache is being invalidate because project 4bcd652ad41d49718e4cee60d29df1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:25.406734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.407699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.416887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1239/2518] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:24 2022] DELETE /identity/v3/projects/4bcd652ad41d49718e4cee60d29df1df => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:25.418320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:25.421860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:25.423644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7cfb6-af17-434a-b704-d17f850fa91a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:25.512093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:25.596154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:25.597468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:25.597861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:25.598384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] PATH_INFO: `/v3/projects/29b43f140cdf45e78f949164ff8db458` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:25.600627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b43f140cdf45e78f949164ff8db458)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:25.606292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:25.712765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104cc-4848-49a1-a7bf-f8573bd62841 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:25.729026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:25.730302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:25.730302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:25.730516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] PATH_INFO: `/v3/users/dabf9ef47bc7463cbb6f9db5e3492fee` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:25.731857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabf9ef47bc7463cbb6f9db5e3492fee)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:25.734379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:25.812014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b43f140cdf45e78f949164ff8db458', 'request_id': 'req-962bc15e-f745-43f7-9f67-a46755ddc43d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.830361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b43f140cdf45e78f949164ff8db458', 'request_id': 'req-962bc15e-f745-43f7-9f67-a46755ddc43d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.848131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b43f140cdf45e78f949164ff8db458', 'request_id': 'req-962bc15e-f745-43f7-9f67-a46755ddc43d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.854189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabf9ef47bc7463cbb6f9db5e3492fee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.855277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabf9ef47bc7463cbb6f9db5e3492fee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.876259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabf9ef47bc7463cbb6f9db5e3492fee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.878075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] The token cache is being invalidate because project 29b43f140cdf45e78f949164ff8db458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:25.878367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.878978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabf9ef47bc7463cbb6f9db5e3492fee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.879351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-962bc15e-f745-43f7-9f67-a46755ddc43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.883198 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1280/2519] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:25 2022] DELETE /identity/v3/projects/29b43f140cdf45e78f949164ff8db458 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:25.890387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:25.890780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:25.891143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:25.894379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69ff2d94-55cf-4a6b-9f20-194787c49ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabf9ef47bc7463cbb6f9db5e3492fee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:25.949856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1240/2520] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:25 2022] DELETE /identity/v3/users/dabf9ef47bc7463cbb6f9db5e3492fee => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:05:25.952870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:25.953070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:26.039690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1281/2521] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:26.048004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.048485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.048651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.090294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:26.091792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:26.105264 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1241/2522] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:26.106451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.136635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe6c94-d31a-4e72-94cd-87d81df245a9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.149327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.149960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.150241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.150513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.151185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:26.151669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.153872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.173892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1282/2523] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:26.178521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.196612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5efa-d67a-455e-b45c-9e658b86e389 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.208622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.211062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.211337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.211802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.212456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.217072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.293167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1242/2524] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:26 2022] POST /identity/v3/projects => generated 395 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:26.299213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.306333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:26.318885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f9c54-5b25-44b0-823b-2c616c4612db admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.453543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.455588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:26.502414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.503281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.503631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.503973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.504902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.506949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.548115 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1283/2525] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:26 2022] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:26.550740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.576845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb4c0c-a3d5-43d8-ba25-4945b79cfb21 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.602426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.603059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.607694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.608083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.608786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.610509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.613402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72242e5-8561-425a-a20c-54212ec5849a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.630328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.630995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.631405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.631679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] PATH_INFO: `/v3/users/e11f56c35f4845b181e465224cf05a84` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.634750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11f56c35f4845b181e465224cf05a84)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.638035 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1284/2526] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:26.641477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.644349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.660577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef62ab-9eaa-4f95-afe8-2cb48fa5df07 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.673605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.674282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.674560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:26.674678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.674839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.675946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.680488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.708424 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1285/2527] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:26.712692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.736966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e1dc-cb20-4cc1-b1c8-bdf6224917ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:26.800062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:26.800756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.803888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.804168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] PATH_INFO: `/v3/projects/7d2440a5a1224c7a9ed861701ad78722/users/16dfeb727c754cd0869ca992c7ef5b1e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.805276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11f56c35f4845b181e465224cf05a84'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:26.806867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11f56c35f4845b181e465224cf05a84'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:26.817820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11f56c35f4845b181e465224cf05a84'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:26.819361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11f56c35f4845b181e465224cf05a84'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:26.830496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e4e1f77-e089-468b-8807-c019aeaf4e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11f56c35f4845b181e465224cf05a84'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:26.861338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2440a5a1224c7a9ed861701ad78722, user_id=16dfeb727c754cd0869ca992c7ef5b1e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:26.866232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:26.890369 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1286/2528] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:26 2022] PUT /identity/v3/projects/7d2440a5a1224c7a9ed861701ad78722/users/16dfeb727c754cd0869ca992c7ef5b1e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:26.899512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1243/2529] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:26 2022] DELETE /identity/v3/users/e11f56c35f4845b181e465224cf05a84 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:26.903660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:26.906820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:26.907182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:26.907483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:26.918132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:26.986036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] MFA Rules not processed for user `16dfeb727c754cd0869ca992c7ef5b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:26.990506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.084399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd6593-9947-404e-82c0-0a87e8e52e74 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.089328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.090275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.090560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.090837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] PATH_INFO: `/v3/projects/9309c803f778417cb3236aeaf5daeb3b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.093518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9309c803f778417cb3236aeaf5daeb3b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.095465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.109844 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1244/2530] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:27.114247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.117851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.139698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa4908-09d8-476e-99b7-04c8f6ad157a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.146370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.161612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.165352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.165860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.167401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.173534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.188021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:27.191191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9309c803f778417cb3236aeaf5daeb3b', 'request_id': 'req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.212945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9309c803f778417cb3236aeaf5daeb3b', 'request_id': 'req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.224336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9309c803f778417cb3236aeaf5daeb3b', 'request_id': 'req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.239807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1245/2531] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:05:27.240583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] The token cache is being invalidate because project 9309c803f778417cb3236aeaf5daeb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:27.241077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.241300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.242489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.243032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.244354 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1287/2532] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:26 2022] DELETE /identity/v3/projects/9309c803f778417cb3236aeaf5daeb3b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:27.245511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.247046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.321089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:27.326473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10e700-a764-4ea8-827c-ea747da1dc97 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.333210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.334063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.334722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.334999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] PATH_INFO: `/v3/projects/22e9d50ee0c04ad58b4f851a619b58c1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.336702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e9d50ee0c04ad58b4f851a619b58c1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.339896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.342095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53dc8-e238-4e1b-a6ee-1418a17d14c4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.347991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.348859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.349370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.349870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.350713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.353478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc24b-41a4-44a9-85c0-b2fd28115a67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.384050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1288/2533] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:27.385811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169976-29b2-4242-ab17-d5ed2971b188 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.386340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169976-29b2-4242-ab17-d5ed2971b188 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.387247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169976-29b2-4242-ab17-d5ed2971b188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.405321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e9d50ee0c04ad58b4f851a619b58c1', 'request_id': 'req-783e66ed-0ed3-46b8-b742-4d5d948e6363'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.414964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2f169976-29b2-4242-ab17-d5ed2971b188 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:27.417058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f169976-29b2-4242-ab17-d5ed2971b188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.420301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e9d50ee0c04ad58b4f851a619b58c1', 'request_id': 'req-783e66ed-0ed3-46b8-b742-4d5d948e6363'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.428576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e9d50ee0c04ad58b4f851a619b58c1', 'request_id': 'req-783e66ed-0ed3-46b8-b742-4d5d948e6363'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.452646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] The token cache is being invalidate because project 22e9d50ee0c04ad58b4f851a619b58c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:27.452947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.454963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:27.457433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1246/2534] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:27 2022] DELETE /identity/v3/projects/22e9d50ee0c04ad58b4f851a619b58c1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:27.457830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.462355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.496641 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1289/2535] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:27.504755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170593-794e-4101-b24f-296cbbabfb91 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.505421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170593-794e-4101-b24f-296cbbabfb91 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.505421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170593-794e-4101-b24f-296cbbabfb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.541625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7e170593-794e-4101-b24f-296cbbabfb91 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:27.543337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e170593-794e-4101-b24f-296cbbabfb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.562780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1290/2536] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:27.563039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e66ed-0ed3-46b8-b742-4d5d948e6363 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.563146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.563146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.563146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.567813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.568574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.568944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.569334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.570380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.571848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1009c45-f793-49c4-9c28-9f26a8f752f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.584873 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1247/2537] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:27.586365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.586748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.587114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.593012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:27.594634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.619629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:27.620913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:27.625822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1291/2538] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:27.628842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.639322 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1248/2539] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:27.639322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.650896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63f516-473b-411b-b09a-ff6914361970 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.655969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.656443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ea9b-10d0-483c-ac2d-40b9e4f7dc21 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.656593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.656848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.657148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.658791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:27.659514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.661630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.674666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.675726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.675856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.676218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] PATH_INFO: `/v3/projects/f99d7df4f1924bf9888d353f261425ee/users/87ba647c6fbd49d08e102251d38a6ad8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.681979 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1249/2540] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:27.682928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.699256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb036-8157-4ee5-86d0-e12e04851b74 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.705867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99d7df4f1924bf9888d353f261425ee, user_id=87ba647c6fbd49d08e102251d38a6ad8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.706036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.706568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.706850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.707124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.707774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:27.708076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.709688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.711691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.726712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1250/2541] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:27.727589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.743809 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1292/2542] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:27 2022] PUT /identity/v3/projects/f99d7df4f1924bf9888d353f261425ee/users/87ba647c6fbd49d08e102251d38a6ad8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:27.744760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:27.758120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45968e2-fc71-49e4-81cf-290fa430ecd4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.837948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:27.898572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:27.905343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa50fc-2889-45bf-9506-bcf5a450ad5c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:27.913997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.915921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.916362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:27.916721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.917193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.917524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:27.917977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:27.918466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:27.919333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.923402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.950861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:27.954773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:27.996217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1293/2543] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:27.996217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.042039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1251/2544] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:27 2022] POST /identity/v3/projects => generated 393 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:28.042866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.154221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec3a2b-beaf-415d-8f2e-d829513fb2c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.203809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef49023-a46f-4517-9810-e15477cb559f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.225654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.229057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.229319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.229849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.230508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.235421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.277880 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1252/2545] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:28 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:28.278768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.292567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06b8cb-0c3b-4d62-8a4d-241da25af7d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.297526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.298195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.298482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.298752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.299381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.301470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a0e56-44eb-4e8a-843e-6654babb885f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.321895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.322565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.327257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.327564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.328270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.332404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.343499 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1253/2546] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:28 2022] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:28.345107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.345565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.345989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.357892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1294/2547] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:28.359417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.374582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:28.376228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:28.390231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28968ff-5ef2-4d7a-ae25-908913b6eafc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.412870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.413860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.414512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.415205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.416163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.418131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.453837 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1295/2548] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:28.458886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.472762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6c20a-222f-4f3c-99b8-196c4e644c6f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.477570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.478905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.479222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.479829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.480595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.483089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.486866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1254/2549] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:28.488031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.499290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1296/2550] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:28.499290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.511732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19e115-b918-4de3-a30a-32da13fe9dcb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.518004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.518217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe31ef-40f2-4c2b-a8a2-95943389c654 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.518674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.519091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.519554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.520212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.522380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.525449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.526297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.526748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.527289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] PATH_INFO: `/v3/projects/f99d7df4f1924bf9888d353f261425ee/users/87ba647c6fbd49d08e102251d38a6ad8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.529795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99d7df4f1924bf9888d353f261425ee, user_id=87ba647c6fbd49d08e102251d38a6ad8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.532895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.538331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1297/2551] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:28.538331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.548428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bc3c0-8819-4255-a729-1d5b731d66cc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.552794 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1255/2552] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:28 2022] PUT /identity/v3/projects/f99d7df4f1924bf9888d353f261425ee/users/87ba647c6fbd49d08e102251d38a6ad8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:28.553810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.566018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:28.576826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:28.626523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:28.641648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.642446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.642819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.643185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.643946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.646190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.659586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1298/2553] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:28.660273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.665867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33621c27-0f1d-491a-ba92-631379522ff8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.670893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a0d8b-eebd-4028-aa49-bcacbe3d9f62 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.673056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.674007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.674298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.674574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.676686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.677379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.677653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.677921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] PATH_INFO: `/v3/projects/95688716e1614719bab0f4850aa70b2c/users/e46ff953364048d392e5adcdade2b256/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.693971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=95688716e1614719bab0f4850aa70b2c, user_id=e46ff953364048d392e5adcdade2b256, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.699318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde86f4e-0b21-466e-af2a-72a8f9a24efc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.723483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1299/2554] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:28 2022] PUT /identity/v3/projects/95688716e1614719bab0f4850aa70b2c/users/e46ff953364048d392e5adcdade2b256/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:28.725104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f59ba-eab7-4e89-99dc-e6e0635749ed None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.725372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f59ba-eab7-4e89-99dc-e6e0635749ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.725640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f59ba-eab7-4e89-99dc-e6e0635749ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.758578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.760213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.774325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1256/2555] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:05:28.775308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.779653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-995f59ba-eab7-4e89-99dc-e6e0635749ed None None] MFA Rules not processed for user `87ba647c6fbd49d08e102251d38a6ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:28.780974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-995f59ba-eab7-4e89-99dc-e6e0635749ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:28.791693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b43e-4a67-4a0b-8ad3-43859f58ed08 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:28.889994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:28.890666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.890942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.891218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] PATH_INFO: `/v3/projects/9e6890b8afbe4908bf905270b9fa2efc/users/ad3515f6ad9942e794a457e1febaee02/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.917978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6890b8afbe4908bf905270b9fa2efc, user_id=ad3515f6ad9942e794a457e1febaee02, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:28.921583 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1300/2556] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:28.923356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729652-5efe-4346-b881-0de8b0b29afa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:28.924515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729652-5efe-4346-b881-0de8b0b29afa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:28.925150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729652-5efe-4346-b881-0de8b0b29afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:28.927872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:28.963161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1257/2557] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:28 2022] PUT /identity/v3/projects/9e6890b8afbe4908bf905270b9fa2efc/users/ad3515f6ad9942e794a457e1febaee02/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:28.964183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:28.966506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:28.975771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-35729652-5efe-4346-b881-0de8b0b29afa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:28.976983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35729652-5efe-4346-b881-0de8b0b29afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:29.110741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:29.112507 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1301/2558] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:29.114175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.114456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.114727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.117670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173073b9-5b81-491c-b145-bec801bd0196 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.126788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.128418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.128950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.129527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.159465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] MFA Rules not processed for user `ad3515f6ad9942e794a457e1febaee02`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:29.162163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:29.185909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:29.225292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.239825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.248638 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1258/2559] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:29.251502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.254237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:29.312410 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1302/2560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:29.316825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.339144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f917004-5557-4d1a-8175-4b4e8ef58366 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.348096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af908a8-bcb8-4d40-813e-d96e0e344ac9 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.352605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.353145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.353421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.353686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.357247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.358557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.358857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.359132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.359858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.363389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39c8e1-7d43-4d49-8239-918937b96ddb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.375261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.376706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.399580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1259/2561] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:29.423590 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1303/2562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:29 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:29.427627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.442744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bace5a-d6ee-4505-b572-49baae15e2d3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.636144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.637182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.637641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.637768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.638214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.638404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.638775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.639433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.651382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.672454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:29.673706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:29.719503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1260/2563] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:29 2022] POST /identity/v3/users => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:29.724475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.762146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a783b60-b1cf-4617-980a-749736106eaa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.774990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.775949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.776464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.776948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.777844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.784075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.813711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1261/2564] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:29.817789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.832090 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1304/2565] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:29.846858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd62ad1-3927-497d-94c6-0fe52e1e10ef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:29.865293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:29.865987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:29.866445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:29.866728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] PATH_INFO: `/v3/projects/180a8bbfd81d4cfcb81257ee36e60642/users/323438dcdfe64ac9a5080a0c88c8c205/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:29.901619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] RBAC: Authorizing `identity:create_grant(project_id=180a8bbfd81d4cfcb81257ee36e60642, user_id=323438dcdfe64ac9a5080a0c88c8c205, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:29.910855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:29.915635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:29.942226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1262/2566] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:29 2022] PUT /identity/v3/projects/180a8bbfd81d4cfcb81257ee36e60642/users/323438dcdfe64ac9a5080a0c88c8c205/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:29.946371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:29.962477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab83778-ec2c-4132-8aac-6d92bc57eb70 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.054936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.055556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.055852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.056401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.057151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.059073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706814-84b4-4bf8-b69c-a44a27aab3a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.078106 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1305/2567] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:30.083514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:30.109018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c57f1-e65a-46fe-bc40-7a72d89910af admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.117389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.118866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.119603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.120117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] PATH_INFO: `/v3/projects/180a8bbfd81d4cfcb81257ee36e60642/users/323438dcdfe64ac9a5080a0c88c8c205/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.123397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180a8bbfd81d4cfcb81257ee36e60642, user_id=323438dcdfe64ac9a5080a0c88c8c205, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.129511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.158027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.158247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1263/2568] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:30 2022] PUT /identity/v3/projects/180a8bbfd81d4cfcb81257ee36e60642/users/323438dcdfe64ac9a5080a0c88c8c205/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:30.158673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.158953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.190421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:30.192147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:30.202309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] MFA Rules not processed for user `323438dcdfe64ac9a5080a0c88c8c205`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:30.203647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:30.234758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:30.295558 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1306/2569] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:30.335849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55745f-a81c-4e43-9c92-67303c3b5227 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.345845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.347827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.348337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.348722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.351258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:30.436509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.438908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.471451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1264/2570] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:05:30.502282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:30.510644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:30.537602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c784-1389-4e00-90c3-fa858d3ab27a service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.556104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.556732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.557023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.557314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.587483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.596828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.624074 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1265/2571] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:30.672478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96e811-d6ce-4a0b-818d-297323e0da56 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.685806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.686853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.687137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.687461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] PATH_INFO: `/v3/users/16dfeb727c754cd0869ca992c7ef5b1e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.689360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dfeb727c754cd0869ca992c7ef5b1e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.691315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.744123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:30.748419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:30.778716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f84e8-92be-4508-80fe-351a99142487 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:30.819390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:30.821340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.821635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.821913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] PATH_INFO: `/v3/users/6ca1e616c6044c07b3985ab39407f204` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.825120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dfeb727c754cd0869ca992c7ef5b1e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.838339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca1e616c6044c07b3985ab39407f204)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:30.844369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dfeb727c754cd0869ca992c7ef5b1e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.845577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:30.846066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dfeb727c754cd0869ca992c7ef5b1e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.876930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dfeb727c754cd0869ca992c7ef5b1e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.878956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-315ab3a9-9a42-4267-aa17-f74a113a87fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dfeb727c754cd0869ca992c7ef5b1e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.900645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1307/2572] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:30 2022] DELETE /identity/v3/users/16dfeb727c754cd0869ca992c7ef5b1e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:30.909616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:30.910194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:30.910657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:30.954336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca1e616c6044c07b3985ab39407f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.954592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:30.955900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:30.957012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca1e616c6044c07b3985ab39407f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.974056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca1e616c6044c07b3985ab39407f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.976339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca1e616c6044c07b3985ab39407f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:30.985606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:30.996963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca1e616c6044c07b3985ab39407f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.001331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:31.036512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1266/2573] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:30 2022] DELETE /identity/v3/users/6ca1e616c6044c07b3985ab39407f204 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:31.056858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1308/2574] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:31.072572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.075632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.122598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.124877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.163918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765bad1-83fb-4391-b358-1f2b67505957 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:31.190610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6b326-dd48-4c19-970f-9d32df071646 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:31.201184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:31.201812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.206837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.208392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.375471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:31.377168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:31.390672 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1267/2575] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:31.396633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.399960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.426898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47357d2-772f-4ddc-bef3-37735e80370c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:31.438204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:31.439609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.440074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.441045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] PATH_INFO: `/v3/projects/c0ce650ca228469c984583f0d0ae7b20` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.441752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:31.442450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.442817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.443273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] PATH_INFO: `/v3/users/ad3515f6ad9942e794a457e1febaee02` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.445510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ce650ca228469c984583f0d0ae7b20)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:31.446166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3515f6ad9942e794a457e1febaee02)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:31.448502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:31.449370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:31.557302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ce650ca228469c984583f0d0ae7b20', 'request_id': 'req-d7d477f6-3bce-4572-b609-2a5a63c81445'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.566483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3515f6ad9942e794a457e1febaee02'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.571901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ce650ca228469c984583f0d0ae7b20', 'request_id': 'req-d7d477f6-3bce-4572-b609-2a5a63c81445'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.581974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ce650ca228469c984583f0d0ae7b20', 'request_id': 'req-d7d477f6-3bce-4572-b609-2a5a63c81445'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.588912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3515f6ad9942e794a457e1febaee02'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.589739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3515f6ad9942e794a457e1febaee02'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.603561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] The token cache is being invalidate because project c0ce650ca228469c984583f0d0ae7b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:31.603865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.604411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3515f6ad9942e794a457e1febaee02'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.605380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7d477f6-3bce-4572-b609-2a5a63c81445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.605901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35b9e87b-5503-4616-9c07-a3779c2d3125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3515f6ad9942e794a457e1febaee02'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:31.613469 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1268/2576] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:31 2022] DELETE /identity/v3/projects/c0ce650ca228469c984583f0d0ae7b20 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:31.614990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8847c-afbe-45da-bdca-e073c7ad19c8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.615651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8847c-afbe-45da-bdca-e073c7ad19c8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.615651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8847c-afbe-45da-bdca-e073c7ad19c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.650870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1309/2577] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:31 2022] DELETE /identity/v3/users/ad3515f6ad9942e794a457e1febaee02 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:31.657821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.658601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.658809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04c8847c-afbe-45da-bdca-e073c7ad19c8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:31.659079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.659928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04c8847c-afbe-45da-bdca-e073c7ad19c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.674385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:31.710427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:31.713928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.816318 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1269/2578] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:31.826357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.826736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.826989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.861541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:31.876974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:31.877696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.881596 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1310/2579] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:31.902242 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1270/2580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:31.904136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.922024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222a9a5-8889-435f-a341-7402e77aee1f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:31.943632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.945028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:31.952463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:31.953822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:31.954107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:31.954426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:31.955293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:31.955594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:31.958816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:31.982645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1311/2581] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:31.986759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:31.999839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe0bfa-8488-4b3c-bf73-94191cfe152e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.005494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.006606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.007097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.007685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.008500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.012115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.063516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1312/2582] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:31 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:32.068878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.074882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950231c6-7422-4124-982e-8a91eecdc999 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.194818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.195803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.196421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.197048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.236272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19727ae0-1842-4b30-9798-260194613d3b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.246955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.249843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.251155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.251505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.253172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.257726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.329151 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1313/2583] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:32 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:32.335083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.375064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623fa06-1329-41ac-ac60-21f1dbd84eda admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.391936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.392616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.392899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.393190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.393672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.394127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.395288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.395424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.423962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1271/2584] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:05:32.431735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1314/2585] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:05:32.432309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.451256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aeba20-6e9d-44d9-a2d3-a5a3f2d85f93 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.468319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.469304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.469304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.469688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.470456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.472672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659f01-fa10-47e8-b9b7-8b72ede76dca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.479230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:32.498780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1272/2586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:32.501389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.527386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc05f5-5716-4b00-a29d-2995913ae421 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:32.552394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:32.553973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.554447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.556147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] PATH_INFO: `/v3/projects/22a2495ec7094b82bf666a62e4ec149a/users/6621970375db482299d3d8dde8558aa9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.609470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a2495ec7094b82bf666a62e4ec149a, user_id=6621970375db482299d3d8dde8558aa9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:32.615671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:32.645479 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1315/2587] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:32 2022] PUT /identity/v3/projects/22a2495ec7094b82bf666a62e4ec149a/users/6621970375db482299d3d8dde8558aa9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:32.650753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:32.651065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:32.651354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:32.697097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:32.699678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:32.828440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.831301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:32.855942 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1273/2588] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:32.880667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:32.883179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:32.994244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6f82-e0b0-4ec8-a0bb-a11b202be969 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:33.009797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:33.010551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:33.010925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:33.011297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] PATH_INFO: `/v3/projects/7d2440a5a1224c7a9ed861701ad78722` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:33.015301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2440a5a1224c7a9ed861701ad78722)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:33.019458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:33.030813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746af6e-25da-4c5e-9ade-cabdf3ef6f16 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:33.041664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:33.042151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:33.042577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:33.042905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:33.067822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:33.069391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:33.079892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:33.102665 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1274/2589] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:05:33.174102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2440a5a1224c7a9ed861701ad78722', 'request_id': 'req-ea00af57-4b11-4149-acab-af72f24b4210'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.186745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2440a5a1224c7a9ed861701ad78722', 'request_id': 'req-ea00af57-4b11-4149-acab-af72f24b4210'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.206041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2440a5a1224c7a9ed861701ad78722', 'request_id': 'req-ea00af57-4b11-4149-acab-af72f24b4210'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.232364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] The token cache is being invalidate because project 7d2440a5a1224c7a9ed861701ad78722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:33.232804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.236347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.243870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1316/2590] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:32 2022] DELETE /identity/v3/projects/7d2440a5a1224c7a9ed861701ad78722 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:33.245353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:33.259202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f208aae-5178-4623-b08b-36083c318a7a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:33.374002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:33.374958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:33.375740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:33.376306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] PATH_INFO: `/v3/users/87ba647c6fbd49d08e102251d38a6ad8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:33.377841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ba647c6fbd49d08e102251d38a6ad8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:33.380277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:33.489504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:33.493249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ba647c6fbd49d08e102251d38a6ad8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.496415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ba647c6fbd49d08e102251d38a6ad8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.558133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ba647c6fbd49d08e102251d38a6ad8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.559662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ba647c6fbd49d08e102251d38a6ad8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.570976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ba647c6fbd49d08e102251d38a6ad8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:33.597652 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1275/2591] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:33 2022] DELETE /identity/v3/users/87ba647c6fbd49d08e102251d38a6ad8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:33.879097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:33.880711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:33.913359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00af57-4b11-4149-acab-af72f24b4210 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:33.993281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:33.995175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:34.034939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:34.036005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:34.036446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:34.037025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] PATH_INFO: `/v3/projects/9e6890b8afbe4908bf905270b9fa2efc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:34.038499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6890b8afbe4908bf905270b9fa2efc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:34.040516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:34.129211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6890b8afbe4908bf905270b9fa2efc', 'request_id': 'req-d758d348-35d0-44f2-a911-c03e9f7d09d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.159373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6890b8afbe4908bf905270b9fa2efc', 'request_id': 'req-d758d348-35d0-44f2-a911-c03e9f7d09d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.174264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e73a5-4690-4f93-8571-5d76707a7a21 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:34.193227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6890b8afbe4908bf905270b9fa2efc', 'request_id': 'req-d758d348-35d0-44f2-a911-c03e9f7d09d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.239789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] The token cache is being invalidate because project 9e6890b8afbe4908bf905270b9fa2efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:34.239789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.244609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.252212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1317/2592] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:33 2022] DELETE /identity/v3/projects/9e6890b8afbe4908bf905270b9fa2efc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:34.256831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:34.260142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:34.306031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:34.307644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:34.307921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:34.308190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] PATH_INFO: `/v3/projects/f99d7df4f1924bf9888d353f261425ee` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:34.313231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99d7df4f1924bf9888d353f261425ee)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:34.317819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:34.413476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:34.432301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99d7df4f1924bf9888d353f261425ee', 'request_id': 'req-a24514c0-4d50-4c50-9bbf-b18af49dff1d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.450234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99d7df4f1924bf9888d353f261425ee', 'request_id': 'req-a24514c0-4d50-4c50-9bbf-b18af49dff1d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.466859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99d7df4f1924bf9888d353f261425ee', 'request_id': 'req-a24514c0-4d50-4c50-9bbf-b18af49dff1d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.487492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758d348-35d0-44f2-a911-c03e9f7d09d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:34.502750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:34.515231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] The token cache is being invalidate because project f99d7df4f1924bf9888d353f261425ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:34.516064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.521904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a24514c0-4d50-4c50-9bbf-b18af49dff1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.526738 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1276/2593] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:33 2022] DELETE /identity/v3/projects/f99d7df4f1924bf9888d353f261425ee => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:34.531788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b09c0-d6de-412e-8d99-4036882d1c94 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:34.532182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b09c0-d6de-412e-8d99-4036882d1c94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:34.532586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b09c0-d6de-412e-8d99-4036882d1c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:34.614133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:34.614827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:34.615100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:34.615370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] PATH_INFO: `/v3/users/323438dcdfe64ac9a5080a0c88c8c205` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:34.617078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323438dcdfe64ac9a5080a0c88c8c205)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:34.617880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c63b09c0-d6de-412e-8d99-4036882d1c94 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:34.620318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:34.625581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c63b09c0-d6de-412e-8d99-4036882d1c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:34.677978 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1277/2594] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:05:34.689197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:34.691974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:34.692328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:34.755024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323438dcdfe64ac9a5080a0c88c8c205'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.781062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323438dcdfe64ac9a5080a0c88c8c205'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.781635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323438dcdfe64ac9a5080a0c88c8c205'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.787938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:34.795284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:34.803386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323438dcdfe64ac9a5080a0c88c8c205'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.804233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323438dcdfe64ac9a5080a0c88c8c205'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:34.833713 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1278/2595] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:34.836678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:34.852808 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1318/2596] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:05:34 2022] DELETE /identity/v3/users/323438dcdfe64ac9a5080a0c88c8c205 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:05:34.861941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e523eb-fb4d-43ce-9a00-90889a83f998 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.036505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.037088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.037371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.037645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.038299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:35.038602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.040231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.054483 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1279/2597] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:35.059075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.073606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73bf83-ff74-4939-bb29-aa2ba6b892a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.079961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.080312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.080590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.080855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.081519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.083637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.133764 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1319/2598] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:35.139156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.158338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7748fd8-1070-4194-a375-a11b0a98af4e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.284965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.285886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.286336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.287216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.287216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.289497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.348325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1280/2599] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:35 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:35.352126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.367726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f4659-a4e7-4ce2-acc4-bc4e9e31d868 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.380795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.381573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.381948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.382313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.383066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.384764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.410966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1320/2600] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:35.412189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.426505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670fbc-789b-482f-9867-0c221e0580b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.442007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.443160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.443622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.443961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.444739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.446555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b860b2-c257-4748-b465-c4b21be73833 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.472933 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1281/2601] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:35.474391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.488625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad171-130b-4f85-a12b-ef2f7a596e7e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.495484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.496311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.497573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.499790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] PATH_INFO: `/v3/projects/56913dc5924a4386a70e4144edbb7164/users/e61189c62d294b64804e6ef43c1a4d2c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.529718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56913dc5924a4386a70e4144edbb7164, user_id=e61189c62d294b64804e6ef43c1a4d2c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.537884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.572652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1321/2602] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:35 2022] PUT /identity/v3/projects/56913dc5924a4386a70e4144edbb7164/users/e61189c62d294b64804e6ef43c1a4d2c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:05:35.575709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.576134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.579240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.634404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:35.640127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:35.753843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:35.770259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1282/2603] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:35.807617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:35.809651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:35.817899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:35.915646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc36300-1b51-4578-b147-314c37e66846 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:35.920150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:35.920980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:35.921386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:35.921755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:35.945450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:35.947208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4056682-809c-4519-82fe-7671046a7dd7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:35.962588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1322/2604] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:36.332629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:36.334272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:36.399571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648b68d-edcb-4a1d-91da-b6d108eb69af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:36.431826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:36.433728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:36.438796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:36.439260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] PATH_INFO: `/v3/projects/180a8bbfd81d4cfcb81257ee36e60642` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:36.441229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180a8bbfd81d4cfcb81257ee36e60642)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:36.451837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:36.548879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180a8bbfd81d4cfcb81257ee36e60642', 'request_id': 'req-da20e33f-1fe1-4448-9ae0-4468b13445d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:36.564338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180a8bbfd81d4cfcb81257ee36e60642', 'request_id': 'req-da20e33f-1fe1-4448-9ae0-4468b13445d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:36.572020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180a8bbfd81d4cfcb81257ee36e60642', 'request_id': 'req-da20e33f-1fe1-4448-9ae0-4468b13445d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:36.604261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] The token cache is being invalidate because project 180a8bbfd81d4cfcb81257ee36e60642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:05:36.605206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:36.617894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da20e33f-1fe1-4448-9ae0-4468b13445d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:05:36.619845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1283/2605] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:05:36 2022] DELETE /identity/v3/projects/180a8bbfd81d4cfcb81257ee36e60642 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:36.625242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:36.625842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:36.625842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:36.665452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:36.666873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:36.827166 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1323/2606] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:36.836099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:36.836454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:36.838180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:36.875747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:36.877215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:36.891921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1284/2607] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:36.893213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:36.907310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339455c0-e89e-4631-bb00-eeefa652d729 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:36.920122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:36.920755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:36.921051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:36.921318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:36.921979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:05:36.922274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:36.923886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:36.964148 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1324/2608] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:05:36.970387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:36.988222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c765b4e-b3db-47ea-af55-6f3fc05310df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:36.994351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:36.995345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:36.995731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:36.996100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:36.996979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:36.999218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.051061 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1285/2609] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:36 2022] POST /identity/v3/projects => generated 403 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:37.052002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:37.072530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2d949-defe-4a8c-99bf-b56437b3682f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:37.199491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:37.200165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.200477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.200747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.201412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:37.203548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.247401 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1325/2610] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:37 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:37.252285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:37.269379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a29d8-aec8-4f69-a221-bcd45f5e5440 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:37.281460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:37.282300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.282678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.283076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.284714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:37.288738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.329357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:37.330060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1286/2611] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:37.347988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb66b-36ac-4421-a0e3-ee4c67aa86ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:37.356197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:37.357532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.357747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.358091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.359006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:37.361192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5079-ea15-4400-a820-5e72a1667010 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.390102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1326/2612] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:37.395867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:37.413844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facb5ef-c0b7-4f41-9293-46a09e9d8214 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:37.429061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:37.429958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.430334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.430705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] PATH_INFO: `/v3/projects/6a60be2e0a15434fa200eed8d2034213/users/9dca2538fa1f4c2fa15d2e42aee002ce/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.476315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a60be2e0a15434fa200eed8d2034213, user_id=9dca2538fa1f4c2fa15d2e42aee002ce, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:37.479174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.514588 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1287/2613] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:37 2022] PUT /identity/v3/projects/6a60be2e0a15434fa200eed8d2034213/users/9dca2538fa1f4c2fa15d2e42aee002ce/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:37.516313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.516597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.516870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.548109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:37.549509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:37.560497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:37.665042 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1327/2614] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:37.700751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:37.702826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:37.822414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2fa9-3dc1-4f76-8bbc-80dda7dc6423 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:37.832364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:37.833183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:37.833463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:37.833736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:37.851170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:37.852621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de5844-e0c0-4cc0-86c2-af351198e698 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:37.879977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1288/2615] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:41.791524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:41.810118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6d189-fc95-4ce2-990e-7b3518490dea None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:41.817824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:41.819478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:41.820083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:41.820651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:41.827819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:42.044322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:42.047501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:42.092261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1328/2616] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:43.571280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:43.571666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:43.571666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:43.661612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] MFA Rules not processed for user `e46ff953364048d392e5adcdade2b256`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:43.662864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:43.688787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:43.855731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1289/2617] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:43.864295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:43.866379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:43.891758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fefb1-4235-4198-b9d0-efe9d0a55a21 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:43.913384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:43.914024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:43.914304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:43.914574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:43.938303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:43.940788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221bd18-229f-426c-a118-6526bc025bd7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:44.007012 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1329/2618] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:46.520438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:46.522175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:46.554201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b9cf9-e162-4310-99eb-889fce46b78c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:46.567317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:46.572064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:46.572659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:46.573072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:46.577996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:46.623590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:46.626001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454760e-d3c0-44e9-a5d8-445dbb632dd8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:46.652311 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1290/2619] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:48.977634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:48.978248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:48.978453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:49.094052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] MFA Rules not processed for user `6621970375db482299d3d8dde8558aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:49.095335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:49.275012 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1330/2620] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:49.292648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378613-4cbb-4862-b621-b81136586d18 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:49.293890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378613-4cbb-4862-b621-b81136586d18 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:49.293890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a378613-4cbb-4862-b621-b81136586d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:49.316893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a378613-4cbb-4862-b621-b81136586d18 None None] MFA Rules not processed for user `6621970375db482299d3d8dde8558aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:49.318690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a378613-4cbb-4862-b621-b81136586d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:49.338585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1291/2621] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:49.342483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:49.370034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf16a47-9349-4396-a03a-9a1158113e38 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:49.380011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:49.381482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:49.381977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:49.382803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:49.399859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:49.401958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3038c-e61d-4882-a144-ed21ccc677ab service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:49.414192 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1331/2622] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:49.899187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:49.899473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:49.900012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:49.943748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] MFA Rules not processed for user `e46ff953364048d392e5adcdade2b256`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:49.949756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:49.971399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1292/2623] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:50.794705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:50.795257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:50.795257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:50.807036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:50.850668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:50.852117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:50.885225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] MFA Rules not processed for user `e61189c62d294b64804e6ef43c1a4d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:50.886455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:51.020229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0774e6-f02e-4f51-8453-059532c9a9f0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:51.027187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:51.028602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:51.028974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:51.029360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:51.036390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:51.060048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:51.061911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:51.075658 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1332/2624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:51.101097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1293/2625] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:05:51.205446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:51.234520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ded34b-3e33-4e4b-9cfd-a6792debcbce None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:51.247593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:51.248806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:51.249352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:51.249881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:51.263619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:51.282504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb90d8-97ee-4414-8b67-c13e7fc934a9 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:51.302905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:51.305988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1333/2626] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:05:51.318217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dac5b-d9db-4b2d-b400-56d2dc559f78 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:51.331428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:51.332136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:51.332524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:51.332902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:51.346014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:51.368543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:51.379887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:51.403009 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1294/2627] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:05:52.932212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746ba0-d891-46f2-8929-46c8873f0cb9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:52.933192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746ba0-d891-46f2-8929-46c8873f0cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:52.933739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746ba0-d891-46f2-8929-46c8873f0cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:53.010989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c3746ba0-d891-46f2-8929-46c8873f0cb9 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:53.015995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3746ba0-d891-46f2-8929-46c8873f0cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:53.176801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1334/2628] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:05:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:53.191316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:53.193644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:53.396239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:53.410566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9982-096d-4e0f-8a89-7ca72437faf3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:53.435458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:53.436763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:53.438355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:53.439311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:53.468858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:53.474151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:53.502333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1295/2629] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:05:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:05:56.927299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:56.928925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:56.929494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:56.992028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] MFA Rules not processed for user `9dca2538fa1f4c2fa15d2e42aee002ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:05:56.995332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:05:57.160497 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1335/2630] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:05:57.165323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.186169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b36a6-6555-427a-b971-cdb9553151f4 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.202427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.203600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.204206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.204725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.208964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.211846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:57.288149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.297800 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1296/2631] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:05:57 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:05:57.313243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec06479-a814-4753-b47c-403c844036b3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.341204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:05:57.442649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.443273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.443545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.443807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.444620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.446704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:57.488561 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1336/2632] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:05:57 2022] POST /identity/v3/users => generated 308 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:05:57.492873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.513650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ef716-9fba-48f1-a5ae-2532ec7a7ca3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.526094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.527664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.527951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.528225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.530886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.534251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:57.568890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1297/2633] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:05:57.573399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.595705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2236a84-5766-40d4-a853-a771abf76a9c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.600818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.601561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.601938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.602311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] PATH_INFO: `/v3/projects/aeb9244e721d45f683f3206e657a0a05/users/2c76746353654d6a854a90fdfc0e0fd0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.638028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb9244e721d45f683f3206e657a0a05, user_id=2c76746353654d6a854a90fdfc0e0fd0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.641925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:57.678731 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1337/2634] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:57 2022] PUT /identity/v3/projects/aeb9244e721d45f683f3206e657a0a05/users/2c76746353654d6a854a90fdfc0e0fd0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:05:57.682981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.700225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dce6f-af18-409e-bf91-c8697047884c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.863713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.864222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.864496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.864769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.865436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.867048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:57.897768 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1298/2635] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:05:57.900439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:05:57.925142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977dd2e-e426-4fd6-9384-54e529fa89a8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:05:57.941277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:05:57.941966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:05:57.945372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:05:57.945860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] PATH_INFO: `/v3/projects/aeb9244e721d45f683f3206e657a0a05/users/2c76746353654d6a854a90fdfc0e0fd0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:05:57.954093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb9244e721d45f683f3206e657a0a05, user_id=2c76746353654d6a854a90fdfc0e0fd0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:05:57.972634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e11a0-8e8d-4477-9622-50813d943d1b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:05:58.012353 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1338/2636] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:05:57 2022] PUT /identity/v3/projects/aeb9244e721d45f683f3206e657a0a05/users/2c76746353654d6a854a90fdfc0e0fd0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:00.634344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:00.818162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7747-20f0-4839-9c31-3567bed98afd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:00.945718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:00.947609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:00.947945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:00.948221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:00.954250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:00.978020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:00.979748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:01.006443 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1299/2637] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:04.731831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:04.732394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:04.732394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:04.763209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:04.765391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:04.858758 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1339/2638] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:04.868079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:04.881687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:04.961618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c3af2-ef33-4c46-9ca6-887c76d73bfc service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:04.987286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:04.988147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:04.988587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:04.989032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:05.009711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:05.016019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:05.037964 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1300/2639] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:05.188670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:05.191149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:05.399736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a31ee-9682-44b4-8a85-3294f871deb2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:05.408534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:05.410097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:05.410532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:05.410957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:05.413507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:05.427550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:05.438281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:05.440893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6ba7f-522f-49f9-939e-3f4d1c156fa5 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:05.487601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1340/2640] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:06.517637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:06.544074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21d85d-0c69-4d2f-9af5-0a0531b7410d service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:06.578818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:06.581758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:06.585215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:06.586572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:06.594660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:06.661764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:06.664717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:06.685916 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1301/2641] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:15.457079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:15.996720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:15.997051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:15.997320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:16.068971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] MFA Rules not processed for user `2c76746353654d6a854a90fdfc0e0fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:16.070765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:16.249988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1341/2642] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:16.678515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=33 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:21.008409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:21.045876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b896e-7156-4c55-b2c9-49839fc7e3cc service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:21.082500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:21.083124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:21.083405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:21.083676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:21.089872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:21.157148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:21.159507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:21.204240 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1302/2643] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:25.504661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:25.518743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae1858-bde0-417a-9790-0bcaee58d554 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:25.546122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:25.557502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:25.560298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:25.560815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:25.564494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:25.751712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:25.753415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:25.800473 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1342/2644] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:27.841336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:27.842965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:27.865619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba0bb-805a-4885-aa8a-2bc96e557043 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:27.877993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:27.879028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:27.880875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:27.881571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] PATH_INFO: `/v3/users/40da67f39f4d4a6fb25ea033b0f14071` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:27.890090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] RBAC: Authorizing `identity:delete_user(user_id=40da67f39f4d4a6fb25ea033b0f14071)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:27.895458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:28.001850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40da67f39f4d4a6fb25ea033b0f14071'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:28.003269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40da67f39f4d4a6fb25ea033b0f14071'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:28.042607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40da67f39f4d4a6fb25ea033b0f14071'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:28.045061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40da67f39f4d4a6fb25ea033b0f14071'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:28.062303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40da67f39f4d4a6fb25ea033b0f14071'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:28.111336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1303/2645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:27 2022] DELETE /identity/v3/users/40da67f39f4d4a6fb25ea033b0f14071 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:29.325499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:29.365902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbddb9b-7e3b-4817-8e3c-c630f9d9fdd5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:29.537982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:29.538719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:29.539000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:29.539271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] PATH_INFO: `/v3/projects/eb88ccffb014497b801541b53d8bb505` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:29.542674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb88ccffb014497b801541b53d8bb505)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:29.545537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:29.582962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:29.618135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb88ccffb014497b801541b53d8bb505', 'request_id': 'req-5550e224-cc49-4a98-84ac-17aee6aae10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:29.629179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb88ccffb014497b801541b53d8bb505', 'request_id': 'req-5550e224-cc49-4a98-84ac-17aee6aae10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:29.657434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb88ccffb014497b801541b53d8bb505', 'request_id': 'req-5550e224-cc49-4a98-84ac-17aee6aae10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:29.689466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] The token cache is being invalidate because project eb88ccffb014497b801541b53d8bb505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:06:29.689969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:29.692531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:29.702376 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1343/2646] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:29 2022] DELETE /identity/v3/projects/eb88ccffb014497b801541b53d8bb505 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:29.702907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:29.704917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:29.726281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f016d-db1a-42a7-bd99-1ff434c001db admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:29.852773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:29.853491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:29.853771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:29.854079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] PATH_INFO: `/v3/users/7cb6894f296242c1ad06b65570ad8f99` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:29.855888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb6894f296242c1ad06b65570ad8f99)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:29.857873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:30.056584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb6894f296242c1ad06b65570ad8f99'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:30.058032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb6894f296242c1ad06b65570ad8f99'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:30.077939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb6894f296242c1ad06b65570ad8f99'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:30.078714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb6894f296242c1ad06b65570ad8f99'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:30.083289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:30.093118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3365c929-34f1-4ac8-9f57-582b7b121564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb6894f296242c1ad06b65570ad8f99'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:30.122465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1304/2647] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:29 2022] DELETE /identity/v3/users/7cb6894f296242c1ad06b65570ad8f99 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:06:30.718288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:30.725179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:30.754059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e224-cc49-4a98-84ac-17aee6aae10f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:30.982962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:30.984187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:30.984609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:30.985133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] PATH_INFO: `/v3/projects/acc1f2e701884cafbe211c1ecc965f79` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:30.987347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc1f2e701884cafbe211c1ecc965f79)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:30.989564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:31.103003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc1f2e701884cafbe211c1ecc965f79', 'request_id': 'req-21ab72fd-84b0-4a06-8d97-6a9637422a7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:31.116932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc1f2e701884cafbe211c1ecc965f79', 'request_id': 'req-21ab72fd-84b0-4a06-8d97-6a9637422a7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:31.142478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc1f2e701884cafbe211c1ecc965f79', 'request_id': 'req-21ab72fd-84b0-4a06-8d97-6a9637422a7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:31.171234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] The token cache is being invalidate because project acc1f2e701884cafbe211c1ecc965f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:06:31.171980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:31.174775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-21ab72fd-84b0-4a06-8d97-6a9637422a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:31.180862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1344/2648] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:30 2022] DELETE /identity/v3/projects/acc1f2e701884cafbe211c1ecc965f79 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:31.185298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.186164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.186773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.230919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:31.230919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:31.335601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1305/2649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:31.344430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.345320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.345854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.379635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:31.381185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:31.397291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1345/2650] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:06:31.399460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:31.423242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec78ef-e897-4d53-8573-5827c258b43d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:31.429614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:31.441321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.442478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.443211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.445293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:06:31.445895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:31.448316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:31.465316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1306/2651] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:06:31.469935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:31.482582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23fe89-eeb5-4eb7-8dfe-ed05cc50b681 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:31.488668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:31.489760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.490592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.491900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.492948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:31.497300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:31.549252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1346/2652] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:06:31 2022] POST /identity/v3/projects => generated 411 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:31.550634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:31.566151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dfb47-e909-4f8f-aff0-3c4b31a77f8a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:31.706899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:31.709345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.709629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.709908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.710624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:31.716863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:31.797220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1307/2653] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:06:31 2022] POST /identity/v3/users => generated 306 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:31.800886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:31.834523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1251-bfb1-464a-8cf6-3e942034b560 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:31.853271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:31.853709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.854019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.854558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.855277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:31.856911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:31.877682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:31.898005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:31.909518 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1347/2654] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:31.913057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc581f-b3b1-4692-9a1f-9c419e70b552 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:31.941812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:31.942973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:31.943516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:31.944226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:31.945346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:31.947302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ff8cc-7d16-4bdf-867b-2ecc6976cada admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:32.023380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1308/2655] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:32.023660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:32.082963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdc1c1-f300-4587-b74c-afb0f0176498 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:32.104537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:32.106567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:32.107002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:32.107377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] PATH_INFO: `/v3/projects/1c415760996a4973a0e827f3da988200/users/65e262effe18496cbc3541d8b7ceedd7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:32.142912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c415760996a4973a0e827f3da988200, user_id=65e262effe18496cbc3541d8b7ceedd7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:32.145815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:32.177797 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1348/2656] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:06:32 2022] PUT /identity/v3/projects/1c415760996a4973a0e827f3da988200/users/65e262effe18496cbc3541d8b7ceedd7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:32.179028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240812-2c2a-49c4-b0e4-9fab5c962ad0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:32.179524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240812-2c2a-49c4-b0e4-9fab5c962ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:32.179906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240812-2c2a-49c4-b0e4-9fab5c962ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:32.222644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ba240812-2c2a-49c4-b0e4-9fab5c962ad0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:32.226760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba240812-2c2a-49c4-b0e4-9fab5c962ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:32.314048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:32.361956 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1309/2657] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:06:32.378685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:32.380745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:32.502038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1970-2aa5-491f-82c8-1eb3bf0eb8d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:32.517939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:32.518565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:32.518841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:32.519113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:32.563470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:32.566411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:32.592202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1349/2658] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:33.249455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:33.249992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:33.249992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:33.278379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:33.279773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:33.415234 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1310/2659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:33.880701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:33.884064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:33.903676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e6f61-7855-4d99-933a-be27a20f0b9f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:33.908801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:33.909781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:33.910077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:33.910408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:33.912695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:33.928598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:33.931396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c352-b60e-4458-85e6-ee00b6ee1d58 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:33.961726 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1350/2660] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:38.335373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:38.337310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:38.385167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5baf0-907f-491e-a86c-3e1996153abe None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:38.408258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:38.409552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:38.409839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:38.410108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] PATH_INFO: `/v3/users/e61189c62d294b64804e6ef43c1a4d2c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:38.417669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61189c62d294b64804e6ef43c1a4d2c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:38.425955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:38.545881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:38.546365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:38.546481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:38.584403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61189c62d294b64804e6ef43c1a4d2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:38.585840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61189c62d294b64804e6ef43c1a4d2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:38.586849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:38.590081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:38.605322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61189c62d294b64804e6ef43c1a4d2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:38.606357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61189c62d294b64804e6ef43c1a4d2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:38.617618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61189c62d294b64804e6ef43c1a4d2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:38.668266 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1311/2661] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:38 2022] DELETE /identity/v3/users/e61189c62d294b64804e6ef43c1a4d2c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:38.751472 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1351/2662] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:06:38.775228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:38.777978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:39.034611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:39.052283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8043-64cb-43e6-914f-8762a556d479 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:39.065710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:39.066357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:39.066693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:39.066968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:39.173309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:39.177085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:39.194013 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1312/2663] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:40.353470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:40.356781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:40.419835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de4ce-fedd-4b5d-a200-1c9be2541879 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:40.478134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:40.481836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:40.722604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:40.723425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:40.723738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:40.724100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] PATH_INFO: `/v3/projects/56913dc5924a4386a70e4144edbb7164` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:40.727214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56913dc5924a4386a70e4144edbb7164)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:40.734186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:40.770670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:40.790471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559add18-c38c-46a1-9517-9951b8547e71 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:40.814917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:40.815574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:40.815848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:40.816117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] PATH_INFO: `/v3/users/9dca2538fa1f4c2fa15d2e42aee002ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:40.818118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dca2538fa1f4c2fa15d2e42aee002ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:40.827862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:40.926652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56913dc5924a4386a70e4144edbb7164', 'request_id': 'req-481351df-9487-4f45-ade4-21eb8779ca63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:40.940730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56913dc5924a4386a70e4144edbb7164', 'request_id': 'req-481351df-9487-4f45-ade4-21eb8779ca63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:40.958884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56913dc5924a4386a70e4144edbb7164', 'request_id': 'req-481351df-9487-4f45-ade4-21eb8779ca63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:40.989439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] The token cache is being invalidate because project 56913dc5924a4386a70e4144edbb7164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:06:40.989850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:40.990946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-481351df-9487-4f45-ade4-21eb8779ca63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:40.995113 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1352/2664] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:40 2022] DELETE /identity/v3/projects/56913dc5924a4386a70e4144edbb7164 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:41.002781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:41.003173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:41.005183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:41.022019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dca2538fa1f4c2fa15d2e42aee002ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:41.023462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dca2538fa1f4c2fa15d2e42aee002ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:41.053991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dca2538fa1f4c2fa15d2e42aee002ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:41.057849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:41.060249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dca2538fa1f4c2fa15d2e42aee002ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:41.061163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:41.080599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-743f3153-cdcd-48bf-acd1-6315044b003b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dca2538fa1f4c2fa15d2e42aee002ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:41.167693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1313/2665] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:40 2022] DELETE /identity/v3/users/9dca2538fa1f4c2fa15d2e42aee002ce => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:41.274013 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1353/2666] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:41.286310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:41.286595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:41.286884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:41.378117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:41.379422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:41.512351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:41.667938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:41.669492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1314/2667] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:41.692051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdc449-0f6c-4d71-ba7f-d5ec0485332f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:41.720326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:41.720956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:41.721272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:41.721550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:41.722214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:06:41.722515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:41.727260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:41.762435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1354/2668] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:06:41.768122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:41.797865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2634-5796-473f-ab17-36eb0777f479 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:41.811560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:41.812221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:41.812707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:41.813085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:41.814239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:41.817719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:41.908962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1315/2669] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:06:41 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:41.913865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:41.926931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8699-4738-4c6f-9bcb-62f099e50e45 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:41.981250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:41.983268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:42.159887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.164062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.164830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.167570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.168341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.170300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.223365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798923-805a-497d-bcd6-755ab72bebb9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:42.240277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.244027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.246766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.247048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] PATH_INFO: `/v3/projects/6a60be2e0a15434fa200eed8d2034213` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.250328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a60be2e0a15434fa200eed8d2034213)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.250477 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1355/2670] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:06:41 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:42.257872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.258434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:42.293922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53295-1f42-456e-845c-671764c1a6b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:42.311589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.311786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.312359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.313624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.316618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.340766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.382552 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1356/2671] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:42.391498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:42.419810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a60be2e0a15434fa200eed8d2034213', 'request_id': 'req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:42.440248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a60be2e0a15434fa200eed8d2034213', 'request_id': 'req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:42.451011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6e6f2-ccef-4a9c-8aca-a9642db725af admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:42.460832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a60be2e0a15434fa200eed8d2034213', 'request_id': 'req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:42.486571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:42.491268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] The token cache is being invalidate because project 6a60be2e0a15434fa200eed8d2034213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:06:42.491688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:42.493208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:42.502804 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1316/2672] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:41 2022] DELETE /identity/v3/projects/6a60be2e0a15434fa200eed8d2034213 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:42.504128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:42.505728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:42.592558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:42.676665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.677447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.677824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.678195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.679295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.683711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.709790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1357/2673] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:42.714990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:42.717237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:42.734999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1a46-9003-4389-902b-c3877af67f1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:42.741438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.742194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.742535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.742948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] PATH_INFO: `/v3/projects/11cf155786464a64826aadc055af9032/users/04fd432bad6740efad5a96720455b658/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.754554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe918d-0d3d-42de-87c0-2ca0456ff5f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:42.767714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11cf155786464a64826aadc055af9032, user_id=04fd432bad6740efad5a96720455b658, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.771455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2069652-f2a5-42bc-9ede-e5acf4f7aad8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.779971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:42.784600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.784857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.786162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] PATH_INFO: `/v3/users/2c76746353654d6a854a90fdfc0e0fd0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.798220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c76746353654d6a854a90fdfc0e0fd0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:42.807221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:42.837788 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1358/2674] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:06:42 2022] PUT /identity/v3/projects/11cf155786464a64826aadc055af9032/users/04fd432bad6740efad5a96720455b658/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:42.839371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:42.839725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:42.840067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:42.973998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] MFA Rules not processed for user `04fd432bad6740efad5a96720455b658`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:42.977853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:43.003752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c76746353654d6a854a90fdfc0e0fd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:43.007086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c76746353654d6a854a90fdfc0e0fd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:43.030329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c76746353654d6a854a90fdfc0e0fd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:43.033255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c76746353654d6a854a90fdfc0e0fd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:43.051701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c76746353654d6a854a90fdfc0e0fd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:43.114450 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1317/2675] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:42 2022] DELETE /identity/v3/users/2c76746353654d6a854a90fdfc0e0fd0 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:06:43.158463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1359/2676] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:43.178555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:43.181529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:43.366852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4749-cba9-4a20-a06f-0eeed6a5fb9c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:43.387904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:43.389880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:43.391393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:43.392779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:43.579801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:43.581804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa549-9050-47af-8613-71788dce7321 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:43.584678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:43.587043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:43.595316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1318/2677] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:43.806437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3f38-8e2d-4c94-9db0-389552bfa51c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:43.833651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.005625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:44.006655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.007224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.007819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] PATH_INFO: `/v3/projects/aeb9244e721d45f683f3206e657a0a05` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.009355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb9244e721d45f683f3206e657a0a05)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:44.011870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:44.136811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb9244e721d45f683f3206e657a0a05', 'request_id': 'req-62842b15-ffeb-4831-843b-2bb2b108a5e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:44.154538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb9244e721d45f683f3206e657a0a05', 'request_id': 'req-62842b15-ffeb-4831-843b-2bb2b108a5e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:44.174432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb9244e721d45f683f3206e657a0a05', 'request_id': 'req-62842b15-ffeb-4831-843b-2bb2b108a5e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:44.206742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] The token cache is being invalidate because project aeb9244e721d45f683f3206e657a0a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:06:44.207036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:44.212152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62842b15-ffeb-4831-843b-2bb2b108a5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:06:44.220880 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1360/2678] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:06:43 2022] DELETE /identity/v3/projects/aeb9244e721d45f683f3206e657a0a05 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:44.226562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.226775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.227255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.246679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:44.289652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:44.292402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:44.411531 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1319/2679] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:44.413190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.413478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.413760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.452385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:44.453410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:44.469043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1361/2680] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:44.470960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:44.489070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5783a-f5e0-45c0-b841-caad8ae15271 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:44.495705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:44.496591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.497038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.497385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.498137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:06:44.498566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:44.500655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:44.541862 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1320/2681] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:06:44.543445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:44.558607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e480-d971-40d3-9070-60b05a8218b6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:44.567960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:44.568815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.569234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.569619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.570356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:44.573926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7506-c7e1-4cd8-b27f-59bbe2cf496c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:44.643287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:44.644119 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1362/2682] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:06:44 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:44.671528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3439-8de6-4be0-b111-bcd8a0cc19b2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:44.897306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:44.898229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.898557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.899025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.899631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:44.915281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:44.976922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:44.977558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:44.977747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:44.989190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1321/2683] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:06:44 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:44.991081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:45.019950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:45.025717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb57c-6d43-4117-a197-af4c89fd49cc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:45.027267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:45.047163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:45.047945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.048322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.048566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.049304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:45.050921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:45.063807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1322/2684] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:45.069802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:45.116013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73d89-f9ab-4320-831c-b22ce58f194f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:45.143447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:45.144427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.145303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.145926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.148015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:45.149645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:45.172007 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1323/2685] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:45.188537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:45.201264 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1363/2686] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:06:45.216860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc39fd-bb48-4b43-a573-3d9be7d27b65 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:45.223237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:45.224210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.224602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.224955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] PATH_INFO: `/v3/projects/a0d47fbb4e9040039f2ae5153fe6bbbe/users/e5a251b917b244a3b1f55bf9079ff5ef/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.241781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:45.243354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:45.270107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d47fbb4e9040039f2ae5153fe6bbbe, user_id=e5a251b917b244a3b1f55bf9079ff5ef, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:45.280865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d59d-74c4-4e74-b82c-a1396451c6a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:45.302400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:45.321064 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1324/2687] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:06:45 2022] PUT /identity/v3/projects/a0d47fbb4e9040039f2ae5153fe6bbbe/users/e5a251b917b244a3b1f55bf9079ff5ef/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:45.332737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.333300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.333904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.412798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:45.416737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:45.463649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416ba7f-a0e4-4d94-8441-eeff8c71cedc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:45.515149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:45.606653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:45.610525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.610786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.611061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.644297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1325/2688] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:06:45.645925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:45.813447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:45.815038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:45.851073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566eeed0-64ec-434b-843c-81989870eb05 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:45.877130 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1364/2689] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:06:45.886828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:45.889963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:45.890191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:45.890488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:45.895407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:45.904001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:46.038195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1326/2690] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:06:45 2022] POST /identity/v3/projects => generated 383 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:46.042928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:46.061825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e509158-eca2-4442-b1a6-e10baaf74161 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:46.349843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:46.350508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:46.350746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:46.351015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:46.351657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:46.366118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:46.401819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:46.429160 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1365/2691] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:06:46 2022] POST /identity/v3/users => generated 298 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:06:46.429970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:46.460226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75340365-b8cc-474e-a271-639cf6e4312a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:46.499138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:46.501965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:46.502343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:46.503620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:46.505744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:46.512373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:46.608144 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1327/2692] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:06:46.612909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:46.635634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f575fd3-06a0-49be-97a4-cead98e9555f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:46.667277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:46.669997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:46.670278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:46.670547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] PATH_INFO: `/v3/projects/7082eecafe9f4fcea4322326db1c6c5e/users/d22baa0244de4755be177e8435b766a8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:46.748520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7082eecafe9f4fcea4322326db1c6c5e, user_id=d22baa0244de4755be177e8435b766a8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:46.786939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:46.838761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1366/2693] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:06:46 2022] PUT /identity/v3/projects/7082eecafe9f4fcea4322326db1c6c5e/users/d22baa0244de4755be177e8435b766a8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:46.843161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:46.880580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2d82-e019-4c1d-b1be-bb85e0e13970 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:47.129396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:47.133542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:47.134115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:47.135201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:47.137781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:47.140495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bc7f6-821c-41dc-ae52-68cafd1998ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:47.170632 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1328/2694] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:06:47.175522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:47.199477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e618-96f7-4368-b7ad-4e80a269f1e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:47.215860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:47.219848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:47.220132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:47.221659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] PATH_INFO: `/v3/projects/7082eecafe9f4fcea4322326db1c6c5e/users/d22baa0244de4755be177e8435b766a8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:47.261889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7082eecafe9f4fcea4322326db1c6c5e, user_id=d22baa0244de4755be177e8435b766a8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:47.284203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc8c4f-af2d-419d-8ae2-11325264b6e0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:47.333344 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1367/2695] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:06:47 2022] PUT /identity/v3/projects/7082eecafe9f4fcea4322326db1c6c5e/users/d22baa0244de4755be177e8435b766a8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:06:47.346714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:47.347187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:47.347540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:47.444049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] MFA Rules not processed for user `d22baa0244de4755be177e8435b766a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:47.451554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:47.596141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:47.761802 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1329/2696] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:47.776743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287c13-1d2e-4386-9d1c-5c97b2ece19d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:47.777099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287c13-1d2e-4386-9d1c-5c97b2ece19d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:47.777435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287c13-1d2e-4386-9d1c-5c97b2ece19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:47.814371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5f287c13-1d2e-4386-9d1c-5c97b2ece19d None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:47.816143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f287c13-1d2e-4386-9d1c-5c97b2ece19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:47.951534 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1368/2697] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:47.962582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:47.964688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:48.161703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faa295-93a4-4a92-9bc3-4d82cc0d1b9a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:48.174175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:48.174741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:48.175006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:48.175270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:48.200277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:48.203109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:48.231565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1330/2698] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:48.319225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b1aa-a79b-4003-bf03-03b10078bd7b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:48.319782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b1aa-a79b-4003-bf03-03b10078bd7b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:48.319898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b1aa-a79b-4003-bf03-03b10078bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:48.366340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e8d0b1aa-a79b-4003-bf03-03b10078bd7b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:48.368237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8d0b1aa-a79b-4003-bf03-03b10078bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:48.586655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1369/2699] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:48.594639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:48.791583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a7192-1484-45de-af07-721f2e1f2eac service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:48.822839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:48.823858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:48.824085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:48.824359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:48.854512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:48.856168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e04e3-0982-48c8-82bc-de07a83b6e2f service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:48.896270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1331/2700] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:50.711715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:50.712697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:50.713195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:50.770242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] MFA Rules not processed for user `65e262effe18496cbc3541d8b7ceedd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:50.778212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:51.038974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:51.071886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a73f-6311-432f-95b5-1a4f7fcb17e6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:51.072464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a73f-6311-432f-95b5-1a4f7fcb17e6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:51.072571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80a73f-6311-432f-95b5-1a4f7fcb17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:51.078062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1370/2701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:51.142286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6b80a73f-6311-432f-95b5-1a4f7fcb17e6 None None] MFA Rules not processed for user `65e262effe18496cbc3541d8b7ceedd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:51.148411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6b80a73f-6311-432f-95b5-1a4f7fcb17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:51.176103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1332/2702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:51 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 16:06:51.615369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:51.617135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:51.655158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe81712-9115-4a67-838c-be1c2103c812 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:51.674275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:51.674544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:51.674652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:51.674921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:51.683626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:51.685290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:51.725023 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1371/2703] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:53.226598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425753-d030-4315-89c1-ce0926cffb9a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:53.227867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425753-d030-4315-89c1-ce0926cffb9a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:53.229622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425753-d030-4315-89c1-ce0926cffb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:53.258785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-50425753-d030-4315-89c1-ce0926cffb9a None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:53.261792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-50425753-d030-4315-89c1-ce0926cffb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:53.280011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1333/2704] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:53.292746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:53.327848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e8466-e20c-4998-a60f-3fe0779f72cd service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:53.334076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:53.335020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:53.335455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:53.335920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:53.348198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:53.350671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0242a3a-2cc6-4c65-b7af-c0fcb1230ad9 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:53.367148 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1372/2705] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:06:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:06:54.581093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:54.582542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:54.583002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:54.666646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] MFA Rules not processed for user `04fd432bad6740efad5a96720455b658`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:54.670713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:54.787133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:06:54.911753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1334/2706] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:57.064878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:57.065905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:57.066353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:57.092081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] MFA Rules not processed for user `04fd432bad6740efad5a96720455b658`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:06:57.094660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:57.114307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1373/2707] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:06:59.559494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:59.560935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:59.732191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a830bed-823b-42d4-8b0c-14a3c06451e3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:59.763913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:06:59.769681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:59.772832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:06:59.773930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:06:59.777174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:06:59.777838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:06:59.781273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:06:59.825578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:06:59.827473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:06:59.870187 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1335/2708] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:06:59.990010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33a0a3-6b96-40f4-b8f8-f2538ad0c3b3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:06:59.999994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:00.001174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:00.001757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:00.002303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] PATH_INFO: `/v3/users/6621970375db482299d3d8dde8558aa9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:00.003775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6621970375db482299d3d8dde8558aa9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:00.011751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:00.200010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6621970375db482299d3d8dde8558aa9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:00.216175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6621970375db482299d3d8dde8558aa9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:00.218160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6621970375db482299d3d8dde8558aa9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:00.233129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6621970375db482299d3d8dde8558aa9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:00.233925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-647e2b5d-c63e-49d4-928f-df2a37437e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6621970375db482299d3d8dde8558aa9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:00.282945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1374/2709] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:06:59 2022] DELETE /identity/v3/users/6621970375db482299d3d8dde8558aa9 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:01.088705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:01.121387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e601e1d-392c-489a-a90a-eb9fabee3946 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:01.282025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:01.283080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:01.283526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:01.284073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] PATH_INFO: `/v3/projects/22a2495ec7094b82bf666a62e4ec149a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:01.286231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a2495ec7094b82bf666a62e4ec149a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:01.288291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:01.382804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a2495ec7094b82bf666a62e4ec149a', 'request_id': 'req-bc2c07f3-fd33-4764-84b4-32a82583f96d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:01.397150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a2495ec7094b82bf666a62e4ec149a', 'request_id': 'req-bc2c07f3-fd33-4764-84b4-32a82583f96d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:01.400406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:01.411374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a2495ec7094b82bf666a62e4ec149a', 'request_id': 'req-bc2c07f3-fd33-4764-84b4-32a82583f96d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:01.444509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] The token cache is being invalidate because project 22a2495ec7094b82bf666a62e4ec149a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:07:01.445259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:01.448046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc2c07f3-fd33-4764-84b4-32a82583f96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:01.451251 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1336/2710] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:01 2022] DELETE /identity/v3/projects/22a2495ec7094b82bf666a62e4ec149a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:01.456137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:01.457075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:01.458017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:01.488334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:01.490348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:01.596031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:01.660305 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1375/2711] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:01.661753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:01.662036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:01.662307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:01.690954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:01.692433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:01.708965 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1337/2712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:01.711132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:01.730330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115186-1b74-49eb-ad46-3418a651fb7d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:01.743011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:01.746850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:01.747212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:01.748591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:01.749411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:07:01.749791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:01.751948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:01.777986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1376/2713] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:07:01.780399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:01.796681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e33627-ac1b-4d6a-bd8a-82c31f6e6687 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:01.806469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:01.807715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:01.807824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:01.808093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:01.808886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:01.811963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:01.917603 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1338/2714] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:07:01 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:07:01.918795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:01.932506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390763-28d1-42c1-a234-a25b02dcd275 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:02.067745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:02.068103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.068392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.068660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.078002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:02.080119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:02.114901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1377/2715] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:07:01 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:07:02.115562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:02.147833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd1233-64cd-4ac7-bfed-5ee59eabd114 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:02.156969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:02.157995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.158469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.158965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.159862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:02.162186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:02.175164 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1339/2716] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:07:02.179583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:02.191818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd6bc-8cb0-4db0-bf37-bf1e8789f50f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:02.195957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:02.197271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.197755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.198141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.199215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:02.201379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf85f-bd55-498f-9105-270b0f924ce8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:02.218445 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1378/2717] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:07:02.219171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:02.235115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cedd52-f9f7-45a1-96b1-0630dbd74913 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:02.242474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:02.243415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.244160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.244693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] PATH_INFO: `/v3/projects/6e1607209530428891cc7f9b2406e42c/users/f3bfadddfac24b69b7ae873925514f1a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.271120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1607209530428891cc7f9b2406e42c, user_id=f3bfadddfac24b69b7ae873925514f1a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:02.275123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:02.296259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1340/2718] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:07:02 2022] PUT /identity/v3/projects/6e1607209530428891cc7f9b2406e42c/users/f3bfadddfac24b69b7ae873925514f1a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:02.301425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdba5c-603d-400c-a038-9555423660d4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.301700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdba5c-603d-400c-a038-9555423660d4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.302078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdba5c-603d-400c-a038-9555423660d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.331801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cbcdba5c-603d-400c-a038-9555423660d4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:02.333502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbcdba5c-603d-400c-a038-9555423660d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:02.422505 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1379/2719] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:02.433061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:02.435088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:02.504592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e2bf-d326-4625-a541-54078eaf4882 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:02.508552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:02.509479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:02.509804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:02.510072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:02.520872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:02.522398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:02.535493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1341/2720] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:11.094378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e321-3f74-48ca-8f71-d8104cf0b6b5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:11.094842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e321-3f74-48ca-8f71-d8104cf0b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:11.095098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537e321-3f74-48ca-8f71-d8104cf0b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:11.140221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a537e321-3f74-48ca-8f71-d8104cf0b6b5 None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:11.141600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a537e321-3f74-48ca-8f71-d8104cf0b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:11.200482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:11.284143 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1380/2721] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:11.430985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:11.432517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:11.580924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d252d-396d-4ec0-8aba-230b0e376616 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:11.588683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:11.589496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:11.589904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:11.590361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:11.600933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:11.602907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:11.614352 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1342/2722] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:12.561563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:12.562571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:12.563072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:12.584614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:12.586990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:12.650189 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1381/2723] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:12.668095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:12.671001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:12.689851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:12.759271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cd34e-55d7-421b-850e-f4a5661ea591 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:12.764723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:12.765544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:12.765981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:12.766408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:12.781606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:12.784041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c7221-20da-4273-943b-e49de69a3729 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:12.794688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1343/2724] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:07:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:07:14.061409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:14.081110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72725e50-7322-4cf3-919e-0d7186b77ea2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:14.088471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:14.089451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:14.089910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:14.090545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:14.093062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:14.190911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:14.192905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b3f1-8b1e-4b61-8cbe-450161e36fb2 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:14.222703 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1382/2725] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:14.470645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:14.471933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:14.472729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:14.515235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] MFA Rules not processed for user `3ffc4db9f1d64b4e864915e980af84f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:14.517490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:14.518842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:14.519175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:14.519385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:14.529395 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1344/2726] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:14.570123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:14.573184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:14.594673 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1383/2727] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:07:15.250691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:15.252513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:15.266584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d4852-8d11-45f1-ad44-9b53c6e3debc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:15.270757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:15.272271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:15.273252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:15.274707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:15.281265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:15.301495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:15.302955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49917d-be9d-4e4f-b8ce-48467be136de service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:15.317409 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1345/2728] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:15.541630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:15.543784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:15.564109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cb670-5b83-454f-aa31-f56f8d63ca49 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:15.571182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:15.571807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:15.572453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:15.572453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:15.574418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:15.648505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:15.651190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:15.662964 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1384/2729] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:16.570260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ff57-c32e-4499-8e73-2baf7f3c3131 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:16.571344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ff57-c32e-4499-8e73-2baf7f3c3131 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:16.571464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ff57-c32e-4499-8e73-2baf7f3c3131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:16.591331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ce62ff57-c32e-4499-8e73-2baf7f3c3131 None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:16.592544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce62ff57-c32e-4499-8e73-2baf7f3c3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:16.647637 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1346/2730] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:25.657823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:26.640967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=61 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:33.134272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:33.145490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49195135-9e77-40f3-8295-b8031054c65f service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:33.151107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:33.151969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:33.152431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:33.152860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:33.154806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:33.219700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:33.221613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:33.232351 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1385/2731] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:41.986570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0ca2-09ff-4620-85b0-b26f88cd795a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:41.987522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0ca2-09ff-4620-85b0-b26f88cd795a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:41.987957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0ca2-09ff-4620-85b0-b26f88cd795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:42.017026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-365f0ca2-09ff-4620-85b0-b26f88cd795a None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:42.018576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-365f0ca2-09ff-4620-85b0-b26f88cd795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:42.072377 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1347/2732] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:07:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:42.080654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:42.096411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cefa7-f2be-40c0-8700-babfbf33a4ca service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:42.121416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:42.122263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:42.123748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:42.123748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:42.142552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:42.142552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:42.162936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1386/2733] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:07:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:07:44.404520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:44.405152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:44.405669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:44.451272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] MFA Rules not processed for user `19e2cb9474fb47a6b3f3793c7f162caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:44.454657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:44.466288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1348/2734] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:52.158129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=34 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:53.367964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:53.382378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfd0d-4ee8-4870-a9fc-550ddbc2b2bf service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:53.401853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:53.402490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:53.402769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:53.403047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:53.406791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:53.582422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:53.584341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:53.610121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1387/2735] 10.222.0.78 () {60 vars in 1396 bytes} [Tue Oct 18 16:07:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:53.940325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:53.942465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:53.989559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26731317-2d44-44af-9eaa-52aa0f3a7d44 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:53.997175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:53.998463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:53.999128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:53.999596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] PATH_INFO: `/v3/users/65e262effe18496cbc3541d8b7ceedd7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:54.001152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e262effe18496cbc3541d8b7ceedd7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:54.003596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:54.120519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e262effe18496cbc3541d8b7ceedd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.122016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e262effe18496cbc3541d8b7ceedd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.142333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e262effe18496cbc3541d8b7ceedd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.147553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e262effe18496cbc3541d8b7ceedd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.159206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-03d46d34-0976-4803-af16-d27599974da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e262effe18496cbc3541d8b7ceedd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.197849 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1349/2736] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:07:53 2022] DELETE /identity/v3/users/65e262effe18496cbc3541d8b7ceedd7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:54.648673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:54.676770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb9c3-43e2-4440-8b49-5ba496bf4148 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:54.826701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:54.827458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:54.827737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:54.828214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] PATH_INFO: `/v3/projects/1c415760996a4973a0e827f3da988200` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:54.829665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c415760996a4973a0e827f3da988200)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:54.832241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:54.950466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c415760996a4973a0e827f3da988200', 'request_id': 'req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:54.979052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c415760996a4973a0e827f3da988200', 'request_id': 'req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:55.009715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c415760996a4973a0e827f3da988200', 'request_id': 'req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:55.055529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] The token cache is being invalidate because project 1c415760996a4973a0e827f3da988200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:07:55.057227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:55.059442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ceaeb1d5-e88c-4f07-a97d-ab385793e3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:55.065051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1388/2737] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:54 2022] DELETE /identity/v3/projects/1c415760996a4973a0e827f3da988200 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:55.070744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.071715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.072254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.117623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:55.118899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:55.341676 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1350/2738] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:55.343164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.343527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.343872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.387082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:55.390957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:55.437219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.446736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1389/2739] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:55.463769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b05a-bd28-4be9-bab7-d8c12e9a5694 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:55.469239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:55.469862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.470174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.470415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.471075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:07:55.471377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:55.473052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:55.501906 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1351/2740] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:07:55.506238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.516657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c7e3e-8085-431d-8b67-7a99f1295e73 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:55.521905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:55.522888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.523361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.523829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.524689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:55.527284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:55.580677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:55.597291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1390/2741] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:07:55 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:07:55.601634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.619472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811a44e-76fd-4b5b-973b-e221931a2b68 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:55.725869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:55.753946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:55.754639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.754956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.755190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.755831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:55.758556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:55.832024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1352/2742] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:07:55 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:07:55.833254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.852129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd094050-800a-46ab-8b90-19089ba32f35 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:55.864906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:55.865560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.865839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.866143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.866804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:55.868415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:55.900509 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1391/2743] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:07:55.902603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.915604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f6d0a-37a5-48d9-a68b-75ca85da2faf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:55.928344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:55.930353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:55.931119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:55.931674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:55.933261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:55.937776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a955-3c71-4d70-abc6-3b884fee3845 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:55.979580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:55.992358 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1353/2744] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:07:55.996312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad96f1-6d14-437f-b055-112a74f11d93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:56.015491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:56.016456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:56.016927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:56.017384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] PATH_INFO: `/v3/projects/f057228d800e4762bf0885048fd674a6/users/095a658d98074e4badd136c1206fc97e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:56.051738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f057228d800e4762bf0885048fd674a6, user_id=095a658d98074e4badd136c1206fc97e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:56.060441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc8893-ba3a-48aa-acc3-bd68f220875f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:56.083560 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1392/2745] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:07:55 2022] PUT /identity/v3/projects/f057228d800e4762bf0885048fd674a6/users/095a658d98074e4badd136c1206fc97e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:56.167092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:56.168006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:56.168456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:56.224904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] MFA Rules not processed for user `095a658d98074e4badd136c1206fc97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:56.229976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:56.265566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:56.268169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:56.268814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:56.311634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:56.315744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:56.386888 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1354/2746] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:07:56.496349 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1393/2747] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:07:56.583573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:56.585949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:56.830570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcbb93-cca2-4164-a8fa-d256559a2f32 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:56.844893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:56.847202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:56.848882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:56.851690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:56.878271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:56.881473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:56.920856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1355/2748] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:07:59.199999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:59.202237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:07:59.313698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c254288-38f0-43d9-91bc-b9be535ad4c1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:59.322177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:59.323103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:59.323380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:59.323653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] PATH_INFO: `/v3/users/e46ff953364048d392e5adcdade2b256` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:59.324959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46ff953364048d392e5adcdade2b256)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:59.326936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:59.401622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46ff953364048d392e5adcdade2b256'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.410559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46ff953364048d392e5adcdade2b256'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.411429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46ff953364048d392e5adcdade2b256'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.423582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46ff953364048d392e5adcdade2b256'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.424657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-616dc61d-3573-4987-8a87-ee011f2595b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46ff953364048d392e5adcdade2b256'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.433393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:59.457302 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1394/2749] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:07:59 2022] DELETE /identity/v3/users/e46ff953364048d392e5adcdade2b256 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:59.701633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:07:59.715111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b033e6-5f58-4611-8e9b-a88f04520d85 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:07:59.810264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:07:59.838951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:07:59.839621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:59.839895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:59.840162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] PATH_INFO: `/v3/projects/95688716e1614719bab0f4850aa70b2c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:59.841299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95688716e1614719bab0f4850aa70b2c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:07:59.843532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:07:59.907870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95688716e1614719bab0f4850aa70b2c', 'request_id': 'req-40750518-bf3b-4a8f-9af2-c11da0ba5541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.921641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95688716e1614719bab0f4850aa70b2c', 'request_id': 'req-40750518-bf3b-4a8f-9af2-c11da0ba5541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.944483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95688716e1614719bab0f4850aa70b2c', 'request_id': 'req-40750518-bf3b-4a8f-9af2-c11da0ba5541'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.957792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] The token cache is being invalidate because project 95688716e1614719bab0f4850aa70b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:07:59.958076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.959381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-40750518-bf3b-4a8f-9af2-c11da0ba5541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:07:59.963440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1356/2750] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:07:59 2022] DELETE /identity/v3/projects/95688716e1614719bab0f4850aa70b2c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:07:59.968182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:07:59.968447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:07:59.968655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:07:59.992678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:07:59.994436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:00.082301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1395/2751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:00.091038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.091318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.091592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.119874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:00.121485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:00.136314 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1357/2752] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:00.137406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.149283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18e96c-1f1d-41ce-8494-f4198054b989 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.154318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.155302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.155653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.155931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.157109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:08:00.157844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.159938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.179679 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1396/2753] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:08:00.183533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.195084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec701cc2-4c35-4f8e-b891-2487242e5537 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.202798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.203413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.203686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.203956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.204587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.206507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.252659 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1358/2754] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:08:00 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:00.256929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.269295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d6ad-e87f-43d6-9935-86bb04acff6b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.422752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.424002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.424520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.425040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.425995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.430286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.462496 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1397/2755] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:08:00 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:08:00.464117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.476641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e148b3-325c-4dc4-9e2c-348afc9bf42a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.485310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.486484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.486988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.487458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.488313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.491778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.506135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1359/2756] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:00.506634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.520769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014322a-7638-4de5-a8fb-27d05ac90860 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.530920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.531623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.531623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.531623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.532213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.534072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9497d6d-5565-4eea-a104-396ae28e12e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.547075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1398/2757] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:08:00.551079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.564744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd70e58-3cf8-4e22-ab50-04aa0f70a63d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.569878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.570537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.570815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.571085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] PATH_INFO: `/v3/projects/d2282f5ad29c4ff8b49ab1d29fdc4331/users/be17681a7d5e42d1a134801c65fa65b0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.592478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2282f5ad29c4ff8b49ab1d29fdc4331, user_id=be17681a7d5e42d1a134801c65fa65b0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.595280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.617548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1360/2758] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:08:00 2022] PUT /identity/v3/projects/d2282f5ad29c4ff8b49ab1d29fdc4331/users/be17681a7d5e42d1a134801c65fa65b0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:00.619342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.619624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.619947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.643460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:00.644971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:00.730177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:00.745957 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1399/2759] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:00.755562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:00.757711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:00.851082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81701-66e0-4cce-bc6d-dd5156e8c5d6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:00.856140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:00.856754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:00.857086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:00.857356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:00.871851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:00.877046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978d835-2caa-4ff6-b3c3-8935376d8790 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:00.906193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1361/2760] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:05.628780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:05.632833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:05.663608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e0b7c-24d4-463b-b6b0-18563eadcac8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:05.670345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:05.671399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:05.671399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:05.671649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] PATH_INFO: `/v3/users/095a658d98074e4badd136c1206fc97e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:05.673664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095a658d98074e4badd136c1206fc97e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:05.677848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:05.763142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095a658d98074e4badd136c1206fc97e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:05.779767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095a658d98074e4badd136c1206fc97e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:05.782513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095a658d98074e4badd136c1206fc97e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:05.811476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095a658d98074e4badd136c1206fc97e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:05.814066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095a658d98074e4badd136c1206fc97e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:05.883198 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1400/2761] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:08:05 2022] DELETE /identity/v3/users/095a658d98074e4badd136c1206fc97e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:05.887900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:05.888409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:05.888542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:05.924669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:05.933063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:05.945376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:06.105070 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1362/2762] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:06.117320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:06.118898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:06.262622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2657a-46f8-407d-8a8e-1a12b778f941 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:06.269888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:06.271208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:06.271488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:06.271758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:06.300828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:06.304903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4062ce2-424d-4d0c-b8f4-e2b2a82c8e8f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:06.336876 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1401/2763] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:06.957285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:06.958994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:06.974847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65d021-a4a1-4503-a10c-cfd61d040191 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:06.981446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:06.983731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:06.984347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:06.984954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] PATH_INFO: `/v3/projects/f057228d800e4762bf0885048fd674a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:06.986521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f057228d800e4762bf0885048fd674a6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:06.990667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.067731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f057228d800e4762bf0885048fd674a6', 'request_id': 'req-65c791da-764b-49c8-a353-a0f17c7972ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:07.080739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f057228d800e4762bf0885048fd674a6', 'request_id': 'req-65c791da-764b-49c8-a353-a0f17c7972ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:07.107179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f057228d800e4762bf0885048fd674a6', 'request_id': 'req-65c791da-764b-49c8-a353-a0f17c7972ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:07.183201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] The token cache is being invalidate because project f057228d800e4762bf0885048fd674a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:08:07.183493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:07.184156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65c791da-764b-49c8-a353-a0f17c7972ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:07.186388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1363/2764] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:06 2022] DELETE /identity/v3/projects/f057228d800e4762bf0885048fd674a6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:07.191577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.192483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.192978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.233179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:07.234894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:07.383050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1402/2765] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:07.384453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.384802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.385193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.424073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:07.425776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:07.439914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.446759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1364/2766] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:07.451584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e522a-69f8-43e9-b0b7-a360a0aeedfb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.458622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.460003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.460434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.461029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.461862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:08:07.462355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:07.464650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.473995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:07.487824 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1403/2767] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:08:07.493359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.502542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957723-53e6-47a0-8bd3-1e0ac7fa3097 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.508094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.508957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.509453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.509904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.511760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:07.514486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.624934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.626828 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1365/2768] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:08:07 2022] POST /identity/v3/projects => generated 395 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:07.643939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cea8fe-bfe3-4dfd-a7bb-142657904670 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.741235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.742047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.742924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.743217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.744059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:07.746317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.796640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.808231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1404/2769] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:08:07 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:07.809681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df635cb-b947-4aed-a46c-fbd7c117ab58 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.815333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.816295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.816741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.817272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.818396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:07.822203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.859103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1366/2770] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:08:07.860479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.878221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80916824-3221-4b19-9240-13c5602147eb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.902702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.904327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.904783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.905251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:07.906240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:07.910073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d122ee-3324-4f61-8b68-aa1fccc827a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:07.945553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1405/2771] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:07.948791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:07.960689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096aa80-03e4-4bab-bbab-f41d1fe7e224 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:07.974772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:07.976434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:07.976901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:07.977379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] PATH_INFO: `/v3/projects/31663cc3c74c4d71a66fc5569ef0e178/users/973a6e472ee344b79a0c17c498fd944a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:08.043321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31663cc3c74c4d71a66fc5569ef0e178, user_id=973a6e472ee344b79a0c17c498fd944a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:08.054356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:08.100517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1367/2772] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:08:07 2022] PUT /identity/v3/projects/31663cc3c74c4d71a66fc5569ef0e178/users/973a6e472ee344b79a0c17c498fd944a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:08.106122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a66f1-e40c-44b4-b3eb-432ce1c26355 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:08.106437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a66f1-e40c-44b4-b3eb-432ce1c26355 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:08.106851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a66f1-e40c-44b4-b3eb-432ce1c26355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:08.151429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7e8a66f1-e40c-44b4-b3eb-432ce1c26355 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:08.152706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e8a66f1-e40c-44b4-b3eb-432ce1c26355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:08.298642 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1406/2773] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:08.323847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:08.325684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:08.394484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:08.472478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b8697-b35c-4227-9d71-58d741bb4175 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:08.482955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:08.483979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:08.484458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:08.484925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:08.507779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:08.509659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f5af5-b5f2-4957-8e91-5dc5773ba21c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:08.557360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1368/2774] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:10.976311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:10.977485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:10.977907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:11.094204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] MFA Rules not processed for user `be17681a7d5e42d1a134801c65fa65b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:11.096077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:11.394225 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1407/2775] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:11.395620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:11.396111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:11.396216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:11.457961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] MFA Rules not processed for user `be17681a7d5e42d1a134801c65fa65b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:11.459771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:11.495149 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1369/2776] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:08:11.500605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:11.502297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:11.520718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:11.739416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5369a-d2e4-4586-9522-63bca5f770c3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:11.755469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:11.756134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:11.756402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:11.756688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:11.776880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:11.778778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00f93-34ba-4100-ad75-a0ac580ead43 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:11.801972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1408/2777] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:17.580776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:17.583217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:17.610160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106649f-c7e0-41b7-b768-db91a4445362 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:17.615650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:17.616503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:17.616971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:17.618036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:17.624654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:17.652673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:17.654578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:17.672051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1370/2778] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:19.109634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22faf6-72c3-40ba-8846-0e04a1f5a533 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:19.110550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22faf6-72c3-40ba-8846-0e04a1f5a533 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:19.110992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22faf6-72c3-40ba-8846-0e04a1f5a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:19.156980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6b22faf6-72c3-40ba-8846-0e04a1f5a533 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:19.160890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b22faf6-72c3-40ba-8846-0e04a1f5a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:19.290249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1409/2779] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:08:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:19.307099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:19.309358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:19.396790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb5b13-e577-4c72-9911-997d6c5178e8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:19.402791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:19.403741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:19.404340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:19.404837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:19.416491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:19.428659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:19.454950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1371/2780] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:08:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:08:28.510194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:28.511177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:28.511746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:28.568810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] MFA Rules not processed for user `973a6e472ee344b79a0c17c498fd944a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:28.577566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:28.745400 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1410/2781] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:29.444431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=54 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:29.703314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:29.721192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4227dd-19e6-4a9e-99b0-4631ebab5fe8 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:29.741073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:29.742870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:29.743326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:29.743758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:29.758311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:29.760605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:29.796139 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1372/2782] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:29 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:30.033675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:30.053622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4335-3410-4c74-bac5-72f237ae1d87 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:30.061734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:30.064299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:30.064582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:30.064861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:30.070139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:30.134645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:30.233205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:30.234670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:30.260970 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1411/2783] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:33.424446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:33.431325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:33.459228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb0a55-bd06-465b-afc2-049741630ff9 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:33.474407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:33.475937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:33.476406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:33.477097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] PATH_INFO: `/v3/users/3ffc4db9f1d64b4e864915e980af84f4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:33.479209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffc4db9f1d64b4e864915e980af84f4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:33.481725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:33.557662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffc4db9f1d64b4e864915e980af84f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:33.558540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffc4db9f1d64b4e864915e980af84f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:33.580891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffc4db9f1d64b4e864915e980af84f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:33.582706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffc4db9f1d64b4e864915e980af84f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:33.601419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-68e348e6-d06c-4a2f-baf3-88a9af2a69ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffc4db9f1d64b4e864915e980af84f4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:33.655010 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1373/2784] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:08:33 2022] DELETE /identity/v3/users/3ffc4db9f1d64b4e864915e980af84f4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:34.801689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:34.827252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210be18-7a64-4497-b8a9-f2133aacbb24 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:35.000495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:35.003403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:35.009994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:35.010656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] PATH_INFO: `/v3/projects/9c2404823fb54cc2bcee162756e6ef79` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:35.012264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2404823fb54cc2bcee162756e6ef79)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:35.016919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:35.142793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2404823fb54cc2bcee162756e6ef79', 'request_id': 'req-1ba1142c-d8db-47ad-bb04-762ce51dd4da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:35.164420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2404823fb54cc2bcee162756e6ef79', 'request_id': 'req-1ba1142c-d8db-47ad-bb04-762ce51dd4da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:35.186327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2404823fb54cc2bcee162756e6ef79', 'request_id': 'req-1ba1142c-d8db-47ad-bb04-762ce51dd4da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:35.226804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] The token cache is being invalidate because project 9c2404823fb54cc2bcee162756e6ef79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:08:35.227160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:35.230081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1ba1142c-d8db-47ad-bb04-762ce51dd4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:35.234798 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1412/2785] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:34 2022] DELETE /identity/v3/projects/9c2404823fb54cc2bcee162756e6ef79 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:35.240234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:35.241713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:35.242176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:35.295706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:35.298189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:35.685602 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1374/2786] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:35.693811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:35.694150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:35.694351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:35.734207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:35.735961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:35.749338 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1413/2787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:35.750357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:35.761449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dbc74-188a-4e44-97ba-bec4a55bc3db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:35.767574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:35.768570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:35.769139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:35.769635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:35.770671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:08:35.771725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:35.773662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:35.793341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:35.801250 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1375/2788] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:08:35.805833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86718824-da52-4ce1-af1b-b1b4139e5d02 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:35.811824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:35.812824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:35.813435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:35.813947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:35.814804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:35.817219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:35.876116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1414/2789] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:08:35 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:08:35.881679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:35.897269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084ce9d-0c22-4e22-8e8f-75e171889fca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:36.039169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:36.069745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:36.070424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.070646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.070953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:36.071530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:36.081234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:36.136127 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1376/2790] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:08:35 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:36.140471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:36.165259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d02fc6-5b32-4e86-bb3e-0b422bbe5c51 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:36.184751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:36.186286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.186582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.186858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:36.187530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:36.189633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:36.229023 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1415/2791] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:36.232942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:36.253125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464ad5-caba-4dec-9fd7-5c40ec9e19ae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:36.269040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:36.270046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.270547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.271069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:36.272219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:36.274154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be5ede-072a-4cc1-8214-c482d127d9e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:36.317039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1377/2792] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:36.320782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:36.339733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3793e3-4e47-409b-89fe-8d4bee62fcba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:36.350706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:36.351797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.352361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.352887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] PATH_INFO: `/v3/projects/657fa7d919794871afefb189abc7e337/users/4debcc0bc2264da988d348a818838adb/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:36.368490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:36.392711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=657fa7d919794871afefb189abc7e337, user_id=4debcc0bc2264da988d348a818838adb, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:36.397289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:36.432027 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1416/2793] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:08:36 2022] PUT /identity/v3/projects/657fa7d919794871afefb189abc7e337/users/4debcc0bc2264da988d348a818838adb/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:36.434303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0a25a-715f-4315-96a9-4ca55cc11785 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.434585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0a25a-715f-4315-96a9-4ca55cc11785 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.434854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0a25a-715f-4315-96a9-4ca55cc11785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:36.474526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-95e0a25a-715f-4315-96a9-4ca55cc11785 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:36.483028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95e0a25a-715f-4315-96a9-4ca55cc11785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:36.661747 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1378/2794] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:36.743965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:36.745802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:36.946217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d599cc-b07b-4090-ad52-59efb233d59f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:36.968803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:36.972712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:36.974633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:36.974864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:37.017934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:37.024532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:37.066042 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1417/2795] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:37.596165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:37.596585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:37.596901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:37.668436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:37.672354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:37.914206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1379/2796] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:43.662644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:43.664431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:43.847606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db54a6-89e6-4efd-be80-c37dfea3d7ba service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:43.860291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:43.861897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:43.863084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:43.865848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] PATH_INFO: `/v3/users/973a6e472ee344b79a0c17c498fd944a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:43.867685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973a6e472ee344b79a0c17c498fd944a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:43.871923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:44.008242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973a6e472ee344b79a0c17c498fd944a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:44.022867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973a6e472ee344b79a0c17c498fd944a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:44.024778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973a6e472ee344b79a0c17c498fd944a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:44.039056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973a6e472ee344b79a0c17c498fd944a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:44.048716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d672d138-87ae-4581-9b29-0098d5a8ca68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973a6e472ee344b79a0c17c498fd944a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:44.094784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1418/2797] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:08:43 2022] DELETE /identity/v3/users/973a6e472ee344b79a0c17c498fd944a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:45.108789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:45.195353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8afd9-c631-4469-a3a7-6a0919a6060c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:45.337717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:45.367539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:45.368459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:45.368949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:45.369436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] PATH_INFO: `/v3/projects/31663cc3c74c4d71a66fc5569ef0e178` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:45.370727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31663cc3c74c4d71a66fc5569ef0e178)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:45.384466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:45.502428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31663cc3c74c4d71a66fc5569ef0e178', 'request_id': 'req-a78993e3-d064-49fd-bb10-e2366dab1a09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:45.522385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31663cc3c74c4d71a66fc5569ef0e178', 'request_id': 'req-a78993e3-d064-49fd-bb10-e2366dab1a09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:45.537113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31663cc3c74c4d71a66fc5569ef0e178', 'request_id': 'req-a78993e3-d064-49fd-bb10-e2366dab1a09'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:45.562800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] The token cache is being invalidate because project 31663cc3c74c4d71a66fc5569ef0e178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:08:45.563090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:45.563785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a78993e3-d064-49fd-bb10-e2366dab1a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:45.571914 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1380/2798] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:45 2022] DELETE /identity/v3/projects/31663cc3c74c4d71a66fc5569ef0e178 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:45.572159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:45.572630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:45.572630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:45.649137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:45.651536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:45.683295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:45.836770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:45.837071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:45.837451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:45.837656 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1419/2799] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:45.908582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:45.916466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:45.950463 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1381/2800] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:08:45.954945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:45.984843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d270-d054-4184-b579-3d3e3b02d22e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.000897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.001761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.003131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.004364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.005404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:08:46.010769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.017701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.054524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:46.058739 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1420/2801] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:08:46.064134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ccb94-3de5-45d2-b2b8-b8dcc840ea3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.072603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.073246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.073520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.073786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.079635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.081618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.157404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:46.158129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1382/2802] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:08:46 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:46.169854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6880ac2-2ff8-460f-87a1-da73f7089caf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.328505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.329176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.329457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.329725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.330362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.332289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.403630 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1421/2803] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:08:46 2022] POST /identity/v3/users => generated 281 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:08:46.408383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:46.431517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41cbf0-7931-449f-a576-a35a74a77cc8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.463977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.464608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.464885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.465192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.465845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.467449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.490968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1383/2804] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:46.494715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:46.512867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40195-84ee-4022-8000-1726087371a3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.524843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.525512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.525793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.526063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.526729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.529528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d4bde-88e9-43c2-bfe8-627c5442da57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.556067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1422/2805] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:08:46.560236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:46.576641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840ca36-c86a-4c55-b71f-e423cc4ffa38 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:46.599739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:46.600723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.601027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.601308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] PATH_INFO: `/v3/projects/c08622db0db54ee8b0f63aa22b426047/users/f92eddd6a20f4d4e82e0c7a1d968a060/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.634528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08622db0db54ee8b0f63aa22b426047, user_id=f92eddd6a20f4d4e82e0c7a1d968a060, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:46.637206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:46.666216 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1384/2806] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:08:46 2022] PUT /identity/v3/projects/c08622db0db54ee8b0f63aa22b426047/users/f92eddd6a20f4d4e82e0c7a1d968a060/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:46.676749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:46.677547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:46.677654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:46.776318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] MFA Rules not processed for user `f92eddd6a20f4d4e82e0c7a1d968a060`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:46.779814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:47.024895 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1423/2807] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:47.477788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:47.479791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:47.756316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:47.855637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783fe71-a172-41ef-ad52-19942abc7e1d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:47.886586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:47.887494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:47.887976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:47.888407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:47.890707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:47.930494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:47.932504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:47.970924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1385/2808] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:48.170600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:48.172725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:48.221640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:48.385581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1391d-7503-449e-ad2d-c0733d03e86a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:48.418121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:48.419011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:48.420707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:48.422038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:48.435524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:48.438244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e2191-15c2-4694-96d6-ce3f4d0f9aa4 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:48.454819 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1424/2809] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:48.529956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:48.793924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a29e19-bd9f-43fa-a5da-5c11f6aa6617 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:48.810985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:48.815977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:48.822629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:48.823181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] PATH_INFO: `/v3/users/f92eddd6a20f4d4e82e0c7a1d968a060` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:48.826383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92eddd6a20f4d4e82e0c7a1d968a060)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:48.828461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:48.998982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92eddd6a20f4d4e82e0c7a1d968a060'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:49.003676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92eddd6a20f4d4e82e0c7a1d968a060'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:49.028266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92eddd6a20f4d4e82e0c7a1d968a060'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:49.028266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92eddd6a20f4d4e82e0c7a1d968a060'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:49.045156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92eddd6a20f4d4e82e0c7a1d968a060'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:49.079431 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1386/2810] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:08:48 2022] DELETE /identity/v3/users/f92eddd6a20f4d4e82e0c7a1d968a060 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:49.087786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:49.088146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:49.088508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:49.179125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:49.181759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:49.452015 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1425/2811] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:49.472674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:49.477637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:49.638797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9e367-5187-484e-805f-656c276fc0cc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:49.654363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:49.655207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:49.657170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:49.657564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:49.700137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:49.704556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:49.707249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d74d8-48fb-4b2e-9e19-e2f441732dc8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:49.741429 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1387/2812] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:50.485459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:50.485459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:50.522853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed95d36-66a8-4c11-aadf-5ab50ecd6a9c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:50.556243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:50.556775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:50.557078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:50.557355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] PATH_INFO: `/v3/projects/c08622db0db54ee8b0f63aa22b426047` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:50.570379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08622db0db54ee8b0f63aa22b426047)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:50.572338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:50.709574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20dae-40e0-4638-9905-85c46de4c313 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:50.710388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20dae-40e0-4638-9905-85c46de4c313 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:50.710786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20dae-40e0-4638-9905-85c46de4c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:50.792042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08622db0db54ee8b0f63aa22b426047', 'request_id': 'req-1a839b79-b676-4000-bb27-7b5703f836ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:50.800118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08622db0db54ee8b0f63aa22b426047', 'request_id': 'req-1a839b79-b676-4000-bb27-7b5703f836ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:50.807817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08622db0db54ee8b0f63aa22b426047', 'request_id': 'req-1a839b79-b676-4000-bb27-7b5703f836ba'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:50.809492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bab20dae-40e0-4638-9905-85c46de4c313 None None] MFA Rules not processed for user `4debcc0bc2264da988d348a818838adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:50.810870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bab20dae-40e0-4638-9905-85c46de4c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:50.840046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] The token cache is being invalidate because project c08622db0db54ee8b0f63aa22b426047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:08:50.842548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:50.844311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a839b79-b676-4000-bb27-7b5703f836ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:08:50.854899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1426/2813] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:08:50 2022] DELETE /identity/v3/projects/c08622db0db54ee8b0f63aa22b426047 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:50.857811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:50.860874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:50.861948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:50.938919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:50.940739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:51.018192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:51.068278 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1388/2814] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:51.146736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1427/2815] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:51.154266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.154556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.154828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.185646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:51.187155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:51.200980 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1389/2816] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:51.204818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.221840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4074cd-e0c0-428b-adbb-046b07b2463e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.246124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.246959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.247334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.247694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.248613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:08:51.249499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.252933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.255214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:51.264797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.296663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1428/2817] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:08:51.302538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.323608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdeb1b-c0ef-45e0-92b3-5af3dad19bf0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.342812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.343697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.344069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.344430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.345374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.347557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.408809 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1429/2818] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:08:51 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:08:51.413521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.477424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83282123-b045-4f92-ab31-5fe17324db59 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.597895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5b57-ffc7-43b5-aa19-ca4ff9f044a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.612593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.614512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.614990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.616422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.618121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.623938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.652760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.653563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.654078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.654366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.687366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1430/2819] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:08:51 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:08:51.690554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:51.692657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.725859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb334a-9f3c-412f-bb22-516f54fc5a7c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.739802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.741699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.743265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.743696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.746931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.753256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.797725 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1431/2820] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:51.801373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.816639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.823545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.833674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3938-0a0c-4462-96f6-49a0e5da0414 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.843271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.844258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.844689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.845495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1390/2821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:08:51.849310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.850337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.859784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbdd28-ef11-4c07-a778-7abd08bfb485 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.873629 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1432/2822] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:08:51.877473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:51.891290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a33c-834e-416b-86dd-b3939b450e09 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:51.898201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:51.899020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.899369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.899745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] PATH_INFO: `/v3/projects/b9650da009f3482f9fc67cacebd2e09e/users/b7d816c3043c435d8bf79d2c819518ec/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.929543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9650da009f3482f9fc67cacebd2e09e, user_id=b7d816c3043c435d8bf79d2c819518ec, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:51.935282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:51.959189 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1391/2823] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:08:51 2022] PUT /identity/v3/projects/b9650da009f3482f9fc67cacebd2e09e/users/b7d816c3043c435d8bf79d2c819518ec/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:08:51.970833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:51.971113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:51.971389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:51.996522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:51.998134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:52.133480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:52.200762 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1433/2824] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:52.228730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:52.232405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:52.237648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:52.242450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:52.389268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c9163-b3ba-4d1b-acdb-d7bcb639478c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:52.401202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:52.402319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:52.402762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:52.403190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:52.414819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:52.416506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95091fe8-434a-472c-a816-4e74c1efbe1c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:52.431363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8c3f7-cf50-4a8d-a556-cccd736fad90 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:52.434574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1434/2825] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:52.460684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:52.461508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:52.461778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:52.462051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:52.467308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:52.512254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:52.514333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:52.534922 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1392/2826] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:54.499259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:54.499838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:54.499838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:54.537216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] MFA Rules not processed for user `ab2aa9c224654cfbbc1559ed58556ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:08:54.540162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:54.642604 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1435/2827] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:08:57.529961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:57.728762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f1dd-d780-439b-a9d1-91dddffd490b service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:08:57.739543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:08:57.740165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:08:57.740551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:08:57.740957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:08:57.743754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:08:57.774943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:08:57.900551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:08:57.904368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:08:57.932187 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1393/2828] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:08:59.993088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:08:59.995135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:00.024367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc94d-ffae-4377-8dfa-78fa49a25c26 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:00.049943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:00.050965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:00.051476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:00.051780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:00.070001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:00.122484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:00.124638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:00.160966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1436/2829] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:09:00.179590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:00.181972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:00.221682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc95b1-f34d-4ff0-b8f3-6d8f6a89a88d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:00.240323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:00.241116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:00.241492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:00.241886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] PATH_INFO: `/v3/users/be17681a7d5e42d1a134801c65fa65b0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:00.243602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be17681a7d5e42d1a134801c65fa65b0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:00.245648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:00.327381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be17681a7d5e42d1a134801c65fa65b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:00.329484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be17681a7d5e42d1a134801c65fa65b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:00.348300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be17681a7d5e42d1a134801c65fa65b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:00.349518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be17681a7d5e42d1a134801c65fa65b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:00.365718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be17681a7d5e42d1a134801c65fa65b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:00.426744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1394/2830] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:09:00 2022] DELETE /identity/v3/users/be17681a7d5e42d1a134801c65fa65b0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:00.871546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:00.899786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f87c5e-eb57-4cf3-96c6-38095569d90c service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:01.155546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:01.158751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:01.159112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:01.165776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] PATH_INFO: `/v3/projects/d2282f5ad29c4ff8b49ab1d29fdc4331` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:01.178199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2282f5ad29c4ff8b49ab1d29fdc4331)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:01.184202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:01.205386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:01.207188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.279698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:01.355084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3e093-95a2-489d-b5e4-16d3f95acd15 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:01.374132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'request_id': 'req-e75e5a33-811c-4de6-801e-1a1e65f04c56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:01.388796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'request_id': 'req-e75e5a33-811c-4de6-801e-1a1e65f04c56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:01.407059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2282f5ad29c4ff8b49ab1d29fdc4331', 'request_id': 'req-e75e5a33-811c-4de6-801e-1a1e65f04c56'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:01.461092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:01.492687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:01.493521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:01.495760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] The token cache is being invalidate because project d2282f5ad29c4ff8b49ab1d29fdc4331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:09:01.496055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:01.496275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:01.496679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:01.497401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e75e5a33-811c-4de6-801e-1a1e65f04c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:01.501916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.503375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1437/2831] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:00 2022] DELETE /identity/v3/projects/d2282f5ad29c4ff8b49ab1d29fdc4331 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:01.512086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c078-d16c-470c-9c7b-fc1a0fb4b67b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:01.512362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c078-d16c-470c-9c7b-fc1a0fb4b67b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:01.512631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795c078-d16c-470c-9c7b-fc1a0fb4b67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:01.729556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3795c078-d16c-470c-9c7b-fc1a0fb4b67b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:01.732394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:01.733051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3795c078-d16c-470c-9c7b-fc1a0fb4b67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.736181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:01.785786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1395/2832] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:09:01.840692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:01.842620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.860781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c2348-e6d1-4ed7-a32f-e3ae7731066d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:01.866545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:01.867166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:01.867750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:01.868029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:01.870976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.896821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1438/2833] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:01.904636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:01.905217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:01.905662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:01.906084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:01.907575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:01.929356 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1396/2834] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:09:01.958020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:01.959273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:01.992061 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1439/2835] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:01.996544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.018695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1504e-c696-437c-905e-eaa64fd8b3ad service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.026376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.027400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.027788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.028172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.028958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:09:02.029494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.031528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.053534 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1397/2836] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:09:02.057217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.074176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9801c-0325-47bc-bb8f-5f065d6f1a98 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.098218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.098838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.099067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.100401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.100401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.104289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.164711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.165186 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1440/2837] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:09:02 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:09:02.178434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c1839-d5f5-401e-a6d6-ee7f20b6cf42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.376191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.376975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.377288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.377558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.378212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.384702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.450236 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1398/2838] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:09:02 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:09:02.454464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.480368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fc64-78c2-4b7b-8042-5e459dd5826d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.506813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.507653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.508031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.508395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.509380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.515041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.540863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.541491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1441/2839] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:09:02.555879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcbad6-e43c-4a05-a027-db383db98540 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.577195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.578776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.578776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.578776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.581362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.588429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad87512-7d66-416f-840a-903def77f8c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.621045 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1399/2840] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:09:02.623607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:02.642226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b244e4-5bf7-417a-94e5-8d36a4271c2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:02.659105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:02.659986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.660385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.660751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] PATH_INFO: `/v3/projects/65ac19ca0ab84dc7b0bcfad3962a33b5/users/d31742926f754ebfb4914ea5f7269e7e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.721429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ac19ca0ab84dc7b0bcfad3962a33b5, user_id=d31742926f754ebfb4914ea5f7269e7e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:02.730603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:02.761169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1442/2841] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:09:02 2022] PUT /identity/v3/projects/65ac19ca0ab84dc7b0bcfad3962a33b5/users/d31742926f754ebfb4914ea5f7269e7e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:02.762105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58d8f-36ed-4102-87e9-483cfebafc93 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:02.762399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58d8f-36ed-4102-87e9-483cfebafc93 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:02.762672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58d8f-36ed-4102-87e9-483cfebafc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:02.821413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:02.837877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-48a58d8f-36ed-4102-87e9-483cfebafc93 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:02.845091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48a58d8f-36ed-4102-87e9-483cfebafc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:03.020736 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1400/2842] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:09:03.090416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:03.092519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:03.117374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:03.215062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231e7d-50d3-4506-87dd-b72fd073cfe0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:03.222091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118eb48-841d-4802-9668-0de695847def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:03.223887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118eb48-841d-4802-9668-0de695847def service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:03.224246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118eb48-841d-4802-9668-0de695847def service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:03.224600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118eb48-841d-4802-9668-0de695847def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:03.253448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118eb48-841d-4802-9668-0de695847def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:03.253448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118eb48-841d-4802-9668-0de695847def service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:03.261548 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1443/2843] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:09:04.201399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6db17-6a09-4b04-b1fb-89a92f5267dd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:04.201948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6db17-6a09-4b04-b1fb-89a92f5267dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:04.202478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6db17-6a09-4b04-b1fb-89a92f5267dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:04.225634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-52e6db17-6a09-4b04-b1fb-89a92f5267dd None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:04.228879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52e6db17-6a09-4b04-b1fb-89a92f5267dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:04.364337 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1401/2844] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:05.344309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:05.344956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:05.344956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:05.468314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] MFA Rules not processed for user `b7d816c3043c435d8bf79d2c819518ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:05.469890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:05.653916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1444/2845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:05.664987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29a4b-140d-433a-a333-c4ea6e3acf0e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:05.666298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29a4b-140d-433a-a333-c4ea6e3acf0e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:05.666773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a29a4b-140d-433a-a333-c4ea6e3acf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:05.711337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20a29a4b-140d-433a-a333-c4ea6e3acf0e None None] MFA Rules not processed for user `b7d816c3043c435d8bf79d2c819518ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:05.715136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20a29a4b-140d-433a-a333-c4ea6e3acf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:05.738447 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1402/2846] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:06.132247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:06.134331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:06.428055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c0a1-0091-4aec-b105-8937e45cae02 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:06.441891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:06.442750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:06.443293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:06.443883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:06.460139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:06.462476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:06.493833 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1445/2847] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:09:07.794492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3199-ce86-40fb-a961-8711a8cbd716 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:07.795546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3199-ce86-40fb-a961-8711a8cbd716 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:07.796072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a3199-ce86-40fb-a961-8711a8cbd716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:07.954283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c82a3199-ce86-40fb-a961-8711a8cbd716 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:07.965402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c82a3199-ce86-40fb-a961-8711a8cbd716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:08.164713 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1403/2848] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:08.178643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:08.180161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:08.245191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:08.366837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191da97-959e-4a6f-8c9a-007840638d77 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:08.388444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:08.390637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:08.390941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:08.392389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:08.420476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:08.424696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0033632-0d1b-442d-a083-7059be0ceae3 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:08.451638 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1446/2849] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:09:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:18.138992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:18.442424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=20 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:23.788009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:23.789742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:23.790650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:23.935773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] MFA Rules not processed for user `d31742926f754ebfb4914ea5f7269e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:23.937803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:24.195402 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1404/2850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:24.205383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707acc-3286-4a84-8b92-ce8b959124c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:24.206535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707acc-3286-4a84-8b92-ce8b959124c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:24.206535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25707acc-3286-4a84-8b92-ce8b959124c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:24.252331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-25707acc-3286-4a84-8b92-ce8b959124c0 None None] MFA Rules not processed for user `d31742926f754ebfb4914ea5f7269e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:24.256379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-25707acc-3286-4a84-8b92-ce8b959124c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:24.274970 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1447/2851] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:24.292855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:24.294632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:24.330488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d088-c896-4349-a0ca-25d8d7d83760 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:24.350309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:24.351311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:24.351788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:24.352529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:24.375211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:24.381530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:24.421623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1405/2852] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:09:28.883332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:28.884613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:28.885173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:28.918994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] MFA Rules not processed for user `e5a251b917b244a3b1f55bf9079ff5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:28.920718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:28.932267 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1448/2853] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:32.719288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:32.725209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:32.760014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012b1aa-5e25-4309-a7dc-a1a8ec4b436d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:32.769334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:32.770582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:32.771223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:32.771735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] PATH_INFO: `/v3/users/4debcc0bc2264da988d348a818838adb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:32.774565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4debcc0bc2264da988d348a818838adb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:32.779134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:32.911113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4debcc0bc2264da988d348a818838adb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:32.912828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4debcc0bc2264da988d348a818838adb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:32.934454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4debcc0bc2264da988d348a818838adb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:32.937813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4debcc0bc2264da988d348a818838adb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:32.982088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23bbd4c9-1c3a-4beb-8b18-0ee723e16df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4debcc0bc2264da988d348a818838adb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.060608 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1406/2854] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:09:32 2022] DELETE /identity/v3/users/4debcc0bc2264da988d348a818838adb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:33.402718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:33.432513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecd580-6842-4d8f-8dda-611141d48d4f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:33.556927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:33.558207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:33.558814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:33.559383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] PATH_INFO: `/v3/projects/657fa7d919794871afefb189abc7e337` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:33.561307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=657fa7d919794871afefb189abc7e337)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:33.563789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:33.706896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657fa7d919794871afefb189abc7e337', 'request_id': 'req-06d80908-fe53-4021-b1d9-e55307a4bb8e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.735741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657fa7d919794871afefb189abc7e337', 'request_id': 'req-06d80908-fe53-4021-b1d9-e55307a4bb8e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.762641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657fa7d919794871afefb189abc7e337', 'request_id': 'req-06d80908-fe53-4021-b1d9-e55307a4bb8e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.802013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] The token cache is being invalidate because project 657fa7d919794871afefb189abc7e337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:09:33.802670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.805188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-06d80908-fe53-4021-b1d9-e55307a4bb8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:09:33.811199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1449/2855] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:09:33 2022] DELETE /identity/v3/projects/657fa7d919794871afefb189abc7e337 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:33.818897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:33.819731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:33.819731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:33.879496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:33.880802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:34.011645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:34.084107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1407/2856] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:34.086197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.087115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.087927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.134659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:34.136217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:34.155043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1450/2857] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:09:34.157196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.171233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226476-8a97-44ab-a231-8f98c8fe43e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.185719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.187417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.188024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.188549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.189467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:09:34.190745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.192713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.232647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1408/2858] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:09:34.233451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.250870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f29f2-44b5-4a96-b257-42193086ffe4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.280456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.281913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.282195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.282506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.283181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.285509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.402990 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1451/2859] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:09:34 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:09:34.404766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.444271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92abde-6d69-417a-ac6c-2187729b0ca6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.610991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.611805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.612193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.612805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.613767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.619334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.665721 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1409/2860] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:09:34 2022] POST /identity/v3/users => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:09:34.669807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.693607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2444b9-6712-4342-8b80-cedd32d8e60c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.704973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.707303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.709383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.709909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.711500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.729971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.755508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1452/2861] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:09:34.760344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.786619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf928eb-3b19-4386-8d52-8aaf761a910d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.801742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.802371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.802657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.802923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.803573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.809348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9890c-1da1-4c00-9709-5706fab5c220 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.828755 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1410/2862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:09:34.834119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:34.846505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb078e-c61f-4d1a-b925-7087fe4e8183 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:34.880942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:34.886711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:34.887768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:34.889538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] PATH_INFO: `/v3/projects/7a79243f5bfd49b3b5dde98a5e969459/users/98a48155bd2d48f9b1f7db3f6807a213/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:34.959322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a79243f5bfd49b3b5dde98a5e969459, user_id=98a48155bd2d48f9b1f7db3f6807a213, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:34.967992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40d9a3-bcec-4eec-8d19-fe56a9222ce1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:34.994340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1453/2863] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:09:34 2022] PUT /identity/v3/projects/7a79243f5bfd49b3b5dde98a5e969459/users/98a48155bd2d48f9b1f7db3f6807a213/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:09:35.000298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:35.000589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:35.001116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:35.074797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:35.085605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:35.085964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:35.086234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:35.091959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:35.149463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:35.158810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:35.192920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:35.252829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1411/2864] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:35.290476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:35.292084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:35.329241 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1454/2865] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:09:35.354615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:35.356127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:35.506706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:35.537957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870a648-4296-47d7-94cd-d6f4f76ed170 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:35.542459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff06a-3500-40f0-b540-7464ae12a17d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:35.550796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:35.551439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:35.551596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:35.551926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:35.553119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:35.554379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:35.554904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:35.555679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:35.564347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:35.573374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4724895-28fe-48dc-ae7a-f5de63dc7590 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:35.575646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:35.579080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:35.594553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1455/2866] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:09:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:09:35.607356 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1412/2867] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:09:45.580536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=51 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:45.592732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:09:49.172395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df66b-2f19-4257-9f48-f781091cbd38 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:49.172844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df66b-2f19-4257-9f48-f781091cbd38 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:49.172912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df66b-2f19-4257-9f48-f781091cbd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:49.212103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-134df66b-2f19-4257-9f48-f781091cbd38 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:49.214146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-134df66b-2f19-4257-9f48-f781091cbd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:49.256769 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1456/2868] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:49.376541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:49.401011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c4f3-c3a4-45e4-856a-7214b14785d1 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:49.414637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:49.415905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:49.416253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:49.416542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:49.441372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:49.443173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:49.473432 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1413/2869] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:51.943585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c46f-27f6-4f1f-86da-a54f88fb6ac0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:51.945023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c46f-27f6-4f1f-86da-a54f88fb6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:51.945608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c46f-27f6-4f1f-86da-a54f88fb6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:51.977548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e237c46f-27f6-4f1f-86da-a54f88fb6ac0 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:51.979482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e237c46f-27f6-4f1f-86da-a54f88fb6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:51.995055 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1457/2870] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:52.028754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:52.047717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca88e-5d7f-4f74-b0c7-e82e004c0451 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:52.056819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:52.059184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:52.059957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:52.060428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:52.072342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:52.074563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:52.093682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1414/2871] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:09:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:54.021527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f648f24-ddae-4da5-b62b-11e93823f147 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:54.022818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f648f24-ddae-4da5-b62b-11e93823f147 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:54.022818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f648f24-ddae-4da5-b62b-11e93823f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:54.070821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f648f24-ddae-4da5-b62b-11e93823f147 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:54.072063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f648f24-ddae-4da5-b62b-11e93823f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:54.098934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1458/2872] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:09:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:54.140625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:54.166054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036a2bb-8163-4d4b-b32c-8167badda11d service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:54.182393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:54.183200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:54.183674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:54.183945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:54.211824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:54.214093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:54.230394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1415/2873] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:09:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:09:56.117046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:56.117589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:56.117589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:56.234066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] MFA Rules not processed for user `98a48155bd2d48f9b1f7db3f6807a213`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:09:56.239668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:56.447951 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1459/2874] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:09:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:09:56.463961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:09:56.465894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:09:56.600255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ff2fe-d281-4440-99da-727988cff019 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:09:56.608973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:09:56.610203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:09:56.610757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:09:56.613569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:09:56.627458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:09:56.642269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:09:56.673266 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1416/2875] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:06.440234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=41 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:06.658433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=52 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:10.243762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:10.268397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4168e-d628-4613-b287-6598f7c8f3c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:10.274731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:10.275690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:10.276958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:10.277451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] PATH_INFO: `/v3/users/98a48155bd2d48f9b1f7db3f6807a213` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:10.279210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a48155bd2d48f9b1f7db3f6807a213)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:10.282124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:10.410009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a48155bd2d48f9b1f7db3f6807a213'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:10.444618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a48155bd2d48f9b1f7db3f6807a213'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:10.445510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a48155bd2d48f9b1f7db3f6807a213'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:10.469571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a48155bd2d48f9b1f7db3f6807a213'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:10.470742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5e909a80-4987-4656-ae94-de60e8e6e40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a48155bd2d48f9b1f7db3f6807a213'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:10.518281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1460/2876] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:10:10 2022] DELETE /identity/v3/users/98a48155bd2d48f9b1f7db3f6807a213 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:10.885137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:10.899656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7dc95-107f-4a31-bf9f-e08ed3d882e0 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.049112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.050005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.050812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.051141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] PATH_INFO: `/v3/projects/7a79243f5bfd49b3b5dde98a5e969459` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.052341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a79243f5bfd49b3b5dde98a5e969459)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.054266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.111541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a79243f5bfd49b3b5dde98a5e969459', 'request_id': 'req-776ff6bd-0360-490b-b72c-6378245c8168'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:11.121278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a79243f5bfd49b3b5dde98a5e969459', 'request_id': 'req-776ff6bd-0360-490b-b72c-6378245c8168'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:11.129899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a79243f5bfd49b3b5dde98a5e969459', 'request_id': 'req-776ff6bd-0360-490b-b72c-6378245c8168'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:11.141282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] The token cache is being invalidate because project 7a79243f5bfd49b3b5dde98a5e969459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:10:11.141620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:11.142304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-776ff6bd-0360-490b-b72c-6378245c8168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:11.144260 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1417/2877] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:10:10 2022] DELETE /identity/v3/projects/7a79243f5bfd49b3b5dde98a5e969459 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:11.148963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.149271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.149565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.170665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:11.171946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:11.259281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1461/2878] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:11.262787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.263141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.263642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.289811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:11.291649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:11.304747 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1418/2879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:11.305413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.320511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8b9a-6093-4c63-8655-506309af57cb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.330635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.331749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.332262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.332859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.334909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:10:11.335530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.352282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.399387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.406194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1462/2880] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:10:11.411280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598903f-7d1e-4821-8fb2-f94eb7badbc8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.416456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.417305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.417787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.418299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.419326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.422081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.480198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.480721 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1419/2881] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:10:11 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:11.504847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca350aef-1564-4763-b899-372ef14ca578 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.610680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.614157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.614682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.615173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.616046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.618487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.630777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:11.671483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1463/2882] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:10:11 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:11.676119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.692689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1955-933f-4068-8e32-5ba05cbecb1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.706050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.706996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.707272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.707698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.708372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.710017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.735212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1420/2883] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:11.740316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.755032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb0c76-1df1-4394-bde6-4d12ddaa8dcb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.769686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.772822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.773207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.773798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.776379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.783221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5615-492a-40d8-8ec6-29b21bc6c4de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.805194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1464/2884] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:11.813194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:11.850459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b821b-5e99-42c6-9d6d-fca0f0a1ae92 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:11.874842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:11.875547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.875825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.876097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] PATH_INFO: `/v3/projects/24dd02df7fd44c1fbe5df55e6ccde4ee/users/c2a4c2cd88304000a7277caf5bb29ed6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.919715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dd02df7fd44c1fbe5df55e6ccde4ee, user_id=c2a4c2cd88304000a7277caf5bb29ed6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:11.925543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:11.958079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1421/2885] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:10:11 2022] PUT /identity/v3/projects/24dd02df7fd44c1fbe5df55e6ccde4ee/users/c2a4c2cd88304000a7277caf5bb29ed6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:11.965026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c74a-122e-4c29-92cb-59b719b5f996 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:11.965440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c74a-122e-4c29-92cb-59b719b5f996 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:11.965725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c74a-122e-4c29-92cb-59b719b5f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:11.997895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b5b8c74a-122e-4c29-92cb-59b719b5f996 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:11.999136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5b8c74a-122e-4c29-92cb-59b719b5f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:12.078131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1465/2886] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:12.088845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:12.090715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:12.189266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:12.246597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647370-d05c-4a71-b8e3-11a20ea971d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:12.250520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:12.251238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:12.251647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:12.252003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:12.261862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:12.263434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:12.275002 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1422/2887] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:13.509872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e24f-2dd9-4160-bbda-6048d92e3af7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:13.510435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e24f-2dd9-4160-bbda-6048d92e3af7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:13.510435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3e24f-2dd9-4160-bbda-6048d92e3af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:13.553671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4a3e24f-2dd9-4160-bbda-6048d92e3af7 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:13.558772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4a3e24f-2dd9-4160-bbda-6048d92e3af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:13.714128 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1466/2888] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:10:13.740943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:13.742428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:13.846401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbae87-2ee5-472e-a63f-916b4eea680a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:13.855364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:13.856228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:13.856688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:13.857743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:13.870856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:13.873847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:13.920530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1423/2889] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:10:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:14.171439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e89e-daac-4aed-9681-4eb5f2881097 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:14.171784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e89e-daac-4aed-9681-4eb5f2881097 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:14.171986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e89e-daac-4aed-9681-4eb5f2881097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:14.209439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e691e89e-daac-4aed-9681-4eb5f2881097 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:14.213456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e691e89e-daac-4aed-9681-4eb5f2881097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:14.235267 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1467/2890] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:14.250151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:14.269965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8960d0-401d-4f6e-a7d7-df670d59f33c service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:14.287554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:14.287554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:14.288125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:14.288248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:14.319030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:14.326202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:14.383530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1424/2891] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:10:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:14.989323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:14.989809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:14.989902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:15.026716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:15.028102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:15.045776 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1468/2892] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:15.062036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:15.086554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339e171-63c3-4bf2-84ce-0e75975bd102 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:15.102031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:15.102665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:15.102940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:15.103209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:15.147066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:15.148736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372c3f-672d-40cc-82ac-b6ca93c526e9 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:15.180591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1425/2893] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:15.338465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:15.339891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:15.367265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280202c-c585-43e7-a5e5-871e0822520f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:15.374115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:15.375730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:15.376198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:15.377290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] PATH_INFO: `/v3/users/04fd432bad6740efad5a96720455b658` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:15.379167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fd432bad6740efad5a96720455b658)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:15.381718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:15.466873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fd432bad6740efad5a96720455b658'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:15.480816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fd432bad6740efad5a96720455b658'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:15.482162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fd432bad6740efad5a96720455b658'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:15.500806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fd432bad6740efad5a96720455b658'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:15.503247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fd432bad6740efad5a96720455b658'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:15.512068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:15.553893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:15.553893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:15.554031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:15.556887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1469/2894] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:10:15 2022] DELETE /identity/v3/users/04fd432bad6740efad5a96720455b658 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:15.578177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:15.579413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:15.702272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:15.704572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:15.715140 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1426/2895] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:15.862851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f6ca0-8141-48bf-ace5-8530a3342ab3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:15.883541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:15.893280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:15.893827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:15.894598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:15.929579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:15.931033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41278640-577d-41f0-8863-4a8293707c51 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:15.963737 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1470/2896] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:17.124566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:17.128482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:17.149866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ea2d-9b85-4e2d-8c78-f629dee2d598 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:17.159592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:17.160586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:17.160967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:17.161282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] PATH_INFO: `/v3/projects/11cf155786464a64826aadc055af9032` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:17.166841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] RBAC: Authorizing `identity:delete_project(project_id=11cf155786464a64826aadc055af9032)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:17.169216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:17.239629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:17.283003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11cf155786464a64826aadc055af9032', 'request_id': 'req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:17.304948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11cf155786464a64826aadc055af9032', 'request_id': 'req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:17.318803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11cf155786464a64826aadc055af9032', 'request_id': 'req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:17.385425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] The token cache is being invalidate because project 11cf155786464a64826aadc055af9032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:10:17.385762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:17.389558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f735bf85-2e07-4dfe-bb9d-fd80d6f557af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:17.396678 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1427/2897] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:10:17 2022] DELETE /identity/v3/projects/11cf155786464a64826aadc055af9032 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:17.398192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:17.399717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:17.399717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:17.446999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:17.452261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:17.738917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1471/2898] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:10:17.757020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:17.757020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:17.757020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:17.826202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:17.837449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:17.880373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1428/2899] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:17.884575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:17.900667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a3445-3bef-4b75-b723-81260d2dd62b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:17.917020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:17.917748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:17.918028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:17.918301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:17.918969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:10:17.919271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:17.924202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bade5-e78e-440d-8382-7bad042b5c30 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:17.960298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1472/2900] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:10:17.961518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:17.982335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a435df-c37c-4198-99c9-d6c960aa2f27 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:17.999438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.000545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.003349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.004787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.006091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.010485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.061298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.061640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.061854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.078060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1429/2901] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:10:17 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:10:18.082876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:18.123661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:18.124915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:18.244885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e95e12-5be1-4fb8-9ebb-d76682a0783e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:18.259530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.260177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.260453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.260724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.261875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.266565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.330962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1430/2902] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:10:18 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:18.335120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:18.356229 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1473/2903] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:18.361427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a405b-b716-4964-9b7f-2e02d455d28f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:18.370871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:18.372286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:18.373870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.377382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.378077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.379609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.381093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.384536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.416742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1431/2904] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:18.419762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:18.437046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:18.449496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd02ffb-8b1f-4c31-a423-beb7a45c8411 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:18.463837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.465635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.467315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.467785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.469466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.472365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.519435 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1432/2905] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:18.521307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:18.543396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0727dc-ee2c-444b-89e8-6b355f2a4231 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:18.558410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.559087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.559364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.559639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] PATH_INFO: `/v3/projects/928e0ad2ecb0472e803ba558d5363066/users/36791ce9742b4eb59f71146237cb6953/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.597889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=928e0ad2ecb0472e803ba558d5363066, user_id=36791ce9742b4eb59f71146237cb6953, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.604365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78346-13a0-4f2b-ae87-3741b9ea012b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:18.606992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa9ec-2fc7-41f3-911f-9c4c2e289efb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.617790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:18.618674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.619120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.619550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.645890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1433/2906] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:10:18 2022] PUT /identity/v3/projects/928e0ad2ecb0472e803ba558d5363066/users/36791ce9742b4eb59f71146237cb6953/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:18.648512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:18.648948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:18.649401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:18.657492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:18.663239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:18.690261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1474/2907] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:10:18.726581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] MFA Rules not processed for user `36791ce9742b4eb59f71146237cb6953`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:18.727839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:18.780426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:19.018776 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1434/2908] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:19.365136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:19.366847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:19.620557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181149a1-f665-46eb-b62e-53afc90bffce service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:19.842033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:19.843189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:19.843666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:19.844201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:19.864766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:19.869662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39047bb-0b5e-4000-a643-d5bd8aaaac3e service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:19.916774 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1475/2909] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:20.077861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:20.336772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556adf-9b12-4e5e-a3f7-92b2031be105 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:20.362360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:20.363018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:20.363291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:20.363560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] PATH_INFO: `/v3/users/36791ce9742b4eb59f71146237cb6953` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:20.368115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36791ce9742b4eb59f71146237cb6953)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:20.370223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:20.532222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36791ce9742b4eb59f71146237cb6953'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:20.534160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36791ce9742b4eb59f71146237cb6953'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:20.568940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36791ce9742b4eb59f71146237cb6953'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:20.570016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36791ce9742b4eb59f71146237cb6953'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:20.588535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36791ce9742b4eb59f71146237cb6953'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:20.644976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1435/2910] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:10:20 2022] DELETE /identity/v3/users/36791ce9742b4eb59f71146237cb6953 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:20.647467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:20.647939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:20.648196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:20.709357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:20.712202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:20.822495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:20.922864 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1476/2911] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:20.923928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:20.925835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:21.096297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:21.144316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f5392-dfd4-4198-8b59-9cea019674b6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:21.158500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:21.159120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:21.160563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:21.160563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:21.194129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:21.198410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265457a-dbe9-43a7-8636-1f9b73397ef6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:21.242004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1436/2912] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:22.252791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:22.254623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:22.296865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1771daf-7b5d-4a5d-965f-829ee45a1418 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:22.310387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:22.311066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:22.311368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:22.311713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] PATH_INFO: `/v3/projects/928e0ad2ecb0472e803ba558d5363066` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:22.313570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928e0ad2ecb0472e803ba558d5363066)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:22.325916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:22.467493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928e0ad2ecb0472e803ba558d5363066', 'request_id': 'req-d71e3c4e-83ee-4a24-9223-08c49bf80b85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:22.477628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928e0ad2ecb0472e803ba558d5363066', 'request_id': 'req-d71e3c4e-83ee-4a24-9223-08c49bf80b85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:22.499926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928e0ad2ecb0472e803ba558d5363066', 'request_id': 'req-d71e3c4e-83ee-4a24-9223-08c49bf80b85'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:22.554654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] The token cache is being invalidate because project 928e0ad2ecb0472e803ba558d5363066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:10:22.555442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:22.556869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d71e3c4e-83ee-4a24-9223-08c49bf80b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:22.559434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1477/2913] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:10:22 2022] DELETE /identity/v3/projects/928e0ad2ecb0472e803ba558d5363066 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:22.565086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:22.565755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:22.565755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:22.609418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:22.610690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:22.775930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1437/2914] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:22.784518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:22.784803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:22.785100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:22.826583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:22.828485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:22.854164 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1478/2915] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:22.855121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:22.876724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168650-b0c4-48d5-a767-e127ffb30dae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:22.883669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:22.884424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:22.884812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:22.885211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:22.885960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:10:22.886368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:22.888040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:22.911537 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1438/2916] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:10:22.916016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:22.943465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cc652-aa24-4351-a325-acb406e5a8a4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:22.964951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:22.966327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:22.967551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:22.969633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:22.971236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:22.978066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:23.061120 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1479/2917] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:10:22 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:23.065637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:23.080678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee42719-bb45-4d87-87c1-d7557ad5f73e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:23.272442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:23.273299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:23.273572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:23.274985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:23.275648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:23.279595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:23.366735 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1439/2918] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:10:23 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:23.370609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:23.400939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52c32e-40fd-47f7-8d3a-2fa5c918480c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:23.408316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:23.409215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:23.409680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:23.410108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:23.410926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:23.414516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:23.442418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1480/2919] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:23.444427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:23.475284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3e68-09cd-4c1a-859c-cf6cf7808d1f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:23.503694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:23.504332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:23.504612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:23.504887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:23.509515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:23.511155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f9678-5a41-43ff-904c-3557a08fe22c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:23.564549 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1440/2920] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:23.565938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:23.585239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fdd48-7674-43c6-ae27-0dac16a2cbb6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:23.601426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:23.602458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:23.603130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:23.603551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] PATH_INFO: `/v3/projects/5daf1d849d91426d94f338ed22af5f9a/users/16bd1444400e47de84f0c1c15cc42c66/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:23.649590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5daf1d849d91426d94f338ed22af5f9a, user_id=16bd1444400e47de84f0c1c15cc42c66, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:23.682353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:23.721618 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1481/2921] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:10:23 2022] PUT /identity/v3/projects/5daf1d849d91426d94f338ed22af5f9a/users/16bd1444400e47de84f0c1c15cc42c66/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:23.726683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc480ff-3036-48aa-bd42-fcce18b23c33 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:23.727171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc480ff-3036-48aa-bd42-fcce18b23c33 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:23.727351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc480ff-3036-48aa-bd42-fcce18b23c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:23.766620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dbc480ff-3036-48aa-bd42-fcce18b23c33 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:23.768968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbc480ff-3036-48aa-bd42-fcce18b23c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:23.877558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:23.905076 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1441/2922] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:23.913807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:23.915453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:24.077057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2462d-719b-47b1-bf3f-9b3d266efe03 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:24.082825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:24.083259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:24.083534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:24.083801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:24.105839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:24.119542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:24.123570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:24.149935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1482/2923] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:28.234454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d38ad-7341-4cbb-aa8d-4a01ea4a2f02 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:28.235026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d38ad-7341-4cbb-aa8d-4a01ea4a2f02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:28.235026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d38ad-7341-4cbb-aa8d-4a01ea4a2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:28.344446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3f7d38ad-7341-4cbb-aa8d-4a01ea4a2f02 None None] MFA Rules not processed for user `c2a4c2cd88304000a7277caf5bb29ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:28.351557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f7d38ad-7341-4cbb-aa8d-4a01ea4a2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:28.647216 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1442/2924] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:28.871965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:28.873582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:29.084052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936119f2-c06c-411f-a579-30486f33207b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:29.096695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:29.097901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:29.097901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:29.098053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:29.114128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:29.117042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:29.159959 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1483/2925] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:30.249216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:30.250220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:30.250991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:30.324938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] MFA Rules not processed for user `c2a4c2cd88304000a7277caf5bb29ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:30.326344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:30.343455 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1443/2926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:32.023316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:32.025451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:32.046234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533794d4-c1fc-4918-8a72-f975f203f941 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:32.056616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:32.057494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:32.057910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:32.058340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:32.062009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:32.086510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:32.088194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58229d4-0a3d-4d88-a680-12192c01ca8b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:32.102301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1484/2927] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:32.189465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:32.202194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495bca9-188c-46cc-9196-fb36c8df54ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:32.210460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:32.214402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:32.215322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:32.216101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:32.221897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:32.248398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:32.250826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79079912-37fa-4b3c-a9ea-581f3761ce78 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:32.265261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1444/2928] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:32.468600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ea43-9694-4366-9ca2-17c0030f3a4f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:32.471571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ea43-9694-4366-9ca2-17c0030f3a4f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:32.472080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406ea43-9694-4366-9ca2-17c0030f3a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:32.526772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2406ea43-9694-4366-9ca2-17c0030f3a4f None None] MFA Rules not processed for user `b7d816c3043c435d8bf79d2c819518ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:32.529308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2406ea43-9694-4366-9ca2-17c0030f3a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:32.802535 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1485/2929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:38.686563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:38.687081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:38.687197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:38.732181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] MFA Rules not processed for user `d31742926f754ebfb4914ea5f7269e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:38.733632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:38.902471 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1445/2930] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:39.013519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:39.014048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:39.014292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:39.128912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] MFA Rules not processed for user `16bd1444400e47de84f0c1c15cc42c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:39.130309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:39.322882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:39.345799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1486/2931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:39.348471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:39.365473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286a2c1-9e82-4c4f-863d-687dac5ee66a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:39.371600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:39.372606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:39.373284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:39.373804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:39.375268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:39.379332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:39.514117 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1446/2932] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:10:39 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:39.514927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:39.539916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98250-9375-4507-8381-f6e5481774e9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:39.742896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:39.743906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:39.744578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:39.745088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:39.746036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:39.748731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:39.823157 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1487/2933] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:10:39 2022] POST /identity/v3/users => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:10:39.826545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:39.872163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1fd0f-e245-46b0-88b8-406580d30679 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:39.896568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:39.897565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:39.900542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:39.901091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:39.904654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:39.907761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:39.984530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1447/2934] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:39.985949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:40.000630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fc648-8161-40c2-8210-8a3678b7e3ed admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:40.014654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:40.015359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:40.015611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:40.015882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] PATH_INFO: `/v3/projects/788b1946c0ce47939d50754a85309241/users/d0b9fb48d25e4d31bf1138664582b086/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:40.055837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788b1946c0ce47939d50754a85309241, user_id=d0b9fb48d25e4d31bf1138664582b086, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:40.062701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:40.099075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1488/2935] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:10:39 2022] PUT /identity/v3/projects/788b1946c0ce47939d50754a85309241/users/d0b9fb48d25e4d31bf1138664582b086/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:40.103052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:40.124353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c8549-3ae2-4bbf-b7da-2d448e5afbd5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:40.186475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:40.339294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:40.341715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:40.342864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:40.344130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:40.346794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:40.353670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:40.419891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:40.420825 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1448/2936] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:10:40.440506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75433-27c1-412b-95f4-40906a91d3f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:40.454980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:40.456477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:40.456771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:40.457174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] PATH_INFO: `/v3/projects/788b1946c0ce47939d50754a85309241/users/d0b9fb48d25e4d31bf1138664582b086/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:40.459912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788b1946c0ce47939d50754a85309241, user_id=d0b9fb48d25e4d31bf1138664582b086, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:40.462918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:40.517567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1489/2937] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:10:40 2022] PUT /identity/v3/projects/788b1946c0ce47939d50754a85309241/users/d0b9fb48d25e4d31bf1138664582b086/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:10:43.530826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:43.749971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2bf92-a372-4240-abf2-d0c7d130c219 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:43.987657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:43.989768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:43.990219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:43.993353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:43.999383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:44.243068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:44.244729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:44.291722 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1449/2938] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:46.355751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:46.402367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc3edb-284d-4588-bea6-1579bb1416e1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:46.501756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:46.506001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:46.511030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:46.511582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:46.521294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:46.545377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:46.548823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc64f88-5737-417d-b672-e660f10244e1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:46.575350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1490/2939] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:54.261246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:54.542823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:54.544276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:54.690390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abd848-5607-461e-9826-8f18c57a9cf5 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:54.694670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:54.695319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:54.695590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:54.695857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] PATH_INFO: `/v3/users/e5a251b917b244a3b1f55bf9079ff5ef` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:54.697178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a251b917b244a3b1f55bf9079ff5ef)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:54.699824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:54.790472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a251b917b244a3b1f55bf9079ff5ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:54.791147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a251b917b244a3b1f55bf9079ff5ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:54.802361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a251b917b244a3b1f55bf9079ff5ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:54.803242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a251b917b244a3b1f55bf9079ff5ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:54.816120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a251b917b244a3b1f55bf9079ff5ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:54.847073 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1450/2940] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:10:54 2022] DELETE /identity/v3/users/e5a251b917b244a3b1f55bf9079ff5ef => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:54.852532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:54.853178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:54.853270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:54.885287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:54.886486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:55.010858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1491/2941] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:55.023846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:55.026103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:55.124315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f6d0-3cf9-4161-883c-18de0b7670f5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:55.129313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:55.130057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:55.130226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:55.130501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:55.143639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:55.146382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:55.195090 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1451/2942] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:55.545259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:55.546890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:55.568684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fc8b5-2cdf-4ccd-ac77-18e447c5d335 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:55.582443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:55.583194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:55.583539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:55.583883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:55.585977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:55.599084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:55.605796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75299-2e90-40cf-9318-8a4c4a44263d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:55.630418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1492/2943] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:10:56.291744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:56.293666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:56.329803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621bc8e-e6b2-41e6-9283-a28dfba32800 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:56.361336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:56.362334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:56.362793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:56.363287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] PATH_INFO: `/v3/projects/a0d47fbb4e9040039f2ae5153fe6bbbe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:56.386142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d47fbb4e9040039f2ae5153fe6bbbe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:56.403061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:56.489039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:56.491419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:56.493386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:56.505210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:56.593773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'request_id': 'req-31d84b7b-81d3-4453-9627-d09d672f83f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:56.613862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'request_id': 'req-31d84b7b-81d3-4453-9627-d09d672f83f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:56.627167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d47fbb4e9040039f2ae5153fe6bbbe', 'request_id': 'req-31d84b7b-81d3-4453-9627-d09d672f83f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:56.638042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:56.672180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:56.677604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:56.689576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] The token cache is being invalidate because project a0d47fbb4e9040039f2ae5153fe6bbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:10:56.690100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:56.694782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:56.700061 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1452/2944] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:10:56 2022] DELETE /identity/v3/projects/a0d47fbb4e9040039f2ae5153fe6bbbe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:56.705145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:56.720697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:56.957490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1493/2945] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:10:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:56.985380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:56.996777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:57.007401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84b7b-81d3-4453-9627-d09d672f83f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:57.036472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:57.037179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:57.037458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:57.037732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] PATH_INFO: `/v3/users/d22baa0244de4755be177e8435b766a8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:57.047967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22baa0244de4755be177e8435b766a8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:57.050066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:57.166327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22baa0244de4755be177e8435b766a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:57.167228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22baa0244de4755be177e8435b766a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:57.193678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22baa0244de4755be177e8435b766a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:57.194718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22baa0244de4755be177e8435b766a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:57.214576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22baa0244de4755be177e8435b766a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:57.271514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1453/2946] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:10:56 2022] DELETE /identity/v3/users/d22baa0244de4755be177e8435b766a8 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:57.339222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46c474-3e1d-4398-aca0-7c6fc9de3b08 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:57.496538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:57.497266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:57.497625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:57.497937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:57.503403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:57.559505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:57.630876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:57.642359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:57.656890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1494/2947] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:10:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:10:58.910768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:58.912259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:58.974206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:59.035183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69da5c-9c36-4fef-ae4c-6e89af8684d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:59.040820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:59.041681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.042667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.043683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.046563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.169762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:59.172350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35e832-e0ad-43d7-bc34-648a3b5e80b0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:59.193276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:59.193946 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1454/2948] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:10:59.195004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.216022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cbee1-6b72-4b35-81ae-eb96de4e5a66 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:59.233278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:59.234573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.238515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.242325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] PATH_INFO: `/v3/projects/7082eecafe9f4fcea4322326db1c6c5e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.246207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7082eecafe9f4fcea4322326db1c6c5e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:59.258860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:59.419532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7082eecafe9f4fcea4322326db1c6c5e', 'request_id': 'req-fd7e01e8-a059-4391-8bfb-208e78ff8251'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:59.468811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7082eecafe9f4fcea4322326db1c6c5e', 'request_id': 'req-fd7e01e8-a059-4391-8bfb-208e78ff8251'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:59.490604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7082eecafe9f4fcea4322326db1c6c5e', 'request_id': 'req-fd7e01e8-a059-4391-8bfb-208e78ff8251'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:59.502162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.502583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.503014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.527690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] The token cache is being invalidate because project 7082eecafe9f4fcea4322326db1c6c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:10:59.528281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:59.530757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fd7e01e8-a059-4391-8bfb-208e78ff8251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:10:59.535479 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1495/2949] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:10:59 2022] DELETE /identity/v3/projects/7082eecafe9f4fcea4322326db1c6c5e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:10:59.541963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460edd-5a3f-4a63-bcd1-734b8a6623bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.542164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] MFA Rules not processed for user `d0b9fb48d25e4d31bf1138664582b086`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:59.542478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460edd-5a3f-4a63-bcd1-734b8a6623bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.543048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28460edd-5a3f-4a63-bcd1-734b8a6623bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.543265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.599901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28460edd-5a3f-4a63-bcd1-734b8a6623bb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:59.601406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28460edd-5a3f-4a63-bcd1-734b8a6623bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.658785 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1455/2950] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:59.670056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:59.675293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.698377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1496/2951] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:59.712703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.714689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.714689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.756936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:10:59.758538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.772813 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1497/2952] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:10:59.778318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:59.793677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb183d7a-5aa4-405d-bcb2-d60bfc77e248 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:59.804616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:59.807329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.807787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.808160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.809496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:10:59.810157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:59.815019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:59.852907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:10:59.862914 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1498/2953] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:10:59.868864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:59.883240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada8d80-4f53-4b12-b36d-a64cdd55e348 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:59.887837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02eedd-c74d-4818-bc2a-4580bde98870 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:10:59.888827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:59.889489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.889842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.890043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.890686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:10:59.893763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:10:59.896804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:10:59.897750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:10:59.898222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:10:59.898903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:10:59.901099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:10:59.954982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1499/2954] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:10:59 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:10:59.956525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:10:59.978323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:00.062501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.064135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.081820 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1456/2955] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:10:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:00.106587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b23cf-582a-4cce-bc55-8464230fbd70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:00.137835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:00.138824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.139354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.139779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.140844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.143652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.192526 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1500/2956] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:10:59 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:00.198539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:00.220327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a32db3-94c3-43d2-8390-0fcde803a84b service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:00.236641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:00.238300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.240194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.240983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.241934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.244329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.262772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1457/2957] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:00.268065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:00.282539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369750d-3a01-40bb-8656-aa0f0865d4b4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:00.288503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:00.289317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.289709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.290075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.291270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.293513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1d1ec-198e-4265-9a09-6dcb2e773b57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.317779 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1501/2958] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:00.321799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:00.340015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbed7e4-4fe2-4e55-8dc8-e1c58735c083 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:00.351279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:00.352123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.352545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.353184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] PATH_INFO: `/v3/projects/79c6b0ef46b449888af03e4a3756d5ba/users/f618899586f9415ebb18589fb9b25a3d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.375194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c6b0ef46b449888af03e4a3756d5ba, user_id=f618899586f9415ebb18589fb9b25a3d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.379297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.403724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1458/2959] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:00 2022] PUT /identity/v3/projects/79c6b0ef46b449888af03e4a3756d5ba/users/f618899586f9415ebb18589fb9b25a3d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:11:00.415516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.416194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.416530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.479336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] MFA Rules not processed for user `f618899586f9415ebb18589fb9b25a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:00.481111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:00.645991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1502/2960] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:00.722999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:00.725709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:00.889727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bd62a-9eba-47c2-86c5-60f047d5ac64 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:00.898255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:00.898881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:00.899155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:00.899423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:00.911684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:00.912708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:00.937361 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1459/2961] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:01.171738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:01.173404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:01.175944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:01.178892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:01.287318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:01.325706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1563c-f8d4-47d3-ab0c-f039b6318d7d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:01.336338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:01.337349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:01.337725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:01.338104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:01.342296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:01.351865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742910c-c97c-4030-b15a-954238f1c14b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:01.361776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:01.362388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:01.362674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:01.362948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:01.366617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:01.368306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:01.386401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:01.388126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758e09-08ea-43fa-95f5-f3f7713b115a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:01.394099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1460/2962] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:01.417711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1503/2963] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:01.658506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:01.866822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f365-9c6d-4a7c-816b-11635a52e56c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:01.877878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:01.879302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:01.879768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:01.880247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] PATH_INFO: `/v3/users/f618899586f9415ebb18589fb9b25a3d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:01.882939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f618899586f9415ebb18589fb9b25a3d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:01.885364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:02.003561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f618899586f9415ebb18589fb9b25a3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:02.005334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f618899586f9415ebb18589fb9b25a3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:02.021414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f618899586f9415ebb18589fb9b25a3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:02.023247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f618899586f9415ebb18589fb9b25a3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:02.041793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f618899586f9415ebb18589fb9b25a3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:02.082445 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1461/2964] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:01 2022] DELETE /identity/v3/users/f618899586f9415ebb18589fb9b25a3d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:02.088697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:02.089203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:02.089635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:02.130133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:02.141030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:02.185623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:02.322323 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1504/2965] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:02.343284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:02.353100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:02.523514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdef87-f039-4c80-8652-bbf1182b2356 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:02.536266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:02.537049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:02.537437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:02.537803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:02.552717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:02.555361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3597-d6a1-415a-8d21-3211dc8713c1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:02.568565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1462/2966] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:03.699741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:03.703348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:03.746045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58b1b3-a311-4fad-beb1-af06a80afd7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:03.759965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:03.762282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:03.762884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:03.763589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] PATH_INFO: `/v3/projects/79c6b0ef46b449888af03e4a3756d5ba` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:03.771996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c6b0ef46b449888af03e4a3756d5ba)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:03.778045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:03.925810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c6b0ef46b449888af03e4a3756d5ba', 'request_id': 'req-732d8112-6dbc-4203-adf8-19cba7b41108'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:03.950427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c6b0ef46b449888af03e4a3756d5ba', 'request_id': 'req-732d8112-6dbc-4203-adf8-19cba7b41108'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:03.966491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c6b0ef46b449888af03e4a3756d5ba', 'request_id': 'req-732d8112-6dbc-4203-adf8-19cba7b41108'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:04.007230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] The token cache is being invalidate because project 79c6b0ef46b449888af03e4a3756d5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:04.009836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:04.011115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-732d8112-6dbc-4203-adf8-19cba7b41108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:04.013447 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1505/2967] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:03 2022] DELETE /identity/v3/projects/79c6b0ef46b449888af03e4a3756d5ba => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:04.018957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.019537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.019537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.058567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:04.061089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:04.077174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:04.212022 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1463/2968] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:04.221020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.221811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.222240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.254195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:04.256265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:04.269194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1506/2969] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:04.274902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.293049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec5b55-137f-4aab-a4cd-9dd4ea00ab15 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.303579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.305671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.306387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.307176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.308101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:04.309042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:04.311055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:04.332208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1464/2970] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:04.337516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.373210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf99fa-faca-464f-b0f1-08ccefba5957 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.381456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.382546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.383044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.384024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.389308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:04.400765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:04.450514 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1507/2971] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:04 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:04.454940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.481930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a293e-da3f-40fb-802c-01f47936e4a1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.640518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.641766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.644412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.645070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.647923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:04.655362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:04.743167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1465/2972] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:04 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:04.744644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.772087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d93ba7-2e88-4192-951b-1fc10583ecf5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.804839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.807128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.808795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.809667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.812341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:04.816262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:04.856398 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1508/2973] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:04.859634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.883456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e552c39-31a2-40b6-bc59-4def68a24c7b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.902592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.908495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.910596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.913377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:04.916781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:04.920172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2fc1b-f261-4a2d-912d-32bf3281f8e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:04.955971 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1466/2974] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:04.957191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:04.981505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42972-8396-49ff-b8ba-503017df0eb3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:04.993623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:04.994497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:04.996889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:04.997393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] PATH_INFO: `/v3/projects/5cd24deb7dd84cb3a71c02d7889b7441/users/c48e6a4f0f804838bad44a786e2bcedf/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:05.038912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd24deb7dd84cb3a71c02d7889b7441, user_id=c48e6a4f0f804838bad44a786e2bcedf, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:05.044962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:05.069246 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1509/2975] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:04 2022] PUT /identity/v3/projects/5cd24deb7dd84cb3a71c02d7889b7441/users/c48e6a4f0f804838bad44a786e2bcedf/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:05.084569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:05.085163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:05.089601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:05.207336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] MFA Rules not processed for user `c48e6a4f0f804838bad44a786e2bcedf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:05.211211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:05.473924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1467/2976] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:06.034906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:06.038214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:06.157551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:06.239194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb6cf-5710-47f5-9a72-9e5e4c380f59 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:06.253212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:06.255052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:06.255339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:06.257928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:06.283042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:06.290569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:06.319425 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1510/2977] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:06.383550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:06.393324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:06.511045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:06.513573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:06.548257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143585a-6ac6-4707-bf6e-d80cbcad70af service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:06.576376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:06.577740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:06.580307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:06.580762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:06.591478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:06.608383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aa8ac-b0ee-47fc-8623-5d0cd2540514 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:06.623924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:06.632640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:06.634002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:06.634392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] PATH_INFO: `/v3/users/c48e6a4f0f804838bad44a786e2bcedf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:06.635568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:06.637949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48e6a4f0f804838bad44a786e2bcedf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:06.644254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:06.645980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c47f-4cbe-4798-a2d8-8a966a0d7783 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:06.689801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1511/2978] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:11:06.761974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48e6a4f0f804838bad44a786e2bcedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:06.764071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48e6a4f0f804838bad44a786e2bcedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:06.784085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48e6a4f0f804838bad44a786e2bcedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:06.785797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48e6a4f0f804838bad44a786e2bcedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:06.808713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48e6a4f0f804838bad44a786e2bcedf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:06.868869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1468/2979] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:06 2022] DELETE /identity/v3/users/c48e6a4f0f804838bad44a786e2bcedf => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:06.872755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:06.873343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:06.873726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:06.925803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:06.927492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:07.109194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1512/2980] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:07.171313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:07.174014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:07.361022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac70f2-9330-429b-8353-4c13260710ee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:07.368781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:07.370693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:07.370693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:07.370693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:07.385906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:07.388213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153504c-e613-450c-aa63-583391e69032 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:07.432973 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1469/2981] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:08.292760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:08.294233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:08.318055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2a74d-e27b-4077-b73f-362b2060b8b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:08.335766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079728-6618-464b-9d65-91966ce493bb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.336519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079728-6618-464b-9d65-91966ce493bb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.337055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05079728-6618-464b-9d65-91966ce493bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.342406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:08.343268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.343711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.343985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] PATH_INFO: `/v3/projects/5cd24deb7dd84cb3a71c02d7889b7441` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.345217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd24deb7dd84cb3a71c02d7889b7441)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:08.347123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:08.401196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05079728-6618-464b-9d65-91966ce493bb None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:08.418742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05079728-6618-464b-9d65-91966ce493bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:08.461575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd24deb7dd84cb3a71c02d7889b7441', 'request_id': 'req-eb16b359-b76e-4b37-a3c6-bacc04eddc06'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:08.475014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd24deb7dd84cb3a71c02d7889b7441', 'request_id': 'req-eb16b359-b76e-4b37-a3c6-bacc04eddc06'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:08.478795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:08.491153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd24deb7dd84cb3a71c02d7889b7441', 'request_id': 'req-eb16b359-b76e-4b37-a3c6-bacc04eddc06'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:08.513751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] The token cache is being invalidate because project 5cd24deb7dd84cb3a71c02d7889b7441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:08.514157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:08.521510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb16b359-b76e-4b37-a3c6-bacc04eddc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:08.523988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1513/2982] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:08 2022] DELETE /identity/v3/projects/5cd24deb7dd84cb3a71c02d7889b7441 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:08.531363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479431-bddc-4e0b-8767-ce1ee8bff0da None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.532102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479431-bddc-4e0b-8767-ce1ee8bff0da None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.533210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77479431-bddc-4e0b-8767-ce1ee8bff0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.552596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1470/2983] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:11:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 18 16:11:08.560025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079728-6618-464b-9d65-91966ce493bb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:08.561768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05079728-6618-464b-9d65-91966ce493bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:08.569883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-77479431-bddc-4e0b-8767-ce1ee8bff0da None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:08.571621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77479431-bddc-4e0b-8767-ce1ee8bff0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:08.677047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:08.727019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05079728-6618-464b-9d65-91966ce493bb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:08.746707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:08.747442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.747787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.748148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.775109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:08.777206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:08.783019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1514/2984] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:08.790096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.790471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.790743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.798051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1471/2985] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:11:08.855710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:08.857022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:08.883227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1515/2986] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:11:08.889186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:08.906239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd59c6-7d43-48ab-947c-dfa1c1f95adf service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:08.920209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:08.920845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:08.921156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:08.921425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:08.924044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:08.924453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:08.928015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:08.975785 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1472/2987] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:08.989411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.015711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f981a-b0a8-420d-a428-ab3290d8562a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.037684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.037684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.038212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.038482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.038909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.040842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.086200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.088865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:09.108501 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1516/2988] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:08 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:09.112838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.265665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e5759-d663-4754-9ad6-4ce3476daa15 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.276670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283f11-59f8-4f33-94e6-7e81f9e9a0e2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.280973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.284303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.284303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.284303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.284303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.286613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.338463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1517/2989] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:09 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:09.342250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.364392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b343c-03ae-43ef-98cc-1ea0cfa54441 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.392681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.393554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.393962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.394331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.395740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.400287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.410941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:09.430020 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1518/2990] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:09.431192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.460339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c876b6-03ed-42ce-9860-fba0ea48e08a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.473797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.476215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.476569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.477123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.478317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.479323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.480566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.482621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.484575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.486569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.492440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:09.508427 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1519/2991] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:09.513564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:09.551269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a7ce7-d1cd-4ed7-a5d9-8181275f912a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:09.563183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.566000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd7c3-a93d-4949-b269-3ec7269bfdb9 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.576235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:09.577421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.577807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.578148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] PATH_INFO: `/v3/projects/81df979b1a734a979497e69752fd0513/users/4e0d3d0016d14a518f95f394245db6bc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.633141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=81df979b1a734a979497e69752fd0513, user_id=4e0d3d0016d14a518f95f394245db6bc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:09.642665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:09.645505 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1473/2992] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:09.679610 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1520/2993] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:09 2022] PUT /identity/v3/projects/81df979b1a734a979497e69752fd0513/users/4e0d3d0016d14a518f95f394245db6bc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:09.683691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:09.684740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:09.685397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:09.761457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] MFA Rules not processed for user `4e0d3d0016d14a518f95f394245db6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:09.762841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:09.961865 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1474/2994] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:11.389674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:11.420386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:11.422030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:11.641107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:11.722684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb7c0b-fdac-4b74-857b-e3948bf272b4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:11.732648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e256f-2460-47e9-9ea7-842f6f9288bc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:11.747024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:11.747024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:11.747024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:11.749381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:11.756220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:11.765252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:11.766773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:11.767167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:11.767592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:11.802618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:11.803944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b5004-db06-40b4-af81-e5c1a6d6628e service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:11.807156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:11.808754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:11.836685 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1475/2995] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:11.843646 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1521/2996] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:19.843370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:19.997369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:20.029414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263de02-1baa-4661-a621-1074c641e136 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:20.040606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:20.041110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:20.041525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:20.042220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] PATH_INFO: `/v3/users/4e0d3d0016d14a518f95f394245db6bc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:20.045533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0d3d0016d14a518f95f394245db6bc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:20.051309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:20.172765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0d3d0016d14a518f95f394245db6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:20.174301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0d3d0016d14a518f95f394245db6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:20.190837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0d3d0016d14a518f95f394245db6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:20.191664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0d3d0016d14a518f95f394245db6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:20.204916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0d3d0016d14a518f95f394245db6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:20.263067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1476/2997] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:19 2022] DELETE /identity/v3/users/4e0d3d0016d14a518f95f394245db6bc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:20.268392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:20.268975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:20.268975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:20.316448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:20.321463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:20.544644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1522/2998] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:20.567702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:20.570733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:20.744241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe6af0-5a61-427a-b0cf-f0613d098bb0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:20.753620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:20.754511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:20.754969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:20.755386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:20.781162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:20.783657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:20.805586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1477/2999] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:21.719852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:21.722058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:21.751083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8db958-395b-4469-88ce-8f53807b2d84 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:21.766152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:21.766829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:21.767171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:21.767518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] PATH_INFO: `/v3/users/19e2cb9474fb47a6b3f3793c7f162caf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:21.768835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e2cb9474fb47a6b3f3793c7f162caf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:21.774277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:21.879007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e2cb9474fb47a6b3f3793c7f162caf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:21.891971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e2cb9474fb47a6b3f3793c7f162caf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:21.892847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e2cb9474fb47a6b3f3793c7f162caf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:21.903438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e2cb9474fb47a6b3f3793c7f162caf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:21.904273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e2cb9474fb47a6b3f3793c7f162caf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:21.938805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1523/3000] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:21 2022] DELETE /identity/v3/users/19e2cb9474fb47a6b3f3793c7f162caf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:22.101128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:22.102577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:22.133665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb4e2d-2e58-45e7-b468-dadeaa3c7150 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:22.257664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:22.258825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:22.260190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:22.262212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] PATH_INFO: `/v3/projects/81df979b1a734a979497e69752fd0513` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:22.264687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81df979b1a734a979497e69752fd0513)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:22.268489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:22.297882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:22.368355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81df979b1a734a979497e69752fd0513', 'request_id': 'req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.393072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81df979b1a734a979497e69752fd0513', 'request_id': 'req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.430760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81df979b1a734a979497e69752fd0513', 'request_id': 'req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.480559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] The token cache is being invalidate because project 81df979b1a734a979497e69752fd0513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:22.480907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.483112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dd185ef-b90e-4b39-84cf-c1bc6db8def8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.486406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1478/3001] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:22 2022] DELETE /identity/v3/projects/81df979b1a734a979497e69752fd0513 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:22.495581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:22.496020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:22.497515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190025f-b23e-4897-9dc7-45ee71931001 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:22.497842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190025f-b23e-4897-9dc7-45ee71931001 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:22.498104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190025f-b23e-4897-9dc7-45ee71931001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:22.529862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1669e-3efa-4773-a9ac-42ed7aa40b2e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:22.556093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e190025f-b23e-4897-9dc7-45ee71931001 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:22.560717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e190025f-b23e-4897-9dc7-45ee71931001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:22.615410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:22.656929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:22.657608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:22.657887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:22.658156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] PATH_INFO: `/v3/projects/c91c440777a0421c961411bafbc058ad` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:22.659501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91c440777a0421c961411bafbc058ad)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:22.667396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:22.707205 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1479/3002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:22.715957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:22.716238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:22.716512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:22.760090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:22.762467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:22.836667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91c440777a0421c961411bafbc058ad', 'request_id': 'req-1c36f601-5651-435b-84ce-d92e419bc1be'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.868310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91c440777a0421c961411bafbc058ad', 'request_id': 'req-1c36f601-5651-435b-84ce-d92e419bc1be'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.888247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91c440777a0421c961411bafbc058ad', 'request_id': 'req-1c36f601-5651-435b-84ce-d92e419bc1be'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.914877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] The token cache is being invalidate because project c91c440777a0421c961411bafbc058ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:22.915331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.920288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:22.928083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1524/3003] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:22 2022] DELETE /identity/v3/projects/c91c440777a0421c961411bafbc058ad => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:22.939749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:22.944310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:22.946514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1480/3004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:22.950450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:22.967372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f601-5651-435b-84ce-d92e419bc1be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:22.976148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138ed7-fe02-44a7-8e70-f1452596a447 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:22.985120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:22.985899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:22.986179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:22.986447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] PATH_INFO: `/v3/users/40e9628b43bc45958644160c3a8e943d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:22.989666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e9628b43bc45958644160c3a8e943d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:22.991703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:22.994914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.001538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.001864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.002144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.006755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:23.007167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.008810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.086410 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1481/3005] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:23.090634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e9628b43bc45958644160c3a8e943d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:23.093273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.107017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e9628b43bc45958644160c3a8e943d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:23.107752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e9628b43bc45958644160c3a8e943d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:23.118720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e9628b43bc45958644160c3a8e943d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:23.122613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e9628b43bc45958644160c3a8e943d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:23.130999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9db-2b1e-410f-b590-9e8def2e33f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.147273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.150993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.151280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.151559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.152206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.158637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.173384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1525/3006] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:22 2022] DELETE /identity/v3/users/40e9628b43bc45958644160c3a8e943d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:23.254230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1482/3007] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:23 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:23.258303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.261225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:23.407790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:23.458884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e56ccc-cab1-4e27-9dee-c9321ecc32c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.549615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.550297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.550606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.551290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.551534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.560517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.621754 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1526/3008] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:23 2022] POST /identity/v3/users => generated 284 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:23.625599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.638474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda509f-5ecb-4266-b4af-da93dc3f7947 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.645217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.645973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.646364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.646737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.647850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.649770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.654064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:23.674263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1483/3009] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:11:23.677979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.729049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dd985-e3ed-4183-8a1f-b43a426b2abc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.771254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.774369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.774673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.780564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.783202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.790199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.805459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.807501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:23.845206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002973c5-875b-4ab7-a6b4-ccf3838e268e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.865381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1527/3010] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:23.868394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:23.874275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.874942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.875322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.877806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] PATH_INFO: `/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.882824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a6afd133f34c0caf0d2933249fd8a8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.886461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:23.895769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f525-1f3a-4b08-9e26-e8864567f697 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:23.911735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:23.926640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:23.940547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:23.943344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] PATH_INFO: `/v3/projects/a26e133352f14345a82cf54eb512f1be/users/e8c66912f0ca4625a0cb274c1386cb28/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:23.987863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26e133352f14345a82cf54eb512f1be, user_id=e8c66912f0ca4625a0cb274c1386cb28, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:23.999451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50b549-3891-43ac-ad43-183b549537dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.020529 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1528/3011] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:23 2022] PUT /identity/v3/projects/a26e133352f14345a82cf54eb512f1be/users/e8c66912f0ca4625a0cb274c1386cb28/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:24.025602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.026225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.027049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.054969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a6afd133f34c0caf0d2933249fd8a8', 'request_id': 'req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:24.070346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a6afd133f34c0caf0d2933249fd8a8', 'request_id': 'req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:24.079317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a6afd133f34c0caf0d2933249fd8a8', 'request_id': 'req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:24.083420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:24.088208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:24.120548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] The token cache is being invalidate because project b8a6afd133f34c0caf0d2933249fd8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:24.120548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:24.123393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bc68efcf-bd2a-4f7d-965d-62532ef9cea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:24.128224 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1484/3012] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:23 2022] DELETE /identity/v3/projects/b8a6afd133f34c0caf0d2933249fd8a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:24.137295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fc93-e56c-46a1-8871-85972b72cd36 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.138345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fc93-e56c-46a1-8871-85972b72cd36 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.139776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fc93-e56c-46a1-8871-85972b72cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.198833 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1529/3013] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:24.236852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.239291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:24.251026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff33fc93-e56c-46a1-8871-85972b72cd36 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:24.270777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff33fc93-e56c-46a1-8871-85972b72cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:24.318284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1485/3014] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:11:24.321918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:24.324451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.326003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.326441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.328521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41e2e-119e-43fc-8e03-7a3ff8538554 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.337734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.338445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.339288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.339638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.356210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.356210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.370158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1530/3015] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:24.407474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:24.409159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:24.435500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1486/3016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:24.440326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.452498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d9911-456e-4df1-a0f0-ddf779a75279 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.468671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.469549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.469827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.470094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.470768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:24.471068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.472670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.502396 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1531/3017] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:11:24.506856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.521540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649c4f3-723e-41fa-b4b1-7b75ea48fdfa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.535402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.536042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.536318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.536592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.537274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.539247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.575013 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1487/3018] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:24 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:24.580017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.602301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1f2bd-5ac2-4882-ba10-01aecd65dc97 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.696369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.697022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.697693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.698017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.699405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.701407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.739235 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1532/3019] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:24 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:24.740531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.757330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff2b26-65cc-4281-bdd2-db13e1835b2b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.769490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.770861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.772256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.772671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.773545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.776852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.800102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1488/3020] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:24.801624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.829518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbb58-199b-486b-9181-d1cc71951c6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.852059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.855678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.856281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.868717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.872204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.875763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da97c-0d17-4d7b-90ea-f0ce2edeab16 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:24.918062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1533/3021] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:24.919600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:24.942076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8085c-ec1a-4903-ba56-d02ec0aa0ccd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:24.948702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:24.950002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:24.950279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:24.951170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6/users/8bae748fa0ec4a17bee421f0632aae73/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:24.982631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3748e4ee8bdf41798158bc6e65f409e6, user_id=8bae748fa0ec4a17bee421f0632aae73, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:24.986892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:25.019495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1489/3022] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:24 2022] PUT /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6/users/8bae748fa0ec4a17bee421f0632aae73/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:25.024736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:25.025056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:25.025314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:25.097348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] MFA Rules not processed for user `8bae748fa0ec4a17bee421f0632aae73`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:25.098841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:25.269993 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1534/3023] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:25.271035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:25.357878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f3ca-b550-40cd-bd47-80cee67e23f5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:25.366401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:25.367083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:25.367360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:25.367627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:25.368328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:25.370658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:25.407279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:25.432502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1490/3024] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:25 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:25.436330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:25.452630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17050-92d1-453a-8b8e-4e2974ac867c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:25.585426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:25.643054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:25.660193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:25.665586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:25.666541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:25.676906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:25.691013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:25.803608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:25.804824 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1535/3025] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:25 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:25.821515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90151-fb53-4841-b62b-f9aff7fd6256 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:25.839734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:25.841359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:25.841855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:25.842334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:25.843276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:25.852644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:25.889347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1491/3026] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:11:25.893913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:25.921086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708d384-2395-4c3b-9e08-a489d5c5ed07 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:25.947363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:25.948171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:25.949138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:25.949529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] PATH_INFO: `/v3/projects/8a85259fc6a14de9b73c625d398182e6/users/4430930d6d284f22a83b8a574229fc91/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:25.992777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a85259fc6a14de9b73c625d398182e6, user_id=4430930d6d284f22a83b8a574229fc91, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:25.999709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.030081 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1536/3027] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:25 2022] PUT /identity/v3/projects/8a85259fc6a14de9b73c625d398182e6/users/4430930d6d284f22a83b8a574229fc91/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:26.031210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:26.049601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faecab-0eee-49fd-a2fc-ae8864b8505b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:26.195099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:26.196260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.196694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.200276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.201052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:26.203613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7127cf6-dce2-4e66-9006-37d0f71a4dc3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.218329 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1492/3028] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:11:26.222927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:26.239541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec46603-7084-4bfd-93a8-ef4881b897d4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:26.270548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.270752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.271094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.280403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:26.281149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.282095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.282287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] PATH_INFO: `/v3/projects/8a85259fc6a14de9b73c625d398182e6/users/4430930d6d284f22a83b8a574229fc91/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.289622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a85259fc6a14de9b73c625d398182e6, user_id=4430930d6d284f22a83b8a574229fc91, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:26.290955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd712e96-ccaf-4c95-a793-c45e4747c861 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.320256 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1537/3029] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:26 2022] PUT /identity/v3/projects/8a85259fc6a14de9b73c625d398182e6/users/4430930d6d284f22a83b8a574229fc91/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:26.335935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.336222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.336495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.342631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] MFA Rules not processed for user `c2a4c2cd88304000a7277caf5bb29ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:26.344449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:26.407722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] MFA Rules not processed for user `4430930d6d284f22a83b8a574229fc91`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:26.409067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:26.499571 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1493/3030] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:26.581240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1538/3031] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:26.588660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:26.617372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7375332-5cfe-4db4-995d-0e67edc311c6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:26.627773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:26.628422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.628958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.629104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.629682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:26.629996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:26.636197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.678095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1494/3032] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:26.682164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:26.709128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd4d18-ff05-49ac-a135-028c6b4c0602 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:26.715435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:26.716095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.716424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.717345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.719191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:26.721450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.788867 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1539/3033] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:26 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:26.792763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:26.811677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5e-0073-44c4-9932-26f24ea20ffb tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:26.908121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:26.908891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:26.909293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:26.910550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:26.911283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:26.911864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:26.914124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:26.952093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1495/3034] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:11:27.740133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:27.742378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:27.800068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:27.802107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:27.825031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:28.004777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:28.056292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f4ee-e3ae-4093-b7b9-97fc77020248 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:28.058685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62100552-4618-4372-b436-f4b8fcec3cc3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:28.068008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:28.068796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:28.069949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:28.070397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:28.073262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:28.089595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:28.092151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3ae26-e09f-4679-8272-09efdcb9c840 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:28.095373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:28.096010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:28.096294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:28.096571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:28.108040 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1496/3035] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:11:28.121145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:28.123175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:28.149838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1540/3036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:28.191304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6fc81-2f53-4d2f-9199-dd55a0242f17 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:28.191685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6fc81-2f53-4d2f-9199-dd55a0242f17 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:28.192033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6fc81-2f53-4d2f-9199-dd55a0242f17 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:28.193892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1497/3037] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:28.206822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:28.229012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:28.262396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb61ccf-cdeb-485f-adfb-2d2fea41812f service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:28.280489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:28.281250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:28.281538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:28.281878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:28.290378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7bb26f1d4c94d959aa0d2327b21f941)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:28.300224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:28.309556 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1541/3038] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:28 2022] GET /identity/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941 => generated 369 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:28.962842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ecac-f951-4db0-b264-636621dc8d74 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:28.963401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ecac-f951-4db0-b264-636621dc8d74 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:28.963401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7ecac-f951-4db0-b264-636621dc8d74 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:28.965304 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1498/3039] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:28.986893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:28.989279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:29.051310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:29.107757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d7f6-6850-41dc-a42f-68e23bbc4fb5 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:29.134224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:29.137341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:29.141101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:29.144553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:29.150256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7bb26f1d4c94d959aa0d2327b21f941)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:29.155261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:29.159383 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1542/3040] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:28 2022] GET /identity/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941 => generated 369 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:29.451065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be41a-1ba3-4d48-9049-938295347008 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:29.451273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be41a-1ba3-4d48-9049-938295347008 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:29.451501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be41a-1ba3-4d48-9049-938295347008 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:29.453241 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1499/3041] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:29.462828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:29.510097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:29.530757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf947e-e438-425a-bd6a-1e5a359fce33 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:29.536897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:29.538667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:29.539270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:29.539703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:29.541805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7bb26f1d4c94d959aa0d2327b21f941)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:29.544239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93f72c-8947-4b33-ab1c-4249afa2e7ac tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:29.548255 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1543/3042] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:29 2022] GET /identity/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941 => generated 369 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:29.584286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41be41a-1ba3-4d48-9049-938295347008 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:29.608876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41be41a-1ba3-4d48-9049-938295347008 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:29.617836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:29.618837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:29.619409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:29.619974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:29.621531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c7bb26f1d4c94d959aa0d2327b21f941)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:29.623820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:29.776837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bb26f1d4c94d959aa0d2327b21f941', 'request_id': 'req-198153ea-c5fd-430d-9864-d2b1bca56ea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:29.798275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bb26f1d4c94d959aa0d2327b21f941', 'request_id': 'req-198153ea-c5fd-430d-9864-d2b1bca56ea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:29.810804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bb26f1d4c94d959aa0d2327b21f941', 'request_id': 'req-198153ea-c5fd-430d-9864-d2b1bca56ea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:29.844795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] The token cache is being invalidate because project c7bb26f1d4c94d959aa0d2327b21f941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:29.845119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:29.854641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:29.863030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1500/3043] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:29 2022] DELETE /identity/v3/projects/c7bb26f1d4c94d959aa0d2327b21f941 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:30.058882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4252-69d7-453d-9e8f-408f4fa1e38e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:30.059415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4252-69d7-453d-9e8f-408f4fa1e38e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:30.059415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4252-69d7-453d-9e8f-408f4fa1e38e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:30.060783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1544/3044] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:30.066799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:30.075544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:30.260959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:30.262494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:30.302269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:30.466167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198153ea-c5fd-430d-9864-d2b1bca56ea7 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:30.481964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:30.482910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:30.483428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:30.483940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:30.488590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=3748e4ee8bdf41798158bc6e65f409e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:30.496440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:30.522274 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1501/3045] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:30 2022] GET /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6 => generated 373 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:30.532709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4252-69d7-453d-9e8f-408f4fa1e38e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:30.554907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4252-69d7-453d-9e8f-408f4fa1e38e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:30.577307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:30.580958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:30.583433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:30.584701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:30.588196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:30.588666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:30.592347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:30.654549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1545/3046] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:30.655529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:30.681458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ad9e4-b28b-4e1e-8bfe-f0406b1b8d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:30.709579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:30.713492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:30.715387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:30.716656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:30.717507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:30.726203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9bdd4-e83b-46b3-bba3-eee6a98a1411 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:30.845340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:30.845735 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1502/3047] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:30.861676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d455-0d03-4d6c-ae18-c7197e959e36 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:31.057263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:31.058104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:31.058755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:31.059175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:31.060455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:31.060763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:31.068172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:31.103859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1546/3048] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:31.639203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d9b5-6f6c-4ded-bf6f-5d383ee63f8c None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:31.639813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d9b5-6f6c-4ded-bf6f-5d383ee63f8c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:31.640114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7d9b5-6f6c-4ded-bf6f-5d383ee63f8c None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:31.642288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1503/3049] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:31.657310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:31.659452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:31.934498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:31.966340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6a3c-f5c1-4eaf-9c16-20e322eed81a tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:31.991597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:31.992254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:31.992527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:31.992791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/69796d713d1643cc9e9f792c72ed3a3f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:31.993967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=69796d713d1643cc9e9f792c72ed3a3f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:31.996018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:31.997928 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1547/3050] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:31 2022] GET /identity/v3/projects/69796d713d1643cc9e9f792c72ed3a3f => generated 371 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:11:32.551332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addf9-26ca-4e72-94d4-0575550132e0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:32.552060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addf9-26ca-4e72-94d4-0575550132e0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:32.552533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574addf9-26ca-4e72-94d4-0575550132e0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:32.555051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1504/3051] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:32.574092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:32.665574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:32.710134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee7ddb-342d-46f0-8060-fb4f16e0b4c3 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:32.736854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:32.737966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:32.738585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:32.739044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/69796d713d1643cc9e9f792c72ed3a3f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:32.741159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=69796d713d1643cc9e9f792c72ed3a3f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:32.743468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:32.745448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1548/3052] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:32 2022] GET /identity/v3/projects/69796d713d1643cc9e9f792c72ed3a3f => generated 371 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:32.870317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574addf9-26ca-4e72-94d4-0575550132e0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:32.895663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574addf9-26ca-4e72-94d4-0575550132e0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:32.911189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:32.911810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:32.912089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:32.912359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:32.913030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:32.917988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:32.919646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:32.973681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:32.983837 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1505/3053] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:32.988538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571e3d-e0b9-429b-8846-55744f73dbba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:33.007965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:33.008651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:33.008932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:33.009236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:33.009891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:33.013995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea5ddc-08d6-4662-a77f-75e07abbb8bd tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:33.067743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1549/3054] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:32 2022] POST /identity/v3/users => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:33.071885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:33.083033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853a3c-e6f4-4bdb-8635-b7760482ab0e tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:33.106898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:33.107877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:33.108259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:33.108639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:33.109594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:33.111124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:33.122234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:33.182238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1506/3055] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:33.416481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e8b3-70d3-413c-909e-63ab10ad68b9 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:33.416766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e8b3-70d3-413c-909e-63ab10ad68b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:33.417064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880e8b3-70d3-413c-909e-63ab10ad68b9 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:33.418721 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1550/3056] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:33.425666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:33.447698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:33.498803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613854-a6e9-4da7-a84c-be36c6925d42 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:33.526801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:33.527624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:33.528159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:33.528654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/69796d713d1643cc9e9f792c72ed3a3f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:33.530532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=69796d713d1643cc9e9f792c72ed3a3f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:33.533508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:33.573351 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1507/3057] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:33 2022] GET /identity/v3/projects/69796d713d1643cc9e9f792c72ed3a3f => generated 371 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:34.238100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae235-3789-473d-9ab8-5b86210c4682 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:34.238729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae235-3789-473d-9ab8-5b86210c4682 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:34.238878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ae235-3789-473d-9ab8-5b86210c4682 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:34.241632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1551/3058] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:34.253486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:34.273653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:34.318456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c5c4-cc60-460d-99fb-16ca99f94d01 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:34.334174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:34.334937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:34.335920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:34.336308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/69796d713d1643cc9e9f792c72ed3a3f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:34.337610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=69796d713d1643cc9e9f792c72ed3a3f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:34.339793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:34.359715 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1508/3059] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:34 2022] GET /identity/v3/projects/69796d713d1643cc9e9f792c72ed3a3f => generated 371 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:34.398397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ae235-3789-473d-9ab8-5b86210c4682 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:34.408276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:34.425153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ae235-3789-473d-9ab8-5b86210c4682 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:34.443604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:34.446850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:34.447432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:34.449636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/users/4a44d1239fc74d57874c4fe421d40edd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:34.504589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4a44d1239fc74d57874c4fe421d40edd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:34.506972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:34.649472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44d1239fc74d57874c4fe421d40edd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:34.665568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44d1239fc74d57874c4fe421d40edd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:34.666870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44d1239fc74d57874c4fe421d40edd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:34.698590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44d1239fc74d57874c4fe421d40edd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:34.704401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bea3861c-30d7-49d1-8090-a3c5aaf7f854 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44d1239fc74d57874c4fe421d40edd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:34.768567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1552/3060] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:34 2022] DELETE /identity/v3/users/4a44d1239fc74d57874c4fe421d40edd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:34.772731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:34.774678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:34.801880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24100177-4d0a-4414-8bfb-8d4c3ddba897 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:35.026402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:35.028028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:35.028028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:35.028267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/69796d713d1643cc9e9f792c72ed3a3f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:35.029826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69796d713d1643cc9e9f792c72ed3a3f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:35.037949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:35.177687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69796d713d1643cc9e9f792c72ed3a3f', 'request_id': 'req-99092786-1edb-4507-a7a7-2a63949dfdba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:35.183598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:35.239207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69796d713d1643cc9e9f792c72ed3a3f', 'request_id': 'req-99092786-1edb-4507-a7a7-2a63949dfdba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:35.288470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69796d713d1643cc9e9f792c72ed3a3f', 'request_id': 'req-99092786-1edb-4507-a7a7-2a63949dfdba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:35.324658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] The token cache is being invalidate because project 69796d713d1643cc9e9f792c72ed3a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:35.325033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:35.330649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:35.332481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1509/3061] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:34 2022] DELETE /identity/v3/projects/69796d713d1643cc9e9f792c72ed3a3f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:35.393477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0d45-9961-48fa-98a4-f2646b33549e None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:35.398375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0d45-9961-48fa-98a4-f2646b33549e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:35.402823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b0d45-9961-48fa-98a4-f2646b33549e None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:35.404444 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1553/3062] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:35.416658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:35.418471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:35.582081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:35.584123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:35.670824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092786-1edb-4507-a7a7-2a63949dfdba tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:35.685394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:35.686416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:35.686698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:35.686973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:35.690689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=3748e4ee8bdf41798158bc6e65f409e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:35.692518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:35.699977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1510/3063] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:35 2022] GET /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6 => generated 373 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:35.759637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9b69-12b9-4ff5-88af-f6f999c7f675 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:35.760158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9b69-12b9-4ff5-88af-f6f999c7f675 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:35.761146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe9b69-12b9-4ff5-88af-f6f999c7f675 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:35.763440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1554/3064] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:35.771211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:35.797452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:35.823787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8dc3e-9406-49c6-bcd0-85907a85cc3d tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:35.831012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:35.831730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:35.832003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:35.832337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:35.834325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=3748e4ee8bdf41798158bc6e65f409e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:35.836670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:35.839550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1511/3065] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:35 2022] GET /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6 => generated 373 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:36.555931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:36.556804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:36.557256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:36.559019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1555/3066] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:11:36.565987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:11:36.580676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:36.590850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6f8fb-ff49-414c-a445-57962171cca1 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:36.597120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4430930d6d284f22a83b8a574229fc91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a85259fc6a14de9b73c625d398182e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:36.597767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:36.598034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:36.598354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:36.599753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorizing `identity:get_project(project_id=3748e4ee8bdf41798158bc6e65f409e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:36.603325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3987bd-f8e8-4a99-b528-cd000c661f55 tempest-QuotasAdminTestJSON-114311401 tempest-QuotasAdminTestJSON-114311401-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:36.605902 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1512/3067] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:11:36 2022] GET /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6 => generated 373 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:37.132370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:37.134313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:37.322420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5c65c-53f4-44e1-959f-7253b34db9ce None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:37.334381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:37.335271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:37.336676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:37.338031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] PATH_INFO: `/v3/users/8bae748fa0ec4a17bee421f0632aae73` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:37.345286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bae748fa0ec4a17bee421f0632aae73)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:37.347703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:37.489550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bae748fa0ec4a17bee421f0632aae73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:37.502473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bae748fa0ec4a17bee421f0632aae73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:37.503114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bae748fa0ec4a17bee421f0632aae73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:37.518580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bae748fa0ec4a17bee421f0632aae73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:37.519941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bae748fa0ec4a17bee421f0632aae73'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:37.536050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:37.572577 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1556/3068] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:37 2022] DELETE /identity/v3/users/8bae748fa0ec4a17bee421f0632aae73 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:37.577126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:37.577621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:37.577954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:37.641016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:37.644851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:37.779848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:37.809273 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1513/3069] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:11:37.834569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:37.836693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:38.013097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c2a35-95a5-4883-9e45-2bd45170c47b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:38.039814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:38.040695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:38.040695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:38.040954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:38.053902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:38.055351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d39711-f120-424e-bd40-5f7fe30a9f72 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:38.087825 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1557/3070] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:38.720919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:38.722635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:38.746200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b65d69-9850-4a4a-b36e-6ed130aad89f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:38.788584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:38.789268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:38.795271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:38.795568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] PATH_INFO: `/v3/projects/3748e4ee8bdf41798158bc6e65f409e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:38.800436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3748e4ee8bdf41798158bc6e65f409e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:38.802429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:38.935590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:38.936145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:38.936145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:38.982184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3748e4ee8bdf41798158bc6e65f409e6', 'request_id': 'req-45660dcb-0576-47e5-872a-76afa53b959a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:38.993557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3748e4ee8bdf41798158bc6e65f409e6', 'request_id': 'req-45660dcb-0576-47e5-872a-76afa53b959a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:38.995690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:38.998415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:39.007076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3748e4ee8bdf41798158bc6e65f409e6', 'request_id': 'req-45660dcb-0576-47e5-872a-76afa53b959a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.039954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] The token cache is being invalidate because project 3748e4ee8bdf41798158bc6e65f409e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:39.040269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.040930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.050465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1514/3071] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:38 2022] DELETE /identity/v3/projects/3748e4ee8bdf41798158bc6e65f409e6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:39.054407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:39.055909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:39.109659 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1558/3072] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:11:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:11:39.128612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:39.132910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:39.171820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45660dcb-0576-47e5-872a-76afa53b959a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:39.181342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:39.182139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:39.182481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:39.182749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] PATH_INFO: `/v3/users/4430930d6d284f22a83b8a574229fc91` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:39.186356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4430930d6d284f22a83b8a574229fc91)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:39.189681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:39.280450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c8c2-1986-49f2-a17b-4f474529d2a0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:39.291300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:39.292349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:39.293615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:39.294083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:39.300758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4430930d6d284f22a83b8a574229fc91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.301851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4430930d6d284f22a83b8a574229fc91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.341832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4430930d6d284f22a83b8a574229fc91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.348720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4430930d6d284f22a83b8a574229fc91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.352597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:39.356877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:39.364472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dda0505d-4b4a-440b-af99-4d626953be0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4430930d6d284f22a83b8a574229fc91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:39.378498 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1559/3073] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:39.422341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1515/3074] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:39 2022] DELETE /identity/v3/users/4430930d6d284f22a83b8a574229fc91 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:39.911123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:39.912977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:39.972173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:40.023376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.023866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.023956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.036858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:40.069491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:40.077164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:40.118533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91039902-08ef-43e5-b694-4ace4632c4e7 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:40.244158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1516/3075] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:40.246063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:40.247066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.247342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.247620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.251978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:40.259992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:40.262642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:40.306824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:40.308963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:40.351207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1560/3076] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:40.352090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:40.354264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:40.492311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1ae8c-293c-4b75-81de-4e962352e270 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:40.516052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:40.516933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.517611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.518179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.538919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:40.540868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc085a-92c5-4c37-b699-d82d7f33140d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:40.549869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98266a80-f91f-4e0b-9117-0dea0afb0d41 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:40.555877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:40.556680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.556900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.557316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] PATH_INFO: `/v3/projects/8a85259fc6a14de9b73c625d398182e6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.558591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a85259fc6a14de9b73c625d398182e6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:40.561258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:40.562013 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1517/3077] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:11:40.700430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.700930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.701556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.783089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] MFA Rules not processed for user `e8c66912f0ca4625a0cb274c1386cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:40.785123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:40.802767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:40.810546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a85259fc6a14de9b73c625d398182e6', 'request_id': 'req-3664ab6c-2262-4cf9-8663-12395231ca3c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:40.834347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a85259fc6a14de9b73c625d398182e6', 'request_id': 'req-3664ab6c-2262-4cf9-8663-12395231ca3c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:40.861441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a85259fc6a14de9b73c625d398182e6', 'request_id': 'req-3664ab6c-2262-4cf9-8663-12395231ca3c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:40.909864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] The token cache is being invalidate because project 8a85259fc6a14de9b73c625d398182e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:40.910345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:40.911482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3664ab6c-2262-4cf9-8663-12395231ca3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:40.915906 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1561/3078] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:40 2022] DELETE /identity/v3/projects/8a85259fc6a14de9b73c625d398182e6 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:40.935374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89704-d6ab-4066-a8bf-f3369ac9f62f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:40.938919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89704-d6ab-4066-a8bf-f3369ac9f62f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:40.939677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89704-d6ab-4066-a8bf-f3369ac9f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:40.990418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1518/3079] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:41.003107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3be89704-d6ab-4066-a8bf-f3369ac9f62f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:41.005758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3be89704-d6ab-4066-a8bf-f3369ac9f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:41.019825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.021122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:41.095050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:41.186796 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1562/3080] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:41.190374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.190771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.191141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.196655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4ef9-c000-44f4-b362-1723b3aa5f3f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.204679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.205383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.205658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.205969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.215976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.217919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.221902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:41.223576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:41.244194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1519/3081] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:41.251606 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1563/3082] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:41.257235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.278650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caefc46-72e2-498c-b0c4-60f4c0feac66 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.291313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.293663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.294067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.294435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.295195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:11:41.298322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.300116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.335724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1520/3083] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:11:41.336286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.350449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087cf50-5b6d-4aed-98ca-ce69c2192594 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.371609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.372242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.372514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.372779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.373472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.377351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.449426 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1564/3084] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:41 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:11:41.455923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.478845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b1620-28cb-4f78-8d72-e1e5fd514ed5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.623492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.626324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.626884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.628892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.629804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.636193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.702697 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1521/3085] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:41 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:41.706926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.719210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c8c-4fab-45cb-911e-48433090365b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.733619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.736404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.737399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.739497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.740370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.745233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.770178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.782183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fc0bf-f87f-43ae-9632-8c436a13edb5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.782745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1565/3086] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:41.797620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.798627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.799074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.799502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.800291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.802066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c56dc-f69f-4e93-91c5-ed1f885b1cd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.829345 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1522/3087] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:41.831172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:41.852895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21df6-644b-478b-9d3a-628246ba450b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:41.860155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:41.860841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.861171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.861441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] PATH_INFO: `/v3/projects/d6e5c7f1395f42c29859cd1b2eb4a6d2/users/0b49ed05fef04d7d9a605543b4f0e423/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:41.898476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e5c7f1395f42c29859cd1b2eb4a6d2, user_id=0b49ed05fef04d7d9a605543b4f0e423, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:41.906682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:41.934262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1566/3088] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:41 2022] PUT /identity/v3/projects/d6e5c7f1395f42c29859cd1b2eb4a6d2/users/0b49ed05fef04d7d9a605543b4f0e423/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:41.971741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:41.971924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:41.972177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:42.037704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] MFA Rules not processed for user `0b49ed05fef04d7d9a605543b4f0e423`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:42.038942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:42.282612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1523/3089] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:11:42.286825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:42.407508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1aea4-8068-47c6-8c6f-31ad5ecf29a5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:42.418009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:42.418642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:42.418921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:42.419190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:42.419832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:42.422421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:42.463605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:42.498080 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1567/3090] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:11:42 2022] POST /identity/v3/projects => generated 391 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:42.503336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:42.528414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc510e-7a1c-4d25-b467-586783784a09 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:42.538305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:42.727774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:42.728406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:42.728683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:42.728951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:42.729640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:42.735027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:42.787415 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1524/3091] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:11:42 2022] POST /identity/v3/users => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:11:42.794638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:42.811338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a408-7cc2-41db-a4f1-15ac5f6f589f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:42.819536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:42.820163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:42.820435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:42.820703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:42.821391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:42.823132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:42.838492 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1568/3092] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:42.846911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:42.867881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348c8af-6280-4697-a4f9-0177d788e6a8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:42.878630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:42.879572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:42.879895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:42.880269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] PATH_INFO: `/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb/users/e2af50a37b5b42afac55b927f3f8ecaf/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:42.927712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9102dff5fc4c0a907b76b78ba87dfb, user_id=e2af50a37b5b42afac55b927f3f8ecaf, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:42.931887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:42.977099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:42.977945 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1525/3093] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:42 2022] PUT /identity/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb/users/e2af50a37b5b42afac55b927f3f8ecaf/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:11:42.994495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb31ea-1a88-47f2-953b-0af9a4c85170 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:43.178182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:43.178818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:43.179090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:43.179355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:43.180002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:43.181616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d9709-b9bd-4284-97f1-0d5d52006137 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:43.210353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:43.213375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1569/3094] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:11:43.247246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971254-b6a3-45c8-8792-255de6d8f827 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:43.277226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:43.278001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:43.278423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:43.281412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] PATH_INFO: `/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb/users/e2af50a37b5b42afac55b927f3f8ecaf/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:43.287373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9102dff5fc4c0a907b76b78ba87dfb, user_id=e2af50a37b5b42afac55b927f3f8ecaf, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:43.293850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:43.335927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab41c9-2617-42f2-85d6-fc205125893b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:43.336491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab41c9-2617-42f2-85d6-fc205125893b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:43.336491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab41c9-2617-42f2-85d6-fc205125893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:43.339659 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1526/3095] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:11:43 2022] PUT /identity/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb/users/e2af50a37b5b42afac55b927f3f8ecaf/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:11:43.397975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7bab41c9-2617-42f2-85d6-fc205125893b None None] MFA Rules not processed for user `e2af50a37b5b42afac55b927f3f8ecaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:43.399471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7bab41c9-2617-42f2-85d6-fc205125893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:43.574956 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1570/3096] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:43.582361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:43.584242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:43.811325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37048-f47e-4901-b798-f643f0f03731 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:43.822891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:43.832875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:43.833482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:43.833727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:43.934901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:43.943277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:43.945677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:43.970457 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1527/3097] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:45.695271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8b9-c75a-4784-adcc-deb25083537b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:45.695827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8b9-c75a-4784-adcc-deb25083537b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:45.695915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d8b9-c75a-4784-adcc-deb25083537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:45.767265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4bc0d8b9-c75a-4784-adcc-deb25083537b None None] MFA Rules not processed for user `e8c66912f0ca4625a0cb274c1386cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:45.769365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bc0d8b9-c75a-4784-adcc-deb25083537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:45.898546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:45.964398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67666006-bdf1-41e8-9bcd-d15644eac96e service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:45.990661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:45.991611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:45.992065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:45.992499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:46.054372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:46.055804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:46.102582 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1528/3098] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:46.103649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1571/3099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:56.043058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:56.087100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:58.199015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:58.291090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e5e23-e52a-436d-9d9c-2d3ad09ae65c service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:58.296938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:58.297553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:58.297905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:58.298243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] PATH_INFO: `/v3/users/0b49ed05fef04d7d9a605543b4f0e423` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:58.299496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b49ed05fef04d7d9a605543b4f0e423)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:58.301547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:58.370648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b49ed05fef04d7d9a605543b4f0e423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:58.371316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b49ed05fef04d7d9a605543b4f0e423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:58.381666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b49ed05fef04d7d9a605543b4f0e423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:58.382427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b49ed05fef04d7d9a605543b4f0e423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:58.392555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-96250e8d-e128-45ca-96ac-b71e782d562a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b49ed05fef04d7d9a605543b4f0e423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:58.423419 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1529/3100] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:58 2022] DELETE /identity/v3/users/0b49ed05fef04d7d9a605543b4f0e423 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:58.428189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:58.428690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:58.428784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:58.456932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:58.458420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:58.500671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe08e7-0368-4845-8aff-f51b809b77d9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:58.501609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe08e7-0368-4845-8aff-f51b809b77d9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:58.502177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe08e7-0368-4845-8aff-f51b809b77d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:58.542069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6efe08e7-0368-4845-8aff-f51b809b77d9 None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:58.543301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6efe08e7-0368-4845-8aff-f51b809b77d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:58.628175 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1572/3101] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:58.665914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:58.668927 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1530/3102] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:58.669396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:58.777739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42342a1c-87db-46fc-aaac-7fa7f632e9cf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:58.784434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:58.785230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:58.785599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:58.785967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:58.806622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:58.808430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba751e7-7dea-4fbe-8e6e-a108c7a24d90 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:58.820321 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1573/3103] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:11:58.950851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:58.951434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:58.951649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:58.978863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] MFA Rules not processed for user `16bd1444400e47de84f0c1c15cc42c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:58.980243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:59.008951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:59.069699 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1531/3104] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:59.078985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:59.079992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:59.080643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:59.119630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] MFA Rules not processed for user `16bd1444400e47de84f0c1c15cc42c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:11:59.137436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:59.138262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:59.139110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:59.158676 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1574/3105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:11:59.165988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d0db-49d6-4e0f-991b-d1fd671f8b51 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:59.178454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:59.179111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:59.179390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:59.179660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] PATH_INFO: `/v3/projects/d6e5c7f1395f42c29859cd1b2eb4a6d2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:59.180867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e5c7f1395f42c29859cd1b2eb4a6d2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:59.184553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:59.278280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e5c7f1395f42c29859cd1b2eb4a6d2', 'request_id': 'req-fef05608-d537-4ba8-90aa-c1c5790d998b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.288885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e5c7f1395f42c29859cd1b2eb4a6d2', 'request_id': 'req-fef05608-d537-4ba8-90aa-c1c5790d998b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.296682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e5c7f1395f42c29859cd1b2eb4a6d2', 'request_id': 'req-fef05608-d537-4ba8-90aa-c1c5790d998b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.313412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] The token cache is being invalidate because project d6e5c7f1395f42c29859cd1b2eb4a6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:11:59.313706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.315165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.317283 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1532/3106] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:59 2022] DELETE /identity/v3/projects/d6e5c7f1395f42c29859cd1b2eb4a6d2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:59.321276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:59.334931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7005a-4c81-45dc-a789-4f40748095f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:59.402735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:59.405743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:59.406358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:59.406756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] PATH_INFO: `/v3/users/e2af50a37b5b42afac55b927f3f8ecaf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:59.408140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2af50a37b5b42afac55b927f3f8ecaf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:59.410112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:59.474579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:11:59.488413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:59.490567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:59.491468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2af50a37b5b42afac55b927f3f8ecaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.503234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2af50a37b5b42afac55b927f3f8ecaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.503996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2af50a37b5b42afac55b927f3f8ecaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.512820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2af50a37b5b42afac55b927f3f8ecaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.513585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2af50a37b5b42afac55b927f3f8ecaf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:11:59.548621 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1575/3107] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:11:59 2022] DELETE /identity/v3/users/e2af50a37b5b42afac55b927f3f8ecaf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:11:59.574044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef05608-d537-4ba8-90aa-c1c5790d998b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:11:59.647118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:11:59.648487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:11:59.648777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:11:59.649067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:11:59.651459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:11:59.664596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:11:59.667696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4b0b-6050-490f-a9cb-90d890efabeb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:11:59.679379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1533/3108] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:11:59.870693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:11:59.873253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:00.051973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a31fa-f8f6-4568-908b-f85f0d51ac55 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.058825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.059142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.059404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.059745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] PATH_INFO: `/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.062610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9102dff5fc4c0a907b76b78ba87dfb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.065550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.153925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9102dff5fc4c0a907b76b78ba87dfb', 'request_id': 'req-b6842d66-3015-473b-921a-a9f75a293bb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:00.171984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9102dff5fc4c0a907b76b78ba87dfb', 'request_id': 'req-b6842d66-3015-473b-921a-a9f75a293bb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:00.183460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9102dff5fc4c0a907b76b78ba87dfb', 'request_id': 'req-b6842d66-3015-473b-921a-a9f75a293bb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:00.200358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] The token cache is being invalidate because project 3b9102dff5fc4c0a907b76b78ba87dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:00.200801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:00.201645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6842d66-3015-473b-921a-a9f75a293bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:00.204121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1576/3109] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:11:59 2022] DELETE /identity/v3/projects/3b9102dff5fc4c0a907b76b78ba87dfb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:00.210323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.212129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.213512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.261976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:00.265248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:00.276325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:00.405267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1534/3110] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:12:00.414614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.414894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.415156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.447169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:00.448544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:00.459861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1577/3111] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:00.464848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.476453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efcd8e-5ffa-4c46-8d6a-a252ef525b37 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.481819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.482431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.482706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.482973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.484796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:12:00.485144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.487001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.501126 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1535/3112] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:12:00.506324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.535341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111644d-7d21-4f1b-8a70-d303508fbe35 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.541381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.542002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.542277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.542543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.543179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.546996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.603019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1578/3113] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:00 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:00.604612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.620032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738b60e-4c0b-437d-9cb7-d861d4aeaf8b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.726130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.726820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.727100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.727395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.728719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.732743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.794253 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1536/3114] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:00 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:00.798844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.811803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76ea6f-dfad-463f-86cb-95bd772963af admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.817887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.818978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.819272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.819608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.820330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.822333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.836405 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1579/3115] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:00.837723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.849652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e6d13-6b5f-4e87-aac9-5346f7589721 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.855801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.856559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.856944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.857484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.858224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.860756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6614fb-026e-4035-8f44-7f95e5df8f38 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.877171 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1537/3116] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:00.878350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:00.889565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d074-bd07-47bf-a206-a486e96f4499 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:00.903492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:00.904103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.904380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.904652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] PATH_INFO: `/v3/projects/8ad06f3c29294b01ba67eb5d5a1ea59c/users/5bd4aa75ffc54e5f840a70d8a901da15/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.907921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:00.945686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad06f3c29294b01ba67eb5d5a1ea59c, user_id=5bd4aa75ffc54e5f840a70d8a901da15, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:00.949048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:00.966674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1580/3117] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:00 2022] PUT /identity/v3/projects/8ad06f3c29294b01ba67eb5d5a1ea59c/users/5bd4aa75ffc54e5f840a70d8a901da15/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:00.973136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf26d-a3b7-4b8a-b085-f3ea190d5720 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:00.973729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf26d-a3b7-4b8a-b085-f3ea190d5720 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:00.974251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf26d-a3b7-4b8a-b085-f3ea190d5720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:00.998970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c62cf26d-a3b7-4b8a-b085-f3ea190d5720 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:01.000853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c62cf26d-a3b7-4b8a-b085-f3ea190d5720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:01.121651 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1538/3118] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:01.132457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:01.135602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:01.228288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd574-cbab-42fa-8dda-cdfb6e5421e8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:01.232517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:01.233213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:01.233502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:01.233797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:01.244900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:01.246373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ee49c-7d88-482a-b923-48a8ac725b35 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:01.273085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1581/3119] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:03.715688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c0e1d-6b2e-4388-b089-cac959ca30b0 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:03.716317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c0e1d-6b2e-4388-b089-cac959ca30b0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:03.716317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c0e1d-6b2e-4388-b089-cac959ca30b0 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:03.718885 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1539/3120] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:12:03.728364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:03.729022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:03.729022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:03.801330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:03.806069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:03.857581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:03.857866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:03.858144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:03.901730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] MFA Rules not processed for user `b7d816c3043c435d8bf79d2c819518ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:03.902952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:03.923759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:04.001569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1582/3121] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:04.029560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:04.032524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:04.039286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1540/3122] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:12:04.047728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481295ba-19b0-48e8-b09c-3435241e8b97 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:04.052312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:04.053126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:04.053620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:04.054111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:04.078655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:04.081496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:04.096468 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1583/3123] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:12:12.676181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:12.692465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43e76e-245c-400d-9978-489c44de05f4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:12.700616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:12.701271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:12.701546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:12.701819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:12.708248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:12.737349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:12.738824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7710c-bc05-4975-ae9b-0f859c962d60 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:12.781583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:12.783914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:12.785231 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1541/3124] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:12.809043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8876b1e-2557-425f-84d5-c32c7beb43eb service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:12.816938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:12.817834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:12.818217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:12.818554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:12.820766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:12.900678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:12.921687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:12.925102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:12.946352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1584/3125] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:12:15.356494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:15.357223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:15.357223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:15.407231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] MFA Rules not processed for user `5bd4aa75ffc54e5f840a70d8a901da15`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:15.408739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:15.570658 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1542/3126] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:15.575232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:15.600304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15054-32b4-4faa-990f-72c445f0d2cc service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:15.615075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:15.615986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:15.616420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:15.616875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:15.617981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:15.622588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:15.677064 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1585/3127] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:15 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:15.678524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:15.695709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c714d0a-d8e5-4cf1-bda5-4b8d75ead65a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:15.856190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:15.859303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:15.859587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:15.859893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:15.860490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:15.869187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:15.916635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1543/3128] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:15 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:15.918262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:15.941224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837c2de-6363-400f-bb44-7ed6044cc793 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:15.962478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:15.963109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:15.963390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:15.963664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:15.964326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:15.965986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:16.018840 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1586/3129] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:16.022912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:16.035127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d051f-5437-4633-ad99-b7ef7bf66c50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:16.045247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:16.048903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:16.049283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:16.049562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] PATH_INFO: `/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8/users/8a6610a5b8564e59af27b1bab118db28/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:16.096049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96557cf1ece4bea92d6aa56c1ae75f8, user_id=8a6610a5b8564e59af27b1bab118db28, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:16.099706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:16.122188 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1544/3130] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:16 2022] PUT /identity/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8/users/8a6610a5b8564e59af27b1bab118db28/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:16.127641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:16.143538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef868f2-4773-45a8-96eb-0cf9217aaa32 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:16.249181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:16.250542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:16.251053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:16.251549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:16.252514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:16.254623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:16.271678 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1587/3131] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:16.275703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:16.284353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:16.289961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8c2b0-019a-4f99-82ef-ca8a32db66ff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:16.298278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:16.299547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:16.300068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:16.300589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] PATH_INFO: `/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8/users/8a6610a5b8564e59af27b1bab118db28/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:16.303043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96557cf1ece4bea92d6aa56c1ae75f8, user_id=8a6610a5b8564e59af27b1bab118db28, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:16.306431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:16.321907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1545/3132] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:16 2022] PUT /identity/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8/users/8a6610a5b8564e59af27b1bab118db28/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:25.546879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:25.548756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:25.716035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73db711-9e84-41c3-a7d7-a25247a7aefb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:25.878475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:25.904129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:25.905677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:25.906116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:25.906537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:25.908555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:25.923576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:25.925577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:25.974444 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1588/3133] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:26.315893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:33.324095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:33.327209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:33.460337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adde924-3327-494f-b7b5-4ccf800d65e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:33.466458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:33.467465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:33.467937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:33.468777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] PATH_INFO: `/v3/users/ab2aa9c224654cfbbc1559ed58556ad5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:33.488797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2aa9c224654cfbbc1559ed58556ad5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:33.491128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:33.586949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2aa9c224654cfbbc1559ed58556ad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:33.587665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2aa9c224654cfbbc1559ed58556ad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:33.599589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2aa9c224654cfbbc1559ed58556ad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:33.600698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2aa9c224654cfbbc1559ed58556ad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:33.613634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2aa9c224654cfbbc1559ed58556ad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:33.659178 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1546/3134] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:12:33 2022] DELETE /identity/v3/users/ab2aa9c224654cfbbc1559ed58556ad5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:34.151900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:34.161275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8ee56-dad6-453a-a87c-fcf855a6eff0 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:34.328892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:34.329746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:34.330121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:34.331580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] PATH_INFO: `/v3/projects/32ade5f58ea543ceb17c4bb5d230705f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:34.390095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ade5f58ea543ceb17c4bb5d230705f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:34.405199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:34.522545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ade5f58ea543ceb17c4bb5d230705f', 'request_id': 'req-85977d41-54e5-4330-ad45-da171b6a8340'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.532489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ade5f58ea543ceb17c4bb5d230705f', 'request_id': 'req-85977d41-54e5-4330-ad45-da171b6a8340'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.541431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ade5f58ea543ceb17c4bb5d230705f', 'request_id': 'req-85977d41-54e5-4330-ad45-da171b6a8340'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.570279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] The token cache is being invalidate because project 32ade5f58ea543ceb17c4bb5d230705f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:34.570782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.571681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.575668 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1589/3135] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:12:34 2022] DELETE /identity/v3/projects/32ade5f58ea543ceb17c4bb5d230705f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:34.580050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:34.583208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:34.601448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11796d-af38-44f2-b8f6-a9b1dffbabeb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:34.741481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:34.742454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:34.742972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:34.743467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] PATH_INFO: `/v3/users/cff9aa4b18a046e48392df7ed9120d01` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:34.744863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff9aa4b18a046e48392df7ed9120d01)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:34.774447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:34.794120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:34.874100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff9aa4b18a046e48392df7ed9120d01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.874792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff9aa4b18a046e48392df7ed9120d01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.895691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff9aa4b18a046e48392df7ed9120d01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.896722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff9aa4b18a046e48392df7ed9120d01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.909288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbb4f30a-f633-44d0-a65b-aada4759365f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff9aa4b18a046e48392df7ed9120d01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:34.961584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1547/3136] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:12:34 2022] DELETE /identity/v3/users/cff9aa4b18a046e48392df7ed9120d01 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:35.922057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:35.924631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:35.956557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85977d41-54e5-4330-ad45-da171b6a8340 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.087727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.088388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.089039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.089307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] PATH_INFO: `/v3/projects/91c98a50654447c8b30bbb5783c54e33` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.091176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c98a50654447c8b30bbb5783c54e33)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.095901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.109933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:36.166771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c98a50654447c8b30bbb5783c54e33', 'request_id': 'req-7a5b986b-f10b-41c6-9c5a-0135b0440135'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:36.175034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c98a50654447c8b30bbb5783c54e33', 'request_id': 'req-7a5b986b-f10b-41c6-9c5a-0135b0440135'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:36.182713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c98a50654447c8b30bbb5783c54e33', 'request_id': 'req-7a5b986b-f10b-41c6-9c5a-0135b0440135'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:36.201677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] The token cache is being invalidate because project 91c98a50654447c8b30bbb5783c54e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:36.202079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:36.202945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7a5b986b-f10b-41c6-9c5a-0135b0440135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:36.208050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1590/3137] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:12:35 2022] DELETE /identity/v3/projects/91c98a50654447c8b30bbb5783c54e33 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:36.210055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.210527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.210856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.251874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:36.255152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:36.331754 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1548/3138] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:36.339469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.339749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.340019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.365574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:36.366804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:36.377046 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1591/3139] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:12:36.380079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.390809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3f4e0-2239-4ddc-a3b3-e220693e22a1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.395946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.396585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.396856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.397165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.398157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:12:36.398157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.399662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.412679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1549/3140] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:12:36.417308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.427936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e7322-344a-4032-af6b-900902e795f8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.433050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.433819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.434568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.434844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.435525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.438781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.474846 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1592/3141] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:36.479263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.492299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac577b-1d45-4eb1-981c-6262adce222f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.574413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.575034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.575337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.575583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.576218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.578530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.621108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1550/3142] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:12:36.625296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.643208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c612d88-e867-4f9c-99eb-7cd43b2aea9b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.651682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.652601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.653138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.654531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.655923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.657861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.672429 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1593/3143] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:36.678707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.692311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:36.697320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c450ab-ee2d-44a2-a5b8-af2ef2ee5f41 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.704750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.705477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.706300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.706796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.707770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.710003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c960c5-4ee6-4627-be91-cd9669d44e0a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.727672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:36.734232 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1551/3144] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:36.741485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2fb5d-89d8-4a5a-a2c6-6b52af032fb1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:36.750796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:36.751587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.751921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.752419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] PATH_INFO: `/v3/projects/9333cee966ee488888baa81cca159833/users/edf8e722c29b4428a12703b05e0ebc2a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.771048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9333cee966ee488888baa81cca159833, user_id=edf8e722c29b4428a12703b05e0ebc2a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:36.775022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:36.803757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:36.803985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:36.804337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:36.807866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1594/3145] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:36 2022] PUT /identity/v3/projects/9333cee966ee488888baa81cca159833/users/edf8e722c29b4428a12703b05e0ebc2a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:12:36.841760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] MFA Rules not processed for user `edf8e722c29b4428a12703b05e0ebc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:36.844688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:36.979616 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1552/3146] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:36.984469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.078311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81ef7-76df-40d8-b8ea-d742ed96a8ef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.083414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.084210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.084550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.084867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.085550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.087459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.125903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1595/3147] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:36 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:37.130210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.146047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6632f-93f9-48f3-b91c-9ed9f9d5a922 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.257584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.258261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.258482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.258749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.259391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.267028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.299084 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1553/3148] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:37 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:12:37.302811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.316164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409e1b-3b9f-4f98-bd01-12c197560ae5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.321731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.322475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.322822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.323286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.324146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.326052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccf1a3-3db3-4856-a2c0-6649d8ddca0d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.344664 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1596/3149] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:12:37.346541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.359713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e5e4e-5ecc-4e36-a419-8bcd87131f3e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.367488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.368305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.368722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.369326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] PATH_INFO: `/v3/projects/4c378fdcfd8543489f0b99fda82d836b/users/8252ee4a252a44e9ae8794892bfadaea/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.408867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c378fdcfd8543489f0b99fda82d836b, user_id=8252ee4a252a44e9ae8794892bfadaea, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.419027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.421266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6c90-7f22-480f-b6ce-dfb5d833892a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.421879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6c90-7f22-480f-b6ce-dfb5d833892a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.423063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c6c90-7f22-480f-b6ce-dfb5d833892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.458036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1554/3150] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:37 2022] PUT /identity/v3/projects/4c378fdcfd8543489f0b99fda82d836b/users/8252ee4a252a44e9ae8794892bfadaea/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:12:37.460934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:37.462424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.504898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-618c6c90-7f22-480f-b6ce-dfb5d833892a None None] MFA Rules not processed for user `8a6610a5b8564e59af27b1bab118db28`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:37.506868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-618c6c90-7f22-480f-b6ce-dfb5d833892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:37.579085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:37.604104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a8a0-16fe-4a56-9472-603487ece245 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.616512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.617746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.619378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.619870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.622705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.626857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.678222 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1555/3151] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:12:37.679457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1597/3152] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:37.681489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.710991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968490-8e17-462d-a7d1-4209be45b9e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:37.721982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:37.722794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.723169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.723580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] PATH_INFO: `/v3/projects/4c378fdcfd8543489f0b99fda82d836b/users/8252ee4a252a44e9ae8794892bfadaea/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.726030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c378fdcfd8543489f0b99fda82d836b, user_id=8252ee4a252a44e9ae8794892bfadaea, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:37.731887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:37.757138 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1556/3153] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:37 2022] PUT /identity/v3/projects/4c378fdcfd8543489f0b99fda82d836b/users/8252ee4a252a44e9ae8794892bfadaea/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:37.761823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb295-840a-47f0-9f20-dd59569eeb58 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:37.762136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb295-840a-47f0-9f20-dd59569eeb58 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:37.762414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb295-840a-47f0-9f20-dd59569eeb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:37.822624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c72fb295-840a-47f0-9f20-dd59569eeb58 None None] MFA Rules not processed for user `8252ee4a252a44e9ae8794892bfadaea`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:37.823849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c72fb295-840a-47f0-9f20-dd59569eeb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:37.826114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:37.828097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:38.006144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf4bad-9a2c-4247-8e98-09dc0850dc62 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:38.015328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:38.016365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:38.017671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:38.018842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:38.021124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:38.089039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1598/3154] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:38.094263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:38.096403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:38.097257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:38.130939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] MFA Rules not processed for user `edf8e722c29b4428a12703b05e0ebc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:38.134681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:38.149311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:38.151524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:38.176788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1557/3155] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:12:38.297158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1599/3156] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:38.376263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:38.377843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:38.393517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9e1d-11a6-4a1a-a9f4-aae6f065c0fd service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:38.400007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:38.400650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:38.400926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:38.401275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:38.411304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:38.413550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:38.448238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1558/3157] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:12:39.576312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:39.578603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:39.623864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:39.778882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4dafb0-b39e-4573-a779-acd4f8990685 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:39.788135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:39.789426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:39.790221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:39.790799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] PATH_INFO: `/v3/users/d31742926f754ebfb4914ea5f7269e7e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:39.792420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31742926f754ebfb4914ea5f7269e7e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:39.795769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:39.913350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31742926f754ebfb4914ea5f7269e7e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:39.932222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31742926f754ebfb4914ea5f7269e7e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:39.933647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31742926f754ebfb4914ea5f7269e7e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:39.949880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31742926f754ebfb4914ea5f7269e7e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:39.951119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-003ee493-af6f-4dcd-8e9d-66a4d7fd0a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31742926f754ebfb4914ea5f7269e7e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:40.004491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1600/3158] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:12:39 2022] DELETE /identity/v3/users/d31742926f754ebfb4914ea5f7269e7e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:40.906326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:40.929723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533bab-d473-4225-90e9-d1a52e2dfe95 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:41.020103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:41.038810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:41.039812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.040254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.040688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] PATH_INFO: `/v3/projects/65ac19ca0ab84dc7b0bcfad3962a33b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.042206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ac19ca0ab84dc7b0bcfad3962a33b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:41.045210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:41.184300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'request_id': 'req-4d86f586-a045-405e-b70b-c6408a9013a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:41.208564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'request_id': 'req-4d86f586-a045-405e-b70b-c6408a9013a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:41.219484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ac19ca0ab84dc7b0bcfad3962a33b5', 'request_id': 'req-4d86f586-a045-405e-b70b-c6408a9013a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:41.232673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] The token cache is being invalidate because project 65ac19ca0ab84dc7b0bcfad3962a33b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:41.234003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:41.234465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d86f586-a045-405e-b70b-c6408a9013a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:41.240523 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1559/3159] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:12:40 2022] DELETE /identity/v3/projects/65ac19ca0ab84dc7b0bcfad3962a33b5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:41.242225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3447-cd59-4079-b997-1655876959ad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.242684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3447-cd59-4079-b997-1655876959ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.243520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db3447-cd59-4079-b997-1655876959ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.294532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d6db3447-cd59-4079-b997-1655876959ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:41.301919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6db3447-cd59-4079-b997-1655876959ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:41.520562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1601/3160] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:12:41.528963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.530413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.531017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.596250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:41.597091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:41.624085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1560/3161] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:41.627610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db3447-cd59-4079-b997-1655876959ad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:41.646897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db3447-cd59-4079-b997-1655876959ad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:41.652002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:41.652672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.653022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.653324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.655585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:12:41.655975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:41.671436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:41.692885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1602/3162] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:12:41.694018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:41.714040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158cc62-9700-484c-971e-f4c0d44b3269 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:41.722399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:41.723036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.723316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.723587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.724220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:41.726562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:41.775514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1561/3163] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:41 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:41.780200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:41.800657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96ec9-8459-481d-8833-b8ff3b5b1ecb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:41.861992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:41.953899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:41.954546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:41.954825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:41.955277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:41.955948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:41.976701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:42.022842 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1603/3164] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:41 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:42.027253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:42.095847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833146-88cb-4bbd-aff3-0e6751c2fb72 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:42.102434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:42.116836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:42.118883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:42.119405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:42.121891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:42.124146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:42.184706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:42.198656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1562/3165] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:42.208932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f40b-f80f-4461-bc78-6689643e33d5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:42.233118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:42.234568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:42.234568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:42.234775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:42.235326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:42.238271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7ae0-70d4-4d1e-951e-578b6fe2c3b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:42.271365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1604/3166] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:12:42.275834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:42.290924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cd36d-763c-4b5e-a3f7-7ab238a0e886 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:42.308084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:42.309110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:42.309563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:42.310232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] PATH_INFO: `/v3/projects/940a12592e50434793075265c3a1f9ce/users/fd4567c0f0b244e4a39a5dabdaa88ee8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:42.359732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=940a12592e50434793075265c3a1f9ce, user_id=fd4567c0f0b244e4a39a5dabdaa88ee8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:42.363132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:42.407981 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1563/3167] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:42 2022] PUT /identity/v3/projects/940a12592e50434793075265c3a1f9ce/users/fd4567c0f0b244e4a39a5dabdaa88ee8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:42.409352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263969a-2baa-4d9e-a7e5-438f3a178a4f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:42.409636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263969a-2baa-4d9e-a7e5-438f3a178a4f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:42.409945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263969a-2baa-4d9e-a7e5-438f3a178a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:42.447710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d263969a-2baa-4d9e-a7e5-438f3a178a4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:42.449136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d263969a-2baa-4d9e-a7e5-438f3a178a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:42.572529 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1605/3168] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:42.600582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:42.610933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:42.720082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce9f1-2eff-48b2-ac39-c94145991469 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:42.725132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:42.725834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:42.726217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:42.726652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:42.741563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:42.744268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:42.785269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1564/3169] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:43.923357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:43.923834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:43.923952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:43.958082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] MFA Rules not processed for user `5bd4aa75ffc54e5f840a70d8a901da15`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:43.959601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:44.087474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1606/3170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:45.450560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:45.462524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1301fc-88d4-4b76-b4ba-d54cdbd9230c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:45.469948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:45.470572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:45.470900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:45.471173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:45.473467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:45.500745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:45.502701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:45.520584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1565/3171] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:47.644645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:47.646381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:47.669285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661c1dd-070e-45b1-aae9-672e5c75160d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:47.677474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:47.678448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:47.679053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:47.679525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] PATH_INFO: `/v3/users/c2a4c2cd88304000a7277caf5bb29ed6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:47.681225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a4c2cd88304000a7277caf5bb29ed6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:47.689174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:47.779089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a4c2cd88304000a7277caf5bb29ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:47.781347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:47.790894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a4c2cd88304000a7277caf5bb29ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:47.791596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a4c2cd88304000a7277caf5bb29ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:47.811784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a4c2cd88304000a7277caf5bb29ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:47.813600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-91d6a6c2-a5b1-47f3-bec9-467c329cf5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a4c2cd88304000a7277caf5bb29ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:47.869440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1607/3172] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:12:47 2022] DELETE /identity/v3/users/c2a4c2cd88304000a7277caf5bb29ed6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:49.341147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:49.364251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1357c-0c06-4305-8633-7bd0e55eb742 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:49.398543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:49.515989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:49.517278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:49.517812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:49.518314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] PATH_INFO: `/v3/projects/24dd02df7fd44c1fbe5df55e6ccde4ee` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:49.519890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dd02df7fd44c1fbe5df55e6ccde4ee)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:49.522075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:49.605229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'request_id': 'req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:49.615520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'request_id': 'req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:49.632343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dd02df7fd44c1fbe5df55e6ccde4ee', 'request_id': 'req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:49.656966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] The token cache is being invalidate because project 24dd02df7fd44c1fbe5df55e6ccde4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:49.656966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:49.658821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a34c88f-cbcd-4554-8dbd-23ae492da0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:49.661493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1566/3173] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:12:49 2022] DELETE /identity/v3/projects/24dd02df7fd44c1fbe5df55e6ccde4ee => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:49.666595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:49.667553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:49.668657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:49.700533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:49.704306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:49.876626 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1608/3174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:49.879071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:49.885073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:49.885693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:49.924676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:49.928335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:49.955919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1567/3175] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:49.960383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:49.987969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ac37-8332-4032-9e6b-937b07c2eb58 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.003430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.004127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.004316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.004779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.005702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:12:50.006101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.007758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.040601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1609/3176] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:12:50.044685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.055690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698c3ba-89cb-4e02-9bc0-8c650ab4859c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.078199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.078844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.079123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.079393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.080184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.082136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.157917 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1568/3177] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:50 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:50.163334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.181437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb38b3a-4d99-4eee-805d-9c03f2eaaf29 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.315297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.316578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.317173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.317601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.318261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.321623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.376355 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1610/3178] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:50 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:12:50.380596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.398793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dac0a-3f94-477a-8bdf-990375ed118c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.410035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.411767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.412247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.412667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.414052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.415993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.431263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1569/3179] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:50.435348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.448732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7121aa-76bd-4993-83fd-e43cb2c6e894 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.454185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.454804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.455081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.455352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.455999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.457627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94c3f-64ed-4477-8116-24a630dc99b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.479210 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1611/3180] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:12:50.483663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.502097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82442c0-87bd-4708-88eb-3cec77121bbe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.510367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.511774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.512084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.512363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] PATH_INFO: `/v3/projects/d5ae35d217ff427ebcc72138f864cffc/users/705dd668b8344cea9a74069c202cbe64/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.530288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ae35d217ff427ebcc72138f864cffc, user_id=705dd668b8344cea9a74069c202cbe64, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.533516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.555239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1570/3181] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:50 2022] PUT /identity/v3/projects/d5ae35d217ff427ebcc72138f864cffc/users/705dd668b8344cea9a74069c202cbe64/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:50.557394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaff9f7-c0ea-4bfb-aef8-66197b9a7c77 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.557684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaff9f7-c0ea-4bfb-aef8-66197b9a7c77 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.558125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaff9f7-c0ea-4bfb-aef8-66197b9a7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.591088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5eaff9f7-c0ea-4bfb-aef8-66197b9a7c77 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:50.593442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5eaff9f7-c0ea-4bfb-aef8-66197b9a7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:50.631836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:50.713211 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1612/3182] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:50.749360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:50.752722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:50.817194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:50.838625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df732-456c-4049-a833-c3ec5b8745a5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:50.844192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:50.844903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:50.845286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:50.845628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:50.863052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:50.865068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7f9c9-b4c6-45ac-9481-ddf5adb58c14 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:50.878417 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1571/3183] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:12:54.280651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:54.281620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:54.282174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:54.349041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] MFA Rules not processed for user `fd4567c0f0b244e4a39a5dabdaa88ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:54.350670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:54.477329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:54.477872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:54.477872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:54.484890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1613/3184] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:54.505246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] MFA Rules not processed for user `fd4567c0f0b244e4a39a5dabdaa88ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:54.507127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:54.526817 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1572/3185] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:54.539617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:54.541097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:54.774428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b29d4-3915-4bf2-b895-b24d9eb35e15 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:54.788106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:54.788732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:54.789023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:54.789293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:54.807963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:54.810019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:54.813734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:54.816150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:54.836256 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1614/3186] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:12:54.851806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc209-722d-40b5-a9fa-494747dd5adf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:54.873871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:54.875391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:54.875901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:54.876912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] PATH_INFO: `/v3/users/b7d816c3043c435d8bf79d2c819518ec` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:54.879797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d816c3043c435d8bf79d2c819518ec)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:54.887610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:54.997291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d816c3043c435d8bf79d2c819518ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:54.998568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d816c3043c435d8bf79d2c819518ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:55.016200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d816c3043c435d8bf79d2c819518ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:55.018005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d816c3043c435d8bf79d2c819518ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:55.039151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d264590-2f24-460b-9a1c-cf49930fc89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d816c3043c435d8bf79d2c819518ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:55.092858 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1573/3187] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:12:54 2022] DELETE /identity/v3/users/b7d816c3043c435d8bf79d2c819518ec => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:56.440245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:56.459723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621bd1a-d726-4f0d-a918-f283ba54e995 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:56.605136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:56.636591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:56.637278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:56.637558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:56.637833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] PATH_INFO: `/v3/projects/b9650da009f3482f9fc67cacebd2e09e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:56.640810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9650da009f3482f9fc67cacebd2e09e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:56.643737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:56.778755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9650da009f3482f9fc67cacebd2e09e', 'request_id': 'req-ece22779-5abe-4f1a-a562-08e41c72b939'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:56.798181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9650da009f3482f9fc67cacebd2e09e', 'request_id': 'req-ece22779-5abe-4f1a-a562-08e41c72b939'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:56.805054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9650da009f3482f9fc67cacebd2e09e', 'request_id': 'req-ece22779-5abe-4f1a-a562-08e41c72b939'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:56.833278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] The token cache is being invalidate because project b9650da009f3482f9fc67cacebd2e09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:12:56.833514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:56.834247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ece22779-5abe-4f1a-a562-08e41c72b939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:12:56.835782 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1615/3188] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:12:56 2022] DELETE /identity/v3/projects/b9650da009f3482f9fc67cacebd2e09e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:56.842385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:56.842877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:56.843445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:56.903402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:56.905806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:57.011671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1574/3189] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:57.020245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.020532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.020812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.086946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:57.088310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:57.129384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1616/3190] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:57.133940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.146601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8d05-06a5-4e05-a0ec-8de2e78eb4db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.164366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.165931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.166405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.166978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.167838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:12:57.171243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.173358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.215763 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1575/3191] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:12:57.221449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.240814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e13ca-f5dc-4120-a2f3-7df09afea95b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.253356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.254010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.254292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.254567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.255671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.258913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.340464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.341221 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1617/3192] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:12:57 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:57.359906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd941-7af0-4926-81a4-185c11ec79f3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.502081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:12:57.563029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.563661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.564046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.564187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.565015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.567399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.663252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.673112 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1576/3193] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:12:57 2022] POST /identity/v3/users => generated 299 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:12:57.676636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb329-8c8a-4541-9035-3d0fa45593c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.702576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.703489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.704022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.704572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.705417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.707189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.738015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.738665 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1618/3194] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:57.759480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e2997-34e5-4fee-991a-e7c727a82e2d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.781166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.789604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.789920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.790190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.790907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.792683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc956f34-8feb-4d59-b672-c92745aa1ac6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.830782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1577/3195] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:12:57.835977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:57.849226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060317fc-f108-43c3-96c9-2a0de72b2787 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:57.861390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:57.862341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.863040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.863466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] PATH_INFO: `/v3/projects/26cf3f81f9b74f23a21ddf195abe07e2/users/a99e18a574be45d59ebbdc64b5effc7a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.882445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf3f81f9b74f23a21ddf195abe07e2, user_id=a99e18a574be45d59ebbdc64b5effc7a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:57.886770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:57.924063 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1619/3196] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:12:57 2022] PUT /identity/v3/projects/26cf3f81f9b74f23a21ddf195abe07e2/users/a99e18a574be45d59ebbdc64b5effc7a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:12:57.929041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efa3c8-2195-46f2-b6ef-d3b4f287a3ca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:57.929566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efa3c8-2195-46f2-b6ef-d3b4f287a3ca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:57.929651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efa3c8-2195-46f2-b6ef-d3b4f287a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:57.953986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-67efa3c8-2195-46f2-b6ef-d3b4f287a3ca None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:12:57.955379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67efa3c8-2195-46f2-b6ef-d3b4f287a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:58.113487 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1578/3197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:12:58.141354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:12:58.148440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:12:58.245167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0815a6-20b3-4389-9c05-1bacab8ab3f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:12:58.249485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:12:58.251067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:12:58.251350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:12:58.251778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:12:58.264925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:12:58.266474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:12:58.286371 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1620/3198] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:01.291287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a462-b945-469b-b0ce-69020501a2a7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:01.291822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a462-b945-469b-b0ce-69020501a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:01.291822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a462-b945-469b-b0ce-69020501a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:01.345266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4054a462-b945-469b-b0ce-69020501a2a7 None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:01.346679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4054a462-b945-469b-b0ce-69020501a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:01.482263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1579/3199] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:07.166979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:07.168562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:07.193369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:07.270194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811960f-c4bc-4f2c-ae2f-6a1d9fcea916 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:07.276573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:07.277930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:07.278208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:07.279226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:07.280662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:07.385212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:07.386893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0565117-dda8-456d-937b-edd7eb0333a7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:07.412885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1621/3200] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:08.483761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:08.485124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:08.485572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:08.536742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:08.538316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:08.599151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:08.641019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1580/3201] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:08.652361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039ea4-e1e9-4880-bd41-2ff7dab47ff3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:08.652907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039ea4-e1e9-4880-bd41-2ff7dab47ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:08.652907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42039ea4-e1e9-4880-bd41-2ff7dab47ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:08.679362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-42039ea4-e1e9-4880-bd41-2ff7dab47ff3 None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:08.679569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:08.680860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:08.681107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42039ea4-e1e9-4880-bd41-2ff7dab47ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:08.690303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1622/3202] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:08.760147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:08.760426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:08.760692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:08.850950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] MFA Rules not processed for user `705dd668b8344cea9a74069c202cbe64`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:08.856007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:08.912362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305095d5-f0cc-46b8-bdee-88aef58f2ba1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:08.946000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:08.947077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:08.947517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:08.947953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:08.950007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:08.969688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:08.971569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:08.990078 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1581/3203] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:13:08.991288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:09.008863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f047-717c-49a1-975f-a8fca431f07f service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:09.018336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:09.019215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:09.019756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:09.020212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:09.038884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:09.040685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade6104-7ffd-4866-a674-856bd43aeb9d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:09.063147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1623/3204] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:09.075074 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1582/3205] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:09.348016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:09.349681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:09.391060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16b8a2-6deb-4d01-80f7-9d85a274e308 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:09.413897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:09.417970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:09.418255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:09.418533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:09.453193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:09.454825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bdbbd-766f-41ce-aab2-be4110313a24 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:09.474595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1624/3206] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:10.611990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973de9-19e6-4cb9-afeb-8f2d65bfc90e None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:10.612933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973de9-19e6-4cb9-afeb-8f2d65bfc90e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:10.612933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973de9-19e6-4cb9-afeb-8f2d65bfc90e None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:10.614918 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1583/3207] 10.222.0.78 () {54 vars in 921 bytes} [Tue Oct 18 16:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:13:10.620304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d17d-bf55-40d0-852d-36ed49b11650 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:10.621544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d17d-bf55-40d0-852d-36ed49b11650 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:10.621990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0d17d-bf55-40d0-852d-36ed49b11650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:10.677225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-65c0d17d-bf55-40d0-852d-36ed49b11650 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:10.681660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65c0d17d-bf55-40d0-852d-36ed49b11650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:10.703266 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1625/3208] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:13:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:10.728773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973de9-19e6-4cb9-afeb-8f2d65bfc90e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:10.751203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973de9-19e6-4cb9-afeb-8f2d65bfc90e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:10.764654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:10.765263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:10.765539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:10.765811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:10.821641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:10.830102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f30b7-fec2-47fe-9557-b256fbe7a9fa service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:10.869724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1584/3209] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:13.542929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335f2bb-13f6-408a-8d8b-0bce98b8b455 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:13.543854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335f2bb-13f6-408a-8d8b-0bce98b8b455 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:13.544134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335f2bb-13f6-408a-8d8b-0bce98b8b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:13.589177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a335f2bb-13f6-408a-8d8b-0bce98b8b455 None None] MFA Rules not processed for user `705dd668b8344cea9a74069c202cbe64`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:13.590434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a335f2bb-13f6-408a-8d8b-0bce98b8b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:13.608104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1626/3210] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:20.852159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=50 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:23.574598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:27.409752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9aac7-0a55-4080-987b-59cfd2dcd6ee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:27.410260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9aac7-0a55-4080-987b-59cfd2dcd6ee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:27.410356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9aac7-0a55-4080-987b-59cfd2dcd6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:27.429832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b5f9aac7-0a55-4080-987b-59cfd2dcd6ee None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:27.431032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5f9aac7-0a55-4080-987b-59cfd2dcd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:27.439097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1585/3211] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:27.499155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e2b-a1dd-44bd-bcad-f4d7b8b21609 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:27.499643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e2b-a1dd-44bd-bcad-f4d7b8b21609 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:27.499749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361e2b-a1dd-44bd-bcad-f4d7b8b21609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:27.519122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f361e2b-a1dd-44bd-bcad-f4d7b8b21609 None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:27.520330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f361e2b-a1dd-44bd-bcad-f4d7b8b21609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:27.527132 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1627/3212] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:27.553047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22ae6-3f05-4e7f-87b2-d760a1168ca1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:27.553350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22ae6-3f05-4e7f-87b2-d760a1168ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:27.553601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22ae6-3f05-4e7f-87b2-d760a1168ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:27.573265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d6f22ae6-3f05-4e7f-87b2-d760a1168ca1 None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:27.574455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6f22ae6-3f05-4e7f-87b2-d760a1168ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:27.581308 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1586/3213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:27.605169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:27.605456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:27.605734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:27.625709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:27.626903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:27.633725 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1628/3214] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:27.660819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:27.661131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:27.661401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:27.680608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] MFA Rules not processed for user `a99e18a574be45d59ebbdc64b5effc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:27.681840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:27.689541 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1587/3215] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:35.829804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:35.844912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba413287-a175-480d-ad39-0cbb60132bb3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:35.850572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:35.851374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:35.851675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:35.852197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] PATH_INFO: `/v3/users/a99e18a574be45d59ebbdc64b5effc7a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:35.854616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99e18a574be45d59ebbdc64b5effc7a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:35.859632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:35.927222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99e18a574be45d59ebbdc64b5effc7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:35.937246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99e18a574be45d59ebbdc64b5effc7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:35.937867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99e18a574be45d59ebbdc64b5effc7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:35.947319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99e18a574be45d59ebbdc64b5effc7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:35.947983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec5ded41-e0a1-41d2-815a-054df456bd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99e18a574be45d59ebbdc64b5effc7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:35.968034 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1629/3216] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:13:35 2022] DELETE /identity/v3/users/a99e18a574be45d59ebbdc64b5effc7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:36.167073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.179703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a81f3-d4d9-466d-ba30-dd1f8683141f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.254332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.255001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.255290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.255623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] PATH_INFO: `/v3/projects/26cf3f81f9b74f23a21ddf195abe07e2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.256789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cf3f81f9b74f23a21ddf195abe07e2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.258966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.307726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cf3f81f9b74f23a21ddf195abe07e2', 'request_id': 'req-8cf56b8e-b783-45c6-a005-47ddd03f69ae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:36.315948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cf3f81f9b74f23a21ddf195abe07e2', 'request_id': 'req-8cf56b8e-b783-45c6-a005-47ddd03f69ae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:36.322661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cf3f81f9b74f23a21ddf195abe07e2', 'request_id': 'req-8cf56b8e-b783-45c6-a005-47ddd03f69ae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:36.334171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] The token cache is being invalidate because project 26cf3f81f9b74f23a21ddf195abe07e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:13:36.334460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:36.335114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8cf56b8e-b783-45c6-a005-47ddd03f69ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:36.336714 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1588/3217] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:13:36 2022] DELETE /identity/v3/projects/26cf3f81f9b74f23a21ddf195abe07e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:36.342813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.343172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.343516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.365290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:36.366533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:36.431238 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1630/3218] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:36.440405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.440758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.441129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.463201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:36.464397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:36.473770 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1589/3219] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:36.478353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.490388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e26bc-782d-4368-b29a-ed8b45d558a2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.495229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.495871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.496152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.496551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.497888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:13:36.498284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.499912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.512297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1631/3220] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:13:36.517017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.526284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c3e9-35ca-47f3-9d52-e245e2dcdc55 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.531142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.531816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.532154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.532460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.533118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.535074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.565477 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1590/3221] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:13:36.569696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.579924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73f153-a2d3-4ef3-bd6a-8cc27cb8740a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.627101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:36.642762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.643369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.643641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.643903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.644536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.646456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.669260 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1632/3222] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:13:36.673353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.685226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b10263-c28d-4f80-a86f-6a0e6ae130af admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.690383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.690989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.691264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.691538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.692184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.693798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.707067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1591/3223] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:13:36.708683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.721404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314ba5-6371-41d2-8a3d-0b4cf1cc9cb6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.726768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.727377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.727651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.728054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.728704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.730764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ca4e5-d9f6-47ca-8dd0-bbe92524ba26 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.743204 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1633/3224] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:13:36.747476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.757991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b63961-917a-43be-b39e-9862ad9ea151 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:36.763164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:36.763675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.763960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.764234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] PATH_INFO: `/v3/projects/488805e986a248a6b9fef434664c9b14/users/9f02f6ad29744dd28e493ca3a14f5775/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.779981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488805e986a248a6b9fef434664c9b14, user_id=9f02f6ad29744dd28e493ca3a14f5775, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:36.782664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e57166-5bd4-4525-8383-6f898e455bf8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:36.796641 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1592/3225] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:13:36 2022] PUT /identity/v3/projects/488805e986a248a6b9fef434664c9b14/users/9f02f6ad29744dd28e493ca3a14f5775/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:36.806898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.807178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.807447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.836055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] MFA Rules not processed for user `9f02f6ad29744dd28e493ca3a14f5775`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:36.837305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:36.924120 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1634/3226] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:36.940815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d813b-47ba-41e6-993f-7e2df665dcd9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:36.941241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d813b-47ba-41e6-993f-7e2df665dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:36.941583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d813b-47ba-41e6-993f-7e2df665dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:36.955954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:36.964675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a90d813b-47ba-41e6-993f-7e2df665dcd9 None None] MFA Rules not processed for user `9f02f6ad29744dd28e493ca3a14f5775`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:36.966659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a90d813b-47ba-41e6-993f-7e2df665dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:36.974623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1593/3227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:36.986138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:36.987551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:37.065164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b8acf-fb84-4845-9c35-502a4f9dd6f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:37.070711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:37.071348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:37.071624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:37.071892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:37.080583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:37.082188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:37.091037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1635/3228] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:47.087005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:48.803387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:48.803956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:48.803956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:48.824275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] MFA Rules not processed for user `edf8e722c29b4428a12703b05e0ebc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:48.826117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:48.892900 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1594/3229] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:51.742748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:51.744959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:51.864212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f06a7-ab04-4e59-8678-8231161232e0 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:51.888979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:51.896542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:51.897026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:51.897307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:51.903909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:51.935781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:51.937583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:51.965047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1636/3230] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:13:53.132090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:53.133608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:53.211862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60419c-e61f-4ab9-ae8f-1cb502e3c79b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:53.217322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:53.217959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:53.218234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:53.218505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] PATH_INFO: `/v3/users/e8c66912f0ca4625a0cb274c1386cb28` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:53.219634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c66912f0ca4625a0cb274c1386cb28)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:53.221654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:53.270973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c66912f0ca4625a0cb274c1386cb28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.271691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c66912f0ca4625a0cb274c1386cb28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.278795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c66912f0ca4625a0cb274c1386cb28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.279705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c66912f0ca4625a0cb274c1386cb28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.288516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d6e95a1-3b29-475a-adb1-dcae895ddc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c66912f0ca4625a0cb274c1386cb28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.311448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1595/3231] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:13:53 2022] DELETE /identity/v3/users/e8c66912f0ca4625a0cb274c1386cb28 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:53.625680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:53.642605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876ed4-9c41-4f79-b12d-c2a0a82b8bf4 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:53.739343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:53.740113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:53.740458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:53.740732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] PATH_INFO: `/v3/projects/a26e133352f14345a82cf54eb512f1be` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:53.741963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26e133352f14345a82cf54eb512f1be)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:53.743856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:53.818610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26e133352f14345a82cf54eb512f1be', 'request_id': 'req-ab6c04fc-b654-41b1-88db-574e05a45c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.827078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26e133352f14345a82cf54eb512f1be', 'request_id': 'req-ab6c04fc-b654-41b1-88db-574e05a45c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.833301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26e133352f14345a82cf54eb512f1be', 'request_id': 'req-ab6c04fc-b654-41b1-88db-574e05a45c03'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.847050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] The token cache is being invalidate because project a26e133352f14345a82cf54eb512f1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:13:53.847423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.848104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab6c04fc-b654-41b1-88db-574e05a45c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:13:53.849672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1637/3232] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:13:53 2022] DELETE /identity/v3/projects/a26e133352f14345a82cf54eb512f1be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:53.854523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:53.854800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:53.855125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:53.878486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:53.880083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:53.921929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:53.981368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1596/3233] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:53.989242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:53.991640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:53.992197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.017153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:54.018336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:54.026113 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1638/3234] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:54.030735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.040349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0415-4e94-4b63-bc4c-0a9e4e32ee2c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.045747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.046341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.046618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.046887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.047532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:13:54.047831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.049461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.062076 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1597/3235] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:13:54.066475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.076588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9de0a6-973f-4dc0-a534-67680bcb7fa7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.082436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.083027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.083298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.083564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.084183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.086078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.098609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:54.116950 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1639/3236] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:13:54 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:13:54.121215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.132290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2846e7-8d49-43bd-9cb1-b15e7bcce8c2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.189387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.189994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.190273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.190545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.191196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.193137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.215099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1598/3237] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:13:54 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:13:54.222491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.235290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058044e0-1ff9-4d61-853e-ec98988207bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.240897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.241905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.242583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.243231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.244302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.247428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.270269 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1640/3238] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:13:54.274618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.290238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadd7bb-5860-4b7b-aed5-09930ddbf2ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.295618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.296529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.297185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.297669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.298643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.299663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.300782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.301531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:54.315951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1599/3239] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:13:54.320304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.336239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac242b-c2e1-4d0e-965d-29ee8245d4e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.344276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.347572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.348017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.348468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] PATH_INFO: `/v3/projects/8c5c1a9259f64a7e937a160a7967f708/users/818cfb3b5ddc4838a93a0d301ac89e22/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.370734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5c1a9259f64a7e937a160a7967f708, user_id=818cfb3b5ddc4838a93a0d301ac89e22, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.375050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889216b-815d-4ae2-bc5a-4b1ab96b1b59 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.401112 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1600/3240] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:13:54 2022] PUT /identity/v3/projects/8c5c1a9259f64a7e937a160a7967f708/users/818cfb3b5ddc4838a93a0d301ac89e22/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:13:54.405201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.405488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.405809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.428567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e1de0-4159-409f-9eaa-c56bf352cdcf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.445353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:13:54.446588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:54.537259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.537884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.538158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.538432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.540402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:54.546614 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1601/3241] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:13:54.554415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.556110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee28943-672e-4017-b39e-b129688e5673 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.557697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:13:54.560017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:13:54.571472 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1641/3242] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:13:54.573117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:13:54.659773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa91cc-c462-4100-bcfc-4e7bd082b8bf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:13:54.671622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:13:54.674983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:13:54.675280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:13:54.675516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:13:54.691813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:13:54.693409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158620f6-0784-4041-a0d4-4c55e91f80c1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:13:54.711860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1602/3243] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:14:02.090908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:02.091647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:02.092112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:02.169931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] MFA Rules not processed for user `818cfb3b5ddc4838a93a0d301ac89e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:02.171152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:02.313322 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1642/3244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:02.327012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:02.327764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:02.327764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:02.362203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] MFA Rules not processed for user `818cfb3b5ddc4838a93a0d301ac89e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:02.363527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:02.375511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1603/3245] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:02.773504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:02.774992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:02.780732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:02.871879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a95b1-5b78-4ffc-9af3-3777959f5b22 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:02.879505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:02.880141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:02.880419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:02.880686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:02.893330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:02.895185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:02.909522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1643/3246] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:14:06.756611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:06.758203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:06.790857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c394be0-d281-4541-80d5-b4c3e604f2c9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:06.801276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:06.801954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:06.803108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:06.803402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:06.807274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:06.822084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:06.823678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b56a2d-f690-4b41-9a29-e275e859c2e3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:06.838999 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1604/3247] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:14:07.091696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:07.109592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee4853-270c-4483-b9db-6b0a3fcbdf61 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:07.117224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:07.118270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:07.118832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:07.119390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:07.122705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:07.140774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:07.143057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:07.194207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1644/3248] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:14:16.832652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=32 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:17.155150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=39 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:24.786479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:24.787280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:24.787280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:24.809042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] MFA Rules not processed for user `818cfb3b5ddc4838a93a0d301ac89e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:24.812153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:24.818149 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1605/3249] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:25.832473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:25.833926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:25.859827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae0cd-729f-4daa-9f2f-47fbe6d99d55 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:25.865488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:25.866364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:25.866646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:25.866919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] PATH_INFO: `/v3/users/fd4567c0f0b244e4a39a5dabdaa88ee8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:25.868074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4567c0f0b244e4a39a5dabdaa88ee8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:25.870020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:25.927408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4567c0f0b244e4a39a5dabdaa88ee8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:25.942241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4567c0f0b244e4a39a5dabdaa88ee8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:25.943286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4567c0f0b244e4a39a5dabdaa88ee8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:25.953453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4567c0f0b244e4a39a5dabdaa88ee8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:25.954546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0711ae3f-dde8-4129-afb7-47a120ef8099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4567c0f0b244e4a39a5dabdaa88ee8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.000370 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1645/3250] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:14:25 2022] DELETE /identity/v3/users/fd4567c0f0b244e4a39a5dabdaa88ee8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:14:26.216381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:26.228892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c550c1-aeba-4998-b7d9-31125d62aea0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:26.294140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:26.294801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.295238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.295520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] PATH_INFO: `/v3/projects/940a12592e50434793075265c3a1f9ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.296643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940a12592e50434793075265c3a1f9ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:26.298605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:26.365196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940a12592e50434793075265c3a1f9ce', 'request_id': 'req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.374209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940a12592e50434793075265c3a1f9ce', 'request_id': 'req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.381490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940a12592e50434793075265c3a1f9ce', 'request_id': 'req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.394308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] The token cache is being invalidate because project 940a12592e50434793075265c3a1f9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:14:26.394600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.395409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f7375d1-768c-450c-abd0-0f2f2c23dfb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:26.397375 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1606/3251] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:14:26 2022] DELETE /identity/v3/projects/940a12592e50434793075265c3a1f9ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:14:26.402812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.403047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.404157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.427467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:26.429098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:26.502091 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1646/3252] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:26.512499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.513051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.513469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.537155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:26.538546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:26.549133 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1607/3253] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:14:26.553697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:26.565062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540635a9-04f8-4d3a-a55f-4ca35554e255 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:26.570264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:26.570959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.571296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.571624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.572440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:14:26.572942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:26.575687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:26.589030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1647/3254] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:14:26.592619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:26.602721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159fed6-fe62-4dbb-a855-998fe915bc0e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:26.610561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:26.611178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.611608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.612082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.613296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:26.615428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:26.648291 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1608/3255] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:14:26 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:14:26.649755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:26.663226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ccbe6-a3e9-4874-8372-edcf80190b4c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:26.828735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:26.830141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.830953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.831830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.832699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:26.837892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:26.851073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:26.883420 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1648/3256] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:14:26 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:14:26.888060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:26.910000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4a22-a81a-4a16-ac75-8b6368e06d6a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:26.924358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:26.925379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:26.925917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:26.927605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:26.930492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:26.939206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:26.982219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1609/3257] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:14:26.983848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:27.009602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d7f9-ece0-4690-84d4-cc3a6f51066a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:27.021596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:27.022230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.022508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.022782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.023573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:27.026089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:27.054933 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1649/3258] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:14:27.062086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:27.110467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8afadd-5444-4412-ad9f-39721d2f88ff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:27.133120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:27.134024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.134572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.135022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] PATH_INFO: `/v3/projects/7bf4b812c55648ffb0442df492d45e18/users/f6944b0e6c664113932ae3df467dc537/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.169712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf4b812c55648ffb0442df492d45e18, user_id=f6944b0e6c664113932ae3df467dc537, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:27.174052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5969-0571-40c3-ac6c-4cbd0e1271f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:27.198980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:27.201012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.205047 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1610/3259] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:14:27 2022] PUT /identity/v3/projects/7bf4b812c55648ffb0442df492d45e18/users/f6944b0e6c664113932ae3df467dc537/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:14:27.207300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.207786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.208058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.217062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397a6c-81a5-4d0a-9052-571b383b04b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:27.233048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:27.234413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.253411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:27.299114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:27.299768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.300171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.300431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] PATH_INFO: `/v3/users/9f02f6ad29744dd28e493ca3a14f5775` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.301813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f02f6ad29744dd28e493ca3a14f5775)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:27.304303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:27.315060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1611/3260] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:14:27.326237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:27.327720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.366401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f02f6ad29744dd28e493ca3a14f5775'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:27.380937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f02f6ad29744dd28e493ca3a14f5775'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:27.381837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f02f6ad29744dd28e493ca3a14f5775'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:27.393797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f02f6ad29744dd28e493ca3a14f5775'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:27.394854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d5199e6-38ec-401f-8084-961362f33136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f02f6ad29744dd28e493ca3a14f5775'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:27.424915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ee56-5782-4d63-9269-e71576975d0d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:27.429166 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1650/3261] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:14:27 2022] DELETE /identity/v3/users/9f02f6ad29744dd28e493ca3a14f5775 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:14:27.441295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64806a06-482f-4016-bc0a-584102188a35 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.445019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64806a06-482f-4016-bc0a-584102188a35 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.445675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64806a06-482f-4016-bc0a-584102188a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.481426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-64806a06-482f-4016-bc0a-584102188a35 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:27.483168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64806a06-482f-4016-bc0a-584102188a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.495340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:27.496452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.496578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.496855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.498805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.570627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:27.610869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1651/3262] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:27.622838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64806a06-482f-4016-bc0a-584102188a35 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:27.624320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64806a06-482f-4016-bc0a-584102188a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:27.628672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:27.630193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:27.646103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64806a06-482f-4016-bc0a-584102188a35 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:27.647596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1612/3263] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:14:27.674081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:27.674743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:27.675023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:27.681586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:27.704660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:27.706510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10849849-72fd-4bef-ae0b-0cb87c839900 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:27.731716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1652/3264] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:14:29.038940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:29.041318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:29.055738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d40b42-f53b-4186-84e2-f7d3372c4abd service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:29.063562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:29.064283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.064567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.064837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] PATH_INFO: `/v3/projects/488805e986a248a6b9fef434664c9b14` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.067082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488805e986a248a6b9fef434664c9b14)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:29.072570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:29.140588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:29.195501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488805e986a248a6b9fef434664c9b14', 'request_id': 'req-f286d837-b643-43c3-8d25-d5f721c71698'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:29.217251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488805e986a248a6b9fef434664c9b14', 'request_id': 'req-f286d837-b643-43c3-8d25-d5f721c71698'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:29.233570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488805e986a248a6b9fef434664c9b14', 'request_id': 'req-f286d837-b643-43c3-8d25-d5f721c71698'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:29.265157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] The token cache is being invalidate because project 488805e986a248a6b9fef434664c9b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:14:29.265497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:29.266560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f286d837-b643-43c3-8d25-d5f721c71698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:14:29.267810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1613/3265] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:14:29 2022] DELETE /identity/v3/projects/488805e986a248a6b9fef434664c9b14 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:14:29.273147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.273702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.273702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.304071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:29.305624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:29.445614 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1653/3266] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:29.453653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.453938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.454216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.514942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:29.516289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:29.543297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1614/3267] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:29.547373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:29.561786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d0432-afdc-4f27-b139-a22b4702522c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:29.567921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:29.568646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.568930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.569249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.570296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:14:29.570983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:29.572735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:29.594337 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1654/3268] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:14:29.598569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:29.610688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84987b-b004-40df-9ea4-d08ddccb39b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:29.618675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:29.619403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.619743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.620101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.621116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:29.625181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:29.666419 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1615/3269] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:14:29 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:14:29.675890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:29.692342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d3483-4f2a-4df7-bf0e-46b501cc9059 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:29.846336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:29.848278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.849297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.850365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.851167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:29.856002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:29.928354 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1655/3270] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:14:29 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:14:29.928586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:29.965537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be273be-c1ba-4ec1-96df-ce765154a22a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:29.974795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:29.976200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:29.976698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:29.977162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:29.978258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:29.980409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:30.017437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1616/3271] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:14:30.020950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:30.033805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4879e-8686-4fa6-a4d5-8539611d350d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:30.040053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:30.041086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:30.041586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:30.042005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:30.043233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:30.045663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3692f4-9d16-4aab-b008-8aa9eb0f1787 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:30.068465 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1656/3272] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:14:30.083253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:30.100616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3c637-2dfb-4bcb-a6db-47d9458a9ac4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:30.114088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:30.117007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:30.119052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:30.119352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] PATH_INFO: `/v3/projects/09f13c8b99d641b0b30333ec27f72b9a/users/466ba2f759a34d11b6dd8887bb49554d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:30.163878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f13c8b99d641b0b30333ec27f72b9a, user_id=466ba2f759a34d11b6dd8887bb49554d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:30.167250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:30.209645 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1617/3273] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:14:30 2022] PUT /identity/v3/projects/09f13c8b99d641b0b30333ec27f72b9a/users/466ba2f759a34d11b6dd8887bb49554d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:14:30.215233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726930-7cac-46d6-ab3a-20157ca9f10e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:30.216070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726930-7cac-46d6-ab3a-20157ca9f10e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:30.216647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726930-7cac-46d6-ab3a-20157ca9f10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:30.268267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-75726930-7cac-46d6-ab3a-20157ca9f10e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:30.274253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75726930-7cac-46d6-ab3a-20157ca9f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:30.407726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:30.443315 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1657/3274] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:30.469806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:30.471700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:30.622717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de54969-ea83-4399-85e1-286c314c0f98 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:30.635339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:30.637237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:30.637561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:30.637860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:30.662893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:30.665811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7df20f-fa3b-41c9-92b2-994a0e5d3a99 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:30.682520 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1618/3275] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:14:40.426675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:40.676567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:14:41.463564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:41.464756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:41.464756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:41.545258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:41.546573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:41.777971 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1658/3276] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:41.779775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bee41-aaf4-4cd8-9a8b-e7981e2e65ac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:41.780233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bee41-aaf4-4cd8-9a8b-e7981e2e65ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:41.780469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bee41-aaf4-4cd8-9a8b-e7981e2e65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:41.814650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-454bee41-aaf4-4cd8-9a8b-e7981e2e65ac None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:41.816101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-454bee41-aaf4-4cd8-9a8b-e7981e2e65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:41.825899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1619/3277] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:41.840144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:41.842490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:42.009139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7538c2-96c3-4ede-90ad-5325e85e8b01 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:42.027656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:42.029230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:42.029796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:42.030396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:42.049625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:42.056174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256ef0-f1a2-4334-adc1-1974833e9e20 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:42.083178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1659/3278] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:14:42.127156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:42.127542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:42.127998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:42.207559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] MFA Rules not processed for user `f6944b0e6c664113932ae3df467dc537`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:42.211448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:42.526187 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1620/3279] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:42.537166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d94-92ae-470a-b0c0-b88bf14887be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:42.537783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d94-92ae-470a-b0c0-b88bf14887be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:42.537913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d94-92ae-470a-b0c0-b88bf14887be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:42.577033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb859d94-92ae-470a-b0c0-b88bf14887be None None] MFA Rules not processed for user `f6944b0e6c664113932ae3df467dc537`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:42.578554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb859d94-92ae-470a-b0c0-b88bf14887be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:42.600725 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1660/3280] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:42.832460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:42.834980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:42.893260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ceb88-1ae7-4b71-b043-fa27f1bea7eb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:42.909784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:42.911539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:42.912922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:42.915471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:42.937718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:42.939332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:42.975928 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1621/3281] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:14:52.032180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221de-bff4-4ca4-b5d8-3dd3d22f6257 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:52.033560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221de-bff4-4ca4-b5d8-3dd3d22f6257 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:52.033560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6221de-bff4-4ca4-b5d8-3dd3d22f6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:52.053470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aa6221de-bff4-4ca4-b5d8-3dd3d22f6257 None None] MFA Rules not processed for user `edf8e722c29b4428a12703b05e0ebc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:14:52.054694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa6221de-bff4-4ca4-b5d8-3dd3d22f6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:52.121781 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1661/3282] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:14:52.569952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:14:52.585970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40310571-52fc-43af-95f2-edb414edf856 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:14:52.595823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:14:52.596861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:14:52.597414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:14:52.597982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:14:52.600911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:14:52.720712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:14:52.722419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6c250-efa0-4297-98c0-611c7aeacd64 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:14:52.738402 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1622/3283] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:00.124803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284813-8235-4bf6-b102-abb4ca911493 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:00.125889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284813-8235-4bf6-b102-abb4ca911493 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:00.126377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284813-8235-4bf6-b102-abb4ca911493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:00.171663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6284813-8235-4bf6-b102-abb4ca911493 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:00.173510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6284813-8235-4bf6-b102-abb4ca911493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:00.193450 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1662/3284] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:02.030434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c0f7c-f10b-4bb0-be40-6a8d638661cb None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:02.031787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c0f7c-f10b-4bb0-be40-6a8d638661cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:02.032438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c0f7c-f10b-4bb0-be40-6a8d638661cb None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:02.036082 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1623/3285] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:15:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:15:02.055455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f44577-7a5e-427b-a49a-bf5136e6d489 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:02.056268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f44577-7a5e-427b-a49a-bf5136e6d489 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:02.056268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f44577-7a5e-427b-a49a-bf5136e6d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:02.096652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:02.177944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2f44577-7a5e-427b-a49a-bf5136e6d489 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:02.179629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2f44577-7a5e-427b-a49a-bf5136e6d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:02.202335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1663/3286] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:15:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:02.214079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c0f7c-f10b-4bb0-be40-6a8d638661cb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:02.249599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c0f7c-f10b-4bb0-be40-6a8d638661cb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:02.259864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:02.260530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:02.260861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:02.261168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:02.289473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:02.290918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:02.315365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1624/3287] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:05.119472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:05.122326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:05.123247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:05.167499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] MFA Rules not processed for user `5bd4aa75ffc54e5f840a70d8a901da15`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:05.170456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:05.318887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1664/3288] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:12.305667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=77 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:14.258709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:14.262035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:14.283988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fce154-26d3-4c71-8374-03f25a46d2fb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:14.290905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:14.292665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:14.293474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:14.294750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] PATH_INFO: `/v3/users/818cfb3b5ddc4838a93a0d301ac89e22` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:14.296479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818cfb3b5ddc4838a93a0d301ac89e22)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:14.299530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:14.410473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818cfb3b5ddc4838a93a0d301ac89e22'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:14.412453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818cfb3b5ddc4838a93a0d301ac89e22'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:14.423654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818cfb3b5ddc4838a93a0d301ac89e22'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:14.425150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818cfb3b5ddc4838a93a0d301ac89e22'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:14.439053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-077747a6-038c-4e11-9dda-86f890d00c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818cfb3b5ddc4838a93a0d301ac89e22'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:14.482226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1625/3289] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:15:14 2022] DELETE /identity/v3/users/818cfb3b5ddc4838a93a0d301ac89e22 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:14.859757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:14.893232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116402b2-9fa1-4440-8119-b73fb8822895 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:15.014273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:15.014947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.015202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.015681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] PATH_INFO: `/v3/projects/8c5c1a9259f64a7e937a160a7967f708` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.017573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5c1a9259f64a7e937a160a7967f708)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:15.019542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:15.099689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5c1a9259f64a7e937a160a7967f708', 'request_id': 'req-84e3e60e-935e-4ebb-955a-c9579e68a94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.112401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5c1a9259f64a7e937a160a7967f708', 'request_id': 'req-84e3e60e-935e-4ebb-955a-c9579e68a94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.126239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5c1a9259f64a7e937a160a7967f708', 'request_id': 'req-84e3e60e-935e-4ebb-955a-c9579e68a94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.157811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] The token cache is being invalidate because project 8c5c1a9259f64a7e937a160a7967f708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:15:15.158250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.159313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e3e60e-935e-4ebb-955a-c9579e68a94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.161392 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1665/3290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:15:14 2022] DELETE /identity/v3/projects/8c5c1a9259f64a7e937a160a7967f708 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:15.169051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.169429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.169787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.203837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:15.209552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:15.337321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1626/3291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:15.351748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.352315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.352745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.376419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:15.378427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:15.399871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1666/3292] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:15.417043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:15.429786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e20979-92d8-4b38-b45e-f9703fb2ce53 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:15.436662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:15.437388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.437669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.437937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.439427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:15:15.439739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:15.441486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:15.467582 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1627/3293] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:15:15.468626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:15.484901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee2cb5-f542-4eb6-96e8-9250006515f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:15.490804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:15.491468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.495496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.495814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.496704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:15.499096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:15.526784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:15.529746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:15.543525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:15.571875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad3f95-df5d-431e-b6b2-3f578350c39a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:15.598620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:15.600406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1667/3294] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:15:15 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:15:15.601168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.601518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.601857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] PATH_INFO: `/v3/users/705dd668b8344cea9a74069c202cbe64` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.605966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=705dd668b8344cea9a74069c202cbe64)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:15.606192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:15.609403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:15.688588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705dd668b8344cea9a74069c202cbe64'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.690664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705dd668b8344cea9a74069c202cbe64'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.699673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:15.703462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705dd668b8344cea9a74069c202cbe64'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.705138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705dd668b8344cea9a74069c202cbe64'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.719689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705dd668b8344cea9a74069c202cbe64'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:15.735118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30434-ea42-4833-b153-b7430ebe6830 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:15.753896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:15.755981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:15.756621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:15.757563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:15.759810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1628/3295] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:15:15 2022] DELETE /identity/v3/users/705dd668b8344cea9a74069c202cbe64 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:15.765550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:15.770713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:15.835724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:15.839645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:15.844647 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1668/3296] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:15:15 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:15:16.040010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e44b0-9343-442b-9eaa-8cc8b1319a0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:16.051780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:16.053168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.053786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.054780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.056393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:16.060803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:16.089464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:16.090323 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1629/3297] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:16.118401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21ac06-ebeb-41e9-9068-f86deb44da5e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:16.138643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:16.139283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.139555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.140153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.141152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:16.143476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc029-6e16-4e8b-b434-7760cf153d40 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:16.164618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:16.173368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1669/3298] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:16.212916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a679-1ae0-4d5e-b4d7-a08c3e0a5aa5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:16.258237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:16.266165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.266793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.267254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] PATH_INFO: `/v3/projects/aadf3f3058d14aa29e908f51d70bca8b/users/0e289f4845b44324a447ec0fb303b29b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.314974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadf3f3058d14aa29e908f51d70bca8b, user_id=0e289f4845b44324a447ec0fb303b29b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:16.342609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:16.396199 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1630/3299] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:15:16 2022] PUT /identity/v3/projects/aadf3f3058d14aa29e908f51d70bca8b/users/0e289f4845b44324a447ec0fb303b29b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:16.399051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.401304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.402279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.446316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:16.451862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:16.496454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:16.509496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:16.622072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cfcd-d508-436e-8458-c062d38ae270 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:16.629939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:16.631201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.631735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.632268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] PATH_INFO: `/v3/projects/d5ae35d217ff427ebcc72138f864cffc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.637939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ae35d217ff427ebcc72138f864cffc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:16.640610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:16.690231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1670/3300] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:16.712453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:16.716012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:16.738308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:16.744513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ae35d217ff427ebcc72138f864cffc', 'request_id': 'req-d032cfa7-4939-4ea4-96d7-3ab19fe71169'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:16.757283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ae35d217ff427ebcc72138f864cffc', 'request_id': 'req-d032cfa7-4939-4ea4-96d7-3ab19fe71169'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:16.769980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ae35d217ff427ebcc72138f864cffc', 'request_id': 'req-d032cfa7-4939-4ea4-96d7-3ab19fe71169'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:16.783249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] The token cache is being invalidate because project d5ae35d217ff427ebcc72138f864cffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:15:16.783544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:16.784285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d032cfa7-4939-4ea4-96d7-3ab19fe71169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:16.786131 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1631/3301] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:15:16 2022] DELETE /identity/v3/projects/d5ae35d217ff427ebcc72138f864cffc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:16.793338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8273e-3e98-47ea-93f4-b7e510c40cef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.794063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8273e-3e98-47ea-93f4-b7e510c40cef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.794611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8273e-3e98-47ea-93f4-b7e510c40cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.823949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517b66b-7f1f-4a2d-95d5-05c020e2997f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:16.831979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-12e8273e-3e98-47ea-93f4-b7e510c40cef None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:16.834038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12e8273e-3e98-47ea-93f4-b7e510c40cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:16.860148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:16.904175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:16.905183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.905520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.905862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.908074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:16.954032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1632/3302] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:16.962138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:16.962596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:16.963828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:16.989461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:16.991284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:17.006700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1633/3303] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:17.011345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.018147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.020441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.030966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf74582-054b-4921-bc1c-43dbff3a8a89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.039009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.040054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.040192 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1671/3304] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:17.040523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.041391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.042498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:15:17.042977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.046323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.066495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1634/3305] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:15:17.073097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.090134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff3fcf-b8aa-4f90-8763-9f99dbed63c0 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.101328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.102289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.102779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.103224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.105353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.109868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.169221 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1672/3306] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:15:17 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:15:17.173511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.194725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e8d9-7bf9-4393-bd7a-6afa81b5847b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.370026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.373066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.373763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.374111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.375603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.380271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.430617 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1635/3307] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:15:17 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:15:17.438910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.459468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c5fef-d867-4fd0-8f5a-36aed5d52e6a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.465145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.465779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.466063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.466361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.467044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.468771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.488703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.488953 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1673/3308] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:17.518397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698f880-8067-47ff-88ee-8fa7e86005d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.526283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.527066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.527430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.527784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.528544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.531437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e978d2e-cf6a-443b-a50a-3f61edded622 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.548796 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1636/3309] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:15:17.554153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.589354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be586a61-b0ed-4de4-b122-e9366129243c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:17.597618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:17.598635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.598821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.599200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] PATH_INFO: `/v3/projects/b2d7b38c393e4700b102c1045a7dea8c/users/0a2ebaf04b014f60a9772029677fb02e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.648877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d7b38c393e4700b102c1045a7dea8c, user_id=0a2ebaf04b014f60a9772029677fb02e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:17.665770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:17.716116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1674/3310] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:15:17 2022] PUT /identity/v3/projects/b2d7b38c393e4700b102c1045a7dea8c/users/0a2ebaf04b014f60a9772029677fb02e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:17.718001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a199b7-06c4-42da-9be4-8108fb25da9b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:17.719626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a199b7-06c4-42da-9be4-8108fb25da9b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:17.720133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a199b7-06c4-42da-9be4-8108fb25da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:17.760890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-94a199b7-06c4-42da-9be4-8108fb25da9b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:17.762627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94a199b7-06c4-42da-9be4-8108fb25da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:17.807610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:17.877263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1637/3311] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:17.917757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:17.920428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:18.139539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989ac61-03ed-4b34-bb4b-07c0dfaf703d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:18.147771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:18.148721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:18.149198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:18.149635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:18.171839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:18.174408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada788-ef6b-4c1d-af9f-c7d0a56e7493 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:18.219372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1675/3312] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:27.858421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=12 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:28.185109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:29.712206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:29.715778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:29.716531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:29.855041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] MFA Rules not processed for user `0a2ebaf04b014f60a9772029677fb02e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:29.856650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:30.101219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1638/3313] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:30.103771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a7a5-0eb0-4da0-a4cd-6f318744ebe1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:30.105088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a7a5-0eb0-4da0-a4cd-6f318744ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:30.105812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a7a5-0eb0-4da0-a4cd-6f318744ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:30.161111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b7d8a7a5-0eb0-4da0-a4cd-6f318744ebe1 None None] MFA Rules not processed for user `0a2ebaf04b014f60a9772029677fb02e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:30.163540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7d8a7a5-0eb0-4da0-a4cd-6f318744ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:30.173903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1676/3314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:30.202893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:30.204418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:30.402817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe74ff-738f-4ab4-8f58-659338a97f95 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:30.409783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:30.410690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:30.411404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:30.411785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:30.424207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:30.426221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb26b3-8e66-42b1-b778-14f3354477dd service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:30.471774 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1639/3315] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:32.001810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:32.002471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:32.002625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:32.042635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:32.044212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:32.174249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1677/3316] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:35.236272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:35.237097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:35.237097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:35.313713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] MFA Rules not processed for user `0e289f4845b44324a447ec0fb303b29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:35.315700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:35.414214 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1640/3317] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:35.430912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:35.450284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c4e0d-74d1-4a68-8f39-7f83fd97df60 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:35.458456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:35.459423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:35.459902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:35.460354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:35.471601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:35.475151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf3bf-dac7-4a59-bd9c-57361fecfd19 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:35.545281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1678/3318] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:36.054460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:36.057845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:36.110667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:36.128950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b5e1-ca43-4bdc-9907-a0d77e272687 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:36.158297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:36.159623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:36.161339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:36.166133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] PATH_INFO: `/v3/users/f6944b0e6c664113932ae3df467dc537` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:36.169667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6944b0e6c664113932ae3df467dc537)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:36.171696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:36.337046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6944b0e6c664113932ae3df467dc537'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:36.342349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6944b0e6c664113932ae3df467dc537'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:36.381252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6944b0e6c664113932ae3df467dc537'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:36.383117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6944b0e6c664113932ae3df467dc537'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:36.423555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6944b0e6c664113932ae3df467dc537'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:36.505512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1641/3319] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:15:36 2022] DELETE /identity/v3/users/f6944b0e6c664113932ae3df467dc537 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:37.012203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df413-a073-4d02-9166-89074e9f8cbe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:37.013122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df413-a073-4d02-9166-89074e9f8cbe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:37.013523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5df413-a073-4d02-9166-89074e9f8cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:37.068484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b5df413-a073-4d02-9166-89074e9f8cbe None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:37.076442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b5df413-a073-4d02-9166-89074e9f8cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:37.335797 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1679/3320] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:37.543524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:37.543524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:37.737324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73550bb1-9f29-4316-b870-966e66284618 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:37.755462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:37.756118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:37.756382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:37.759329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] PATH_INFO: `/v3/projects/7bf4b812c55648ffb0442df492d45e18` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:37.760725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf4b812c55648ffb0442df492d45e18)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:37.766508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:37.886722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf4b812c55648ffb0442df492d45e18', 'request_id': 'req-cb34185e-ede7-47af-a49e-f90f250854d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:37.903175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf4b812c55648ffb0442df492d45e18', 'request_id': 'req-cb34185e-ede7-47af-a49e-f90f250854d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:37.934025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf4b812c55648ffb0442df492d45e18', 'request_id': 'req-cb34185e-ede7-47af-a49e-f90f250854d4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:38.000951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] The token cache is being invalidate because project 7bf4b812c55648ffb0442df492d45e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:15:38.001503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:38.007715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb34185e-ede7-47af-a49e-f90f250854d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:38.016219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1642/3321] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:15:37 2022] DELETE /identity/v3/projects/7bf4b812c55648ffb0442df492d45e18 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:38.019062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:38.019579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:38.020029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:38.085737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:38.087893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:38.328025 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1680/3322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:38.338393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:38.338639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:38.339005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:38.358706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:38.366017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:38.369362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:38.394557 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1643/3323] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:38.400400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:38.444972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585da1-7930-4962-99fa-b67dc6efcba8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:38.467841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:38.468521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:38.468867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:38.474918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:38.476193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:15:38.485507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:38.491275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:38.560416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1681/3324] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:15:38.567353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:38.592121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a267f-82a7-4de6-ac42-ac5058548a33 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:38.622723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:38.626615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:38.631642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:38.651230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:38.656557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:38.667051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:38.820074 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1644/3325] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:15:38 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:15:38.826191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:38.862317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5c58b-f07f-441e-9ae0-8cf00d17bb88 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:38.950267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:39.161022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:39.162115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:39.163622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:39.165021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:39.168368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:39.173242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:39.254072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1682/3326] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:15:38 2022] POST /identity/v3/users => generated 287 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:15:39.255023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:39.272397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a6fc-936e-427b-ac28-f01216cf0e43 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:39.283227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:39.283854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:39.284222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:39.284507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:39.286484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:39.288624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:39.317139 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1645/3327] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:15:39.319937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:39.378944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30789ad2-cb5f-4e51-b8ee-92e36763f2f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:39.415923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:39.417228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:39.417626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:39.417936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:39.418954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:39.421793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362184bd-696b-4ee9-b30e-d9043a3ae8a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:39.466373 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1683/3328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:39.470784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:39.495643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13f3d6-441f-4b0d-80c6-0b8b2727220c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:39.515142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:39.515885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:39.516242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:39.516589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] PATH_INFO: `/v3/projects/20d7bce2e1f94ba98eda27d65b4fd20b/users/4563ea21e17d4d9da3a2e10d64f7351c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:39.598356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d7bce2e1f94ba98eda27d65b4fd20b, user_id=4563ea21e17d4d9da3a2e10d64f7351c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:39.601553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a42bc5-77ff-496a-903a-31b653d3d4c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:39.627292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1646/3329] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:15:39 2022] PUT /identity/v3/projects/20d7bce2e1f94ba98eda27d65b4fd20b/users/4563ea21e17d4d9da3a2e10d64f7351c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:15:39.657910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:39.658501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:39.658955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:39.724052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] MFA Rules not processed for user `4563ea21e17d4d9da3a2e10d64f7351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:39.725568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:39.944850 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1684/3330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:40.069628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031553-2dc2-4f9d-b5c0-4ffc69f07834 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:40.070711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031553-2dc2-4f9d-b5c0-4ffc69f07834 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:40.071357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031553-2dc2-4f9d-b5c0-4ffc69f07834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:40.107144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b0031553-2dc2-4f9d-b5c0-4ffc69f07834 None None] MFA Rules not processed for user `4563ea21e17d4d9da3a2e10d64f7351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:40.110220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b0031553-2dc2-4f9d-b5c0-4ffc69f07834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:40.131519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1647/3331] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:40.149549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:40.153364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:40.519528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332930f0-1e07-4efe-9890-d3a0888a44a2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:40.561825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:40.562870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:40.567149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:40.577119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:40.645015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:40.646749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580c395-d461-4ad6-9914-b65c235e7715 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:40.692251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1685/3332] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:41.714810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:41.715483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:41.715689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:41.779775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] MFA Rules not processed for user `4563ea21e17d4d9da3a2e10d64f7351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:41.782071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:41.826521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1648/3333] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:44.142283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccfa33-81a5-4297-8885-1dfc6620f62d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:44.142800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccfa33-81a5-4297-8885-1dfc6620f62d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:44.145583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccfa33-81a5-4297-8885-1dfc6620f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:44.219545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-91ccfa33-81a5-4297-8885-1dfc6620f62d None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:44.237521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-91ccfa33-81a5-4297-8885-1dfc6620f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:44.259904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:44.365883 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1686/3334] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:44.770720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:44.773422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:44.871786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235e402-24e7-4c4c-8faf-cf461be2c291 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:44.877072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:44.878107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:44.878553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:44.879138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:44.882910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:44.931427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:44.935420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:44.962239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1649/3335] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:45.104338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd9a5-f532-4880-b1a0-0614580ac5a7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:45.104952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd9a5-f532-4880-b1a0-0614580ac5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:45.105594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd9a5-f532-4880-b1a0-0614580ac5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:45.130272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7f3bd9a5-f532-4880-b1a0-0614580ac5a7 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:45.132145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f3bd9a5-f532-4880-b1a0-0614580ac5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:45.145890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1687/3336] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:46.426615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:46.428921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:46.454576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180793e-fd97-4f7a-a5a6-cfd1bac84e7e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:46.469730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:46.471765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:46.472487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:46.473419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:46.485505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:46.534518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:46.539775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18589b4-ad40-4683-a53f-3c30405b51e8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:46.567808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1650/3337] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:15:47.524289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:47.526624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:47.527248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:47.574755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:47.576308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:47.587414 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1688/3338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:48.933987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402157e3-08d3-4829-b184-89b924150843 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:48.935598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402157e3-08d3-4829-b184-89b924150843 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:48.936915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402157e3-08d3-4829-b184-89b924150843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:48.976451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-402157e3-08d3-4829-b184-89b924150843 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:48.978183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-402157e3-08d3-4829-b184-89b924150843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:48.998308 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1651/3339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:49.650125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:49.652668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:49.802489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174aa5-4ced-43d6-b653-f5630bd921be None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:49.811822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:49.812832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:49.813321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:49.813771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] PATH_INFO: `/v3/users/0e289f4845b44324a447ec0fb303b29b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:49.815621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e289f4845b44324a447ec0fb303b29b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:49.819545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:49.907130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e289f4845b44324a447ec0fb303b29b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:49.926088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e289f4845b44324a447ec0fb303b29b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:49.927597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e289f4845b44324a447ec0fb303b29b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:49.961554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e289f4845b44324a447ec0fb303b29b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:49.963623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e289f4845b44324a447ec0fb303b29b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:49.996446 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1689/3340] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:15:49 2022] DELETE /identity/v3/users/0e289f4845b44324a447ec0fb303b29b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:50.186462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ceff-5650-4d84-9851-523d42278d81 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:50.187006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ceff-5650-4d84-9851-523d42278d81 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:50.187260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ceff-5650-4d84-9851-523d42278d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:50.220552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e5d9ceff-5650-4d84-9851-523d42278d81 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:50.222126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5d9ceff-5650-4d84-9851-523d42278d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:50.327688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1652/3341] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:50.454122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:50.456493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:50.561620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:50.663311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd74-64e6-4f36-929a-5d526d11cf18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:50.671681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:50.672938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:50.674056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:50.675662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] PATH_INFO: `/v3/projects/aadf3f3058d14aa29e908f51d70bca8b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:50.679152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadf3f3058d14aa29e908f51d70bca8b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:50.682747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:50.779696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadf3f3058d14aa29e908f51d70bca8b', 'request_id': 'req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:50.799335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadf3f3058d14aa29e908f51d70bca8b', 'request_id': 'req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:50.833041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadf3f3058d14aa29e908f51d70bca8b', 'request_id': 'req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:50.881122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] The token cache is being invalidate because project aadf3f3058d14aa29e908f51d70bca8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:15:50.886744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:50.888039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2ecf58b4-dff4-4f78-be28-1d1d5a7a3401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:15:50.893050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1690/3342] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:15:50 2022] DELETE /identity/v3/projects/aadf3f3058d14aa29e908f51d70bca8b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:50.902551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:50.903243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:50.903762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:50.939098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:50.942961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:50.985764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:51.135224 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1653/3343] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:51.139595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388777-312f-42bf-b232-a2722b2803f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.139985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388777-312f-42bf-b232-a2722b2803f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.140515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388777-312f-42bf-b232-a2722b2803f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.276069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1c388777-312f-42bf-b232-a2722b2803f5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:51.278231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c388777-312f-42bf-b232-a2722b2803f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:51.304066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1691/3344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:51.306428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:51.354766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923da1-1322-4c34-bf05-52f0ca25d06b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:51.382954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:51.384407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.385135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.385957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.403082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:15:51.404070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:51.420331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:51.431652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.432012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.432246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.464750 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1654/3345] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:15:51.466116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:51.467508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:51.469629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:51.529323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ddb7a-4e8a-44fb-9749-f753118261c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:51.544061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:51.545149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.545661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.546151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.547634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:51.553663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:51.601735 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1655/3346] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:15:51 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:15:51.607182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:51.673454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1692/3347] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:15:51.825272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340586-d34e-465a-aaf0-20f445a79e5d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:51.840065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:51.843890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.843890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.843890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.843890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:51.846942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:51.899020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:51.903739 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1656/3348] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:15:51 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:15:51.920714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f39e-6f51-4e32-92eb-dbe890e0423c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:51.938549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:51.939485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:51.940040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:51.940534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:51.941451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:51.943324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:51.976702 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1693/3349] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:51.981687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:52.007514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5787ffc-8c24-438e-80c0-2ca4dc8966c4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:52.028952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:52.030024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:52.030539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:52.031676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:52.039430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:52.047217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288b9c-823a-4501-8c71-db35d92f9e71 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:52.084445 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1657/3350] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:15:52.090217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:52.104170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca378-ad5f-4a3f-8e41-fdb544ceb0c4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:52.124861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:52.126151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:52.128192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:52.129123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] PATH_INFO: `/v3/projects/9aec8b651e6d4b89bd98c593b6e932a2/users/1cc60ef5fff74c2eab3f81450c33a4e7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:52.172620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aec8b651e6d4b89bd98c593b6e932a2, user_id=1cc60ef5fff74c2eab3f81450c33a4e7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:52.181727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:52.214827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1694/3351] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:15:52 2022] PUT /identity/v3/projects/9aec8b651e6d4b89bd98c593b6e932a2/users/1cc60ef5fff74c2eab3f81450c33a4e7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:15:52.220090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e3be-e747-4af9-8735-de369d9854b9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:52.221065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e3be-e747-4af9-8735-de369d9854b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:52.221065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e3be-e747-4af9-8735-de369d9854b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:52.246700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8d8e3be-e747-4af9-8735-de369d9854b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:52.248107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8d8e3be-e747-4af9-8735-de369d9854b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:52.386403 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1658/3352] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:52.391889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:52.394530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:52.426169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:52.506454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676af71-31d3-49b5-8a28-dd6ce9f427d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:52.527171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:52.530921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:52.531437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:52.532248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:52.561223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:52.563194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02290ebe-4754-46c8-851b-5a34b53841d9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:52.577869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1695/3353] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:15:52.616163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:52.616630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:52.617034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:52.629133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:15:52.646821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:52.648194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:52.729170 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1659/3354] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:54.063175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d934e-712b-48c8-b98f-3f20176a18f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:54.064473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d934e-712b-48c8-b98f-3f20176a18f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:54.065091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d934e-712b-48c8-b98f-3f20176a18f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:54.137829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca9d934e-712b-48c8-b98f-3f20176a18f3 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:15:54.139380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca9d934e-712b-48c8-b98f-3f20176a18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:54.165869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1696/3355] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:15:55.973892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:15:55.975438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:56.003559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fe77-871e-46cd-adb6-6b316c41db68 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:15:56.015296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:15:56.015957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:15:56.016271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:15:56.016759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:15:56.019548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:15:56.042046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:15:56.043674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a095ce1-23d6-4939-b1c2-69de6e890425 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:15:56.065239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1660/3356] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:01.487035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a76-ff74-4751-9362-420ba8865c11 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:01.488302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a76-ff74-4751-9362-420ba8865c11 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:01.488302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52562a76-ff74-4751-9362-420ba8865c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:01.527459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-52562a76-ff74-4751-9362-420ba8865c11 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:01.527459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52562a76-ff74-4751-9362-420ba8865c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:01.549270 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1697/3357] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:01.956682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763656-ff51-4648-a70b-2e8956d27701 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:01.957288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763656-ff51-4648-a70b-2e8956d27701 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:01.957591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b763656-ff51-4648-a70b-2e8956d27701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:02.068450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9b763656-ff51-4648-a70b-2e8956d27701 None None] MFA Rules not processed for user `1cc60ef5fff74c2eab3f81450c33a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:02.072408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b763656-ff51-4648-a70b-2e8956d27701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:02.210975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:02.213192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:02.213880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:02.229365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1661/3358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:02.245965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:02.248899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:02.251276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858afd-a284-458e-9b03-2e4c68a264bf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:02.251781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858afd-a284-458e-9b03-2e4c68a264bf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:02.252055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef858afd-a284-458e-9b03-2e4c68a264bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:02.286114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1698/3359] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:02.299822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef858afd-a284-458e-9b03-2e4c68a264bf None None] MFA Rules not processed for user `1cc60ef5fff74c2eab3f81450c33a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:02.301845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef858afd-a284-458e-9b03-2e4c68a264bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:02.316619 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1662/3360] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:02.375259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:02.376782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:02.481508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68885-1d3a-4f36-9b40-c20b10638a64 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:02.494561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:02.496207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:02.496457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:02.497185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:02.511774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:02.516089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:02.546565 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1699/3361] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:04.542977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:04.543551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:04.544049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:04.671024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] MFA Rules not processed for user `1cc60ef5fff74c2eab3f81450c33a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:04.673315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:04.740022 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1663/3362] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:07.433864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:07.435976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:07.465869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38428-921a-4640-8411-e1ad418c96e8 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:07.476741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:07.479055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:07.479833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:07.480344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:07.496362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:07.559918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:07.569342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:07.644770 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1700/3363] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:09.238525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:09.256798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4920-0796-426d-8377-e29e3d31489e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:09.266061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:09.266888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:09.267261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:09.267539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:09.296326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:09.317605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:09.319266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e59671-31e8-4ffd-9998-5f7b91f514d9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:09.332608 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1664/3364] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:13.241746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:13.285046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b93d3-1790-4724-959d-daf55d3bc085 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:13.294188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:13.296108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:13.296564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:13.296987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:13.299055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:13.322552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:13.326643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:13.350159 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1701/3365] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:18.903377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5709-df06-495b-9179-16a49b44ebca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:18.904335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5709-df06-495b-9179-16a49b44ebca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:18.904767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be5709-df06-495b-9179-16a49b44ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:18.989335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20be5709-df06-495b-9179-16a49b44ebca None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:18.993491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20be5709-df06-495b-9179-16a49b44ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:19.246383 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1665/3366] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:20.507773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:20.510049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:20.684752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be5709-df06-495b-9179-16a49b44ebca None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:20.687457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20be5709-df06-495b-9179-16a49b44ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:20.698350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:20.708045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be5709-df06-495b-9179-16a49b44ebca None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:20.713725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:20.714688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:20.715161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:20.715620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] PATH_INFO: `/v3/users/0a2ebaf04b014f60a9772029677fb02e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:20.717749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2ebaf04b014f60a9772029677fb02e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:20.720643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:20.843930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2ebaf04b014f60a9772029677fb02e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:20.846697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2ebaf04b014f60a9772029677fb02e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:20.856600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:20.890976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2ebaf04b014f60a9772029677fb02e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:20.893427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2ebaf04b014f60a9772029677fb02e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:20.921837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dab4df87-a993-465f-bae6-2f25db1a8298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2ebaf04b014f60a9772029677fb02e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:20.955595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ff9a8-d2ad-44dd-9980-8197a7e51c17 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:20.965878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:20.967147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:20.967757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:20.968422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:20.972333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:20.994207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:20.997742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:21.018681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1702/3367] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:21.048023 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1666/3368] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:20 2022] DELETE /identity/v3/users/0a2ebaf04b014f60a9772029677fb02e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:16:21.631817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:21.637484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:21.689504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3126c6-79a1-49a4-89c1-a2eebcc863f1 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:21.848890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:21.849748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:21.850031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:21.850310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] PATH_INFO: `/v3/projects/b2d7b38c393e4700b102c1045a7dea8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:21.854783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d7b38c393e4700b102c1045a7dea8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:21.856733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:21.937033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d7b38c393e4700b102c1045a7dea8c', 'request_id': 'req-846df4ea-2ee7-4b60-ad8d-2576995851d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:21.958232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d7b38c393e4700b102c1045a7dea8c', 'request_id': 'req-846df4ea-2ee7-4b60-ad8d-2576995851d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:21.979095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d7b38c393e4700b102c1045a7dea8c', 'request_id': 'req-846df4ea-2ee7-4b60-ad8d-2576995851d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:22.041858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] The token cache is being invalidate because project b2d7b38c393e4700b102c1045a7dea8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:22.042757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:22.045220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846df4ea-2ee7-4b60-ad8d-2576995851d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:22.049043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1703/3369] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:21 2022] DELETE /identity/v3/projects/b2d7b38c393e4700b102c1045a7dea8c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:22.062069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.062872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.063270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.086974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:22.088780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:22.179446 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1667/3370] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:22.193518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.193880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.194453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.277444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:22.286613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:22.317056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:22.321633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1704/3371] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:22.352577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d982cc7-b42c-468a-859a-eefff0ed49aa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:22.361381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:22.362901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.363331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.363808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.364892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:16:22.365989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:22.370855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:22.402910 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1668/3372] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:16:22.410234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:22.425185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe277161-58de-4a4c-8880-1fe33f9b7235 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:22.437825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:22.438684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.439040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.439382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.440109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:22.447041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:22.541418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1705/3373] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:16:22 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:16:22.546888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:22.562525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b7652-a8b8-4804-9b5c-8e69406ff6d9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:22.687021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:22.687993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.688457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.689120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.690208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:22.693095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:22.705483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:22.743885 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1669/3374] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:16:22 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:22.747632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:22.793608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aa3a1-0f58-4dc4-9608-523871002243 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:22.810787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:22.811644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.812095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.812470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.813315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:22.815559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:22.891792 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1706/3375] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:22.898632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:22.933529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851af1-1d31-4b16-bdfd-05f72ae94bae admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:22.955661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:22.955661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:22.955661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:22.956409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:22.957490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:22.959254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b65c4-83f8-4d3a-87c5-3448debb48a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:22.987926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1670/3376] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:22.993322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:23.019454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41e85-577a-43f8-b69b-78624373bc6f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:23.043182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:23.045056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:23.045527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:23.045956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] PATH_INFO: `/v3/projects/95df9210b0dd484abf991849367a2c16/users/70ac3d341e8444fda9964798e94f0d16/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:23.085894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95df9210b0dd484abf991849367a2c16, user_id=70ac3d341e8444fda9964798e94f0d16, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:23.097418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:23.122653 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1707/3377] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:22 2022] PUT /identity/v3/projects/95df9210b0dd484abf991849367a2c16/users/70ac3d341e8444fda9964798e94f0d16/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:23.127843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e6f-c010-45dd-bd20-22a68a19cccc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:23.128501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e6f-c010-45dd-bd20-22a68a19cccc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:23.128501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b704e6f-c010-45dd-bd20-22a68a19cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:23.158133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0b704e6f-c010-45dd-bd20-22a68a19cccc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:23.159563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b704e6f-c010-45dd-bd20-22a68a19cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:23.241431 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1671/3378] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:23.286320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:23.290549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:23.345611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:23.423023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4fa3-b468-46e4-8cf8-45f2c6fd9966 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:23.430400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:23.431038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:23.431319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:23.431659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:23.464010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:23.465527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ada19-db60-4210-9a63-d41a20c50187 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:23.495146 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1708/3379] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:16:23.594475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:23.594761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:23.595035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:23.645663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] MFA Rules not processed for user `edf8e722c29b4428a12703b05e0ebc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:23.646909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:23.776336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1672/3380] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:26.890884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:26.892132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:26.892570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:26.921772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] MFA Rules not processed for user `466ba2f759a34d11b6dd8887bb49554d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:26.923360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:27.050820 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1709/3381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:27.771387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:27.773033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:27.791998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b992-9f3a-41cd-b3c7-403cfd465c66 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:27.798346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:27.799332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:27.799826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:27.800302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] PATH_INFO: `/v3/users/5bd4aa75ffc54e5f840a70d8a901da15` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:27.801785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd4aa75ffc54e5f840a70d8a901da15)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:27.804010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:27.880849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd4aa75ffc54e5f840a70d8a901da15'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:27.882042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd4aa75ffc54e5f840a70d8a901da15'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:27.896548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd4aa75ffc54e5f840a70d8a901da15'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:27.898333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd4aa75ffc54e5f840a70d8a901da15'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:27.931238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd4aa75ffc54e5f840a70d8a901da15'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:27.967671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:27.980084 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1673/3382] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:27 2022] DELETE /identity/v3/users/5bd4aa75ffc54e5f840a70d8a901da15 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:28.391376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:28.409365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679fedc-589f-44b3-98c2-a95e1141bb58 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:28.511619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:28.512747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:28.513219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:28.513647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] PATH_INFO: `/v3/projects/8ad06f3c29294b01ba67eb5d5a1ea59c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:28.515029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad06f3c29294b01ba67eb5d5a1ea59c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:28.518183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:28.624733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'request_id': 'req-eb690373-9fb9-4ebf-89ef-c6197618bd71'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:28.632728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'request_id': 'req-eb690373-9fb9-4ebf-89ef-c6197618bd71'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:28.639991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad06f3c29294b01ba67eb5d5a1ea59c', 'request_id': 'req-eb690373-9fb9-4ebf-89ef-c6197618bd71'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:28.641876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:28.675563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] The token cache is being invalidate because project 8ad06f3c29294b01ba67eb5d5a1ea59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:28.676661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:28.677993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:28.681650 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1710/3383] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:28 2022] DELETE /identity/v3/projects/8ad06f3c29294b01ba67eb5d5a1ea59c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:28.688509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:28.691882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:28.729888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b3e2f-7b1a-4618-bd2e-bc3e463b1bb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:28.870912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:28.874064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:28.874567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:28.875129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] PATH_INFO: `/v3/users/8a6610a5b8564e59af27b1bab118db28` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:28.877022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6610a5b8564e59af27b1bab118db28)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:28.879891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:29.067962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6610a5b8564e59af27b1bab118db28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.069489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6610a5b8564e59af27b1bab118db28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.093096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6610a5b8564e59af27b1bab118db28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.094299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6610a5b8564e59af27b1bab118db28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.116022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-23aa89ef-9bab-4136-9fe7-a36fe9c6eb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6610a5b8564e59af27b1bab118db28'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.173202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1674/3384] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:28 2022] DELETE /identity/v3/users/8a6610a5b8564e59af27b1bab118db28 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:29.534991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:29.540460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:29.559803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb690373-9fb9-4ebf-89ef-c6197618bd71 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:29.650475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:29.654846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:29.655150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:29.655433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] PATH_INFO: `/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:29.657564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96557cf1ece4bea92d6aa56c1ae75f8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:29.662075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:29.759845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96557cf1ece4bea92d6aa56c1ae75f8', 'request_id': 'req-67d11956-7521-48d7-add5-f2d5b466a8b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.773320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96557cf1ece4bea92d6aa56c1ae75f8', 'request_id': 'req-67d11956-7521-48d7-add5-f2d5b466a8b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.785940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96557cf1ece4bea92d6aa56c1ae75f8', 'request_id': 'req-67d11956-7521-48d7-add5-f2d5b466a8b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.805964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] The token cache is being invalidate because project a96557cf1ece4bea92d6aa56c1ae75f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:29.806302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.806950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67d11956-7521-48d7-add5-f2d5b466a8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:29.808790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1711/3385] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:29 2022] DELETE /identity/v3/projects/a96557cf1ece4bea92d6aa56c1ae75f8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:29.814741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:29.815411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:29.815695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:29.846123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:29.848601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:29.974698 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1675/3386] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:29.975989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:29.977038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:29.977884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.037780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:30.045447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:30.057700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1712/3387] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:30.059859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.071010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac535fcf-05a7-48a4-8ee2-9af117b0052f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.076563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.077546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.078037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.078505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.079380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:16:30.079874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.081902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.097879 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1676/3388] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:16:30.103132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.123756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8bff4-46c5-4a56-a527-9e4fc454f7a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.139131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.139919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.140315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.140684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.141482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.143482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.208535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.209416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1713/3389] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:16:30 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:16:30.217219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:30.222075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6df1-869a-481a-8ef3-4aaaa66a821c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.394401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.395436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.395936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.396422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.397554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.418158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.463841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1677/3390] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:16:30 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:30.469271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.492661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb75bb-4d13-42d0-a7b6-bf94dc6a9e7e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.531481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.532144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.532415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.532779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.534144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.546919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.568695 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1714/3391] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:30.573919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.590163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddd920-7761-45c4-8054-baddb16d0fd2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.606323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.606950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.607226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.607547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.608139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.610374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f60489-c6f4-4b53-a807-310cf383029b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.642636 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1678/3392] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:30.647865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:30.709809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c899f-69b1-4734-a6a5-2c10d1a9b53f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:30.736083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:30.739798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.739798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.739798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] PATH_INFO: `/v3/projects/e947ac0005bc45728f3f10f03dd370a4/users/87a5030b8d644e1892866b2a9cd3257d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:30.822970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e947ac0005bc45728f3f10f03dd370a4, user_id=87a5030b8d644e1892866b2a9cd3257d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:30.829060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:30.863916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1715/3393] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:30 2022] PUT /identity/v3/projects/e947ac0005bc45728f3f10f03dd370a4/users/87a5030b8d644e1892866b2a9cd3257d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:30.876186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:30.876445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:30.876891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:31.010688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] MFA Rules not processed for user `87a5030b8d644e1892866b2a9cd3257d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:31.012068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:31.229108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1679/3394] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:31.336247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:31.343428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:31.388611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:31.584567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7357-2b30-4747-b070-0608474859c1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:31.602110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:31.604590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:31.607845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:31.608826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:31.635232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:31.639963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807f4fb-8d11-4fc3-a7d2-14e4e081f009 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:31.676960 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1716/3395] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:32.850791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:32.917606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581cc42-0709-4eb4-8e1d-7721ab713545 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:32.930986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:32.931711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:32.932062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:32.932455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] PATH_INFO: `/v3/users/87a5030b8d644e1892866b2a9cd3257d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:32.934091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a5030b8d644e1892866b2a9cd3257d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:32.936322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:32.954168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:32.995323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a5030b8d644e1892866b2a9cd3257d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:32.995998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a5030b8d644e1892866b2a9cd3257d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:33.004408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a5030b8d644e1892866b2a9cd3257d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:33.005315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a5030b8d644e1892866b2a9cd3257d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:33.015472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a5030b8d644e1892866b2a9cd3257d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:33.057839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1680/3396] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:32 2022] DELETE /identity/v3/users/87a5030b8d644e1892866b2a9cd3257d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:33.062508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:33.062980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:33.062980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:33.087806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:33.089044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:33.172765 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1717/3397] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:33.183507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:33.185730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:33.261709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55e84-95bb-4d80-90a4-76aa74df235c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:33.266928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:33.267993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:33.268506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:33.268911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:33.286824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:33.290614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b5da8-9733-4b15-95c2-022fe9908f2f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:33.307433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1681/3398] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:34.188110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:34.191187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:34.216862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db7254-9d5c-460e-a986-f5728fee30aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:34.225027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:34.226049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.226726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.227182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] PATH_INFO: `/v3/projects/e947ac0005bc45728f3f10f03dd370a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.229255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e947ac0005bc45728f3f10f03dd370a4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:34.232559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:34.335954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e947ac0005bc45728f3f10f03dd370a4', 'request_id': 'req-6219e1de-1c85-4fce-8fd7-89226254d092'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:34.345862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e947ac0005bc45728f3f10f03dd370a4', 'request_id': 'req-6219e1de-1c85-4fce-8fd7-89226254d092'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:34.356909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e947ac0005bc45728f3f10f03dd370a4', 'request_id': 'req-6219e1de-1c85-4fce-8fd7-89226254d092'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:34.377917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] The token cache is being invalidate because project e947ac0005bc45728f3f10f03dd370a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:34.378268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:34.379090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6219e1de-1c85-4fce-8fd7-89226254d092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:34.382430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1718/3399] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:34 2022] DELETE /identity/v3/projects/e947ac0005bc45728f3f10f03dd370a4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:34.389771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.391367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.392178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.454622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:34.455965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:34.603311 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1682/3400] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:34.604725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.605057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.605523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.633979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:34.635654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:34.659862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1719/3401] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:34.660072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:34.676931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213f49-6839-4142-8d54-68b9a1ce47bd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:34.684336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:34.685603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.685995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.686498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.687174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:16:34.687546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:34.689828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:34.713838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1683/3402] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:16:34.715524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:34.727950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450df8a-d408-40b7-8d63-e9943b5382ee None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:34.734721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:34.735486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.735858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.736229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.737336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:34.739712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:34.771647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:34.787518 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1720/3403] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:16:34 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:34.793195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:34.813344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda936-a008-4834-96f8-7e6509bb84c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:34.842954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:34.913104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:34.914679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:34.915177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:34.915677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:34.916435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:34.918621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:34.983814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1684/3404] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:16:34 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:34.989588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:35.010510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987ca85-f23c-4d3b-a0c3-ffde4cf9a4aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:35.018698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:35.020060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:35.020739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:35.021418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:35.022726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:35.027385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:35.045891 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1721/3405] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:16:35.050782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:35.063757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafd84-486f-4dda-9dec-c7c0199d74d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:35.079869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:35.080490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:35.080763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:35.081841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:35.081841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:35.083500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09457f8-0ce9-477a-955c-d03ce9f299d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:35.112258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1685/3406] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:35.112480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:35.130899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbff396-c6ff-4af1-b02c-8793c89e24d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:35.140627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:35.141880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:35.142357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:35.142822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] PATH_INFO: `/v3/projects/676b034a9d2542e8899af31605f2b7fe/users/cfc3e5f2e86f41a69e3179c1c246d3a7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:35.169465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=676b034a9d2542e8899af31605f2b7fe, user_id=cfc3e5f2e86f41a69e3179c1c246d3a7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:35.174248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:35.228967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1722/3407] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:35 2022] PUT /identity/v3/projects/676b034a9d2542e8899af31605f2b7fe/users/cfc3e5f2e86f41a69e3179c1c246d3a7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:35.232560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845948-869e-45c2-8d74-9c8b6150ef7a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:35.238997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845948-869e-45c2-8d74-9c8b6150ef7a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:35.239792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845948-869e-45c2-8d74-9c8b6150ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:35.270246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-89845948-869e-45c2-8d74-9c8b6150ef7a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:35.272058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89845948-869e-45c2-8d74-9c8b6150ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:35.356103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1686/3408] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:35.416712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:35.418554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:35.588641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd24e-ad71-4e3c-b974-dba1cd31bf0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:35.607503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:35.608264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:35.608972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:35.609312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:35.649297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:35.650756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53d559-0b31-44ed-b062-9fdc72ba66eb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:35.705792 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1723/3409] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:37.874114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:37.874668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:37.874668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:37.961475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:37.963776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:38.123258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1687/3410] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:38.146364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:38.147777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:38.149323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:38.191864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:38.198582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:38.223274 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1724/3411] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:38.237591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:38.239091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:38.300034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:38.360757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497f1a1-50bc-46e1-8e75-bdcb558f762b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:38.371229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:38.395454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:38.396308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:38.397872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:38.422183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:38.423854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:38.438715 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1688/3412] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:16:39.520982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:39.526213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:39.691147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7a66e-33b7-47ba-8d0e-9ae8c840afb6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:39.700555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:39.701236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:39.701707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:39.718323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:39.724255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:39.741838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:39.744077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3dc9d-f867-43d0-868b-0a2fb2626597 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:39.792799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1725/3413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:46.461585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:46.503544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:46.504090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:46.504191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe1ef-b7ef-4638-a620-d9e9f023506f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:46.504414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:46.514481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:46.517448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:46.517929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:46.518245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:46.520657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:46.543770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:46.545419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:46.548289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] MFA Rules not processed for user `cfc3e5f2e86f41a69e3179c1c246d3a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:46.553101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:46.575590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1689/3414] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:46.660574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:46.718672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1726/3415] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:47.027790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:47.029442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:47.057214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7aba1-0c21-4e54-86b2-184d1c77f542 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:47.064581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:47.065342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:47.065818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:47.066268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:47.081433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:47.083731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1b02f-87d9-4fe0-be6f-829db0d22661 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:47.108533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1690/3416] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:16:50.614040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:50.617279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:50.646907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb2832-6fec-4d67-b01a-e28aa91795b5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:50.652661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:50.653679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:50.654232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:50.654720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] PATH_INFO: `/v3/users/4563ea21e17d4d9da3a2e10d64f7351c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:50.656987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4563ea21e17d4d9da3a2e10d64f7351c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:50.660343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:50.736812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4563ea21e17d4d9da3a2e10d64f7351c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:50.749842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4563ea21e17d4d9da3a2e10d64f7351c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:50.751586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4563ea21e17d4d9da3a2e10d64f7351c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:50.765513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4563ea21e17d4d9da3a2e10d64f7351c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:50.766728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4563ea21e17d4d9da3a2e10d64f7351c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:50.802667 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1727/3417] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:50 2022] DELETE /identity/v3/users/4563ea21e17d4d9da3a2e10d64f7351c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:50.810047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:50.810894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:50.811476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:50.865784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:50.871511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:51.016588 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1691/3418] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:51.029227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:51.031569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:51.193181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5972b3a-dda1-454a-8ffe-9b2c3205c198 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:51.199406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:51.200570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:51.200957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:51.203070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:51.237791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:51.239398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:51.273316 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1728/3419] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:51.449236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:51.461908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de9bd7-29ed-46a2-9973-4624d118d310 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:51.467148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:51.468176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:51.468670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:51.469238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:51.471585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:51.485942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:51.487919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856a278-ec21-4b3f-a6dd-0bba5fd13bdf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:51.509453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1692/3420] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:53.067800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:53.071015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:53.095922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f1de4-bfde-43ba-996b-6aac4f20a10b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:53.108275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:53.113942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.114268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.114541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] PATH_INFO: `/v3/projects/20d7bce2e1f94ba98eda27d65b4fd20b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.115893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d7bce2e1f94ba98eda27d65b4fd20b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:53.124032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:53.286497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:53.289222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d7bce2e1f94ba98eda27d65b4fd20b', 'request_id': 'req-bfd1daa4-49e6-4958-ab7f-9511968a56e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:53.302880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d7bce2e1f94ba98eda27d65b4fd20b', 'request_id': 'req-bfd1daa4-49e6-4958-ab7f-9511968a56e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:53.333123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d7bce2e1f94ba98eda27d65b4fd20b', 'request_id': 'req-bfd1daa4-49e6-4958-ab7f-9511968a56e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:53.370426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] The token cache is being invalidate because project 20d7bce2e1f94ba98eda27d65b4fd20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:53.371092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:53.372589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bfd1daa4-49e6-4958-ab7f-9511968a56e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:53.378023 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1729/3421] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:53 2022] DELETE /identity/v3/projects/20d7bce2e1f94ba98eda27d65b4fd20b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:53.384419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.385709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.386351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.416153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:53.417738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:53.575256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1693/3422] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:53.583651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.584398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.589843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.619583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:53.621609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:53.645179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1730/3423] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:53.649451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:53.663876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e31a-17e2-40f7-8525-d6b79c3ad169 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:53.673611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:53.674575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.675061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.675516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.676372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:16:53.676872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:53.679692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:53.702960 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1694/3424] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:16:53.703675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:53.734456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854a45-0617-431b-abee-eff09fa38587 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:53.747692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:53.748815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.749392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.750050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.751379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:53.755651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:53.818273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1731/3425] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:16:53 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:16:53.825507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:53.845018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:53.859187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c092466-1af5-4411-85d6-388f9d9fa778 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:53.989044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:53.989738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:53.990102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:53.990491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:53.991358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:53.994464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.033034 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1695/3426] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:16:53 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:54.036580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.065454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eae2-bc7c-4dc7-9903-1abf90960380 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.071168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.071783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.072058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.072336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.073114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.075549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.088757 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1732/3427] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:54.092929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.103702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a08b4-c98b-4142-a115-a73f29a98bf8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.113040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.114096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.114646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.118614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.121847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.123714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd783c05-e8ad-45d0-9b4f-a4fccb9697be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.154380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1696/3428] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:54.155815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.170935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46540b8-cc79-48b1-9b8a-a96850cd2dd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.186061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.187396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.187950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.188477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] PATH_INFO: `/v3/projects/da98433355e64e3683134a7b1fc4ee10/users/12177165ef35462fb753059ceb00501f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.209470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da98433355e64e3683134a7b1fc4ee10, user_id=12177165ef35462fb753059ceb00501f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.213466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.233188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1733/3429] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:54 2022] PUT /identity/v3/projects/da98433355e64e3683134a7b1fc4ee10/users/12177165ef35462fb753059ceb00501f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:16:54.254786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359eb7-d715-485e-9861-283492b68911 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.255263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359eb7-d715-485e-9861-283492b68911 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.255586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1359eb7-d715-485e-9861-283492b68911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.300718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1359eb7-d715-485e-9861-283492b68911 None None] MFA Rules not processed for user `12177165ef35462fb753059ceb00501f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:54.302093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1359eb7-d715-485e-9861-283492b68911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:54.445096 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1697/3430] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:54.449931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.584474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d05a-2126-41fa-95ff-4178291e0fa2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.592005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.592952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.594503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.594503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.595378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.598765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.651925 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1734/3431] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:16:54 2022] POST /identity/v3/projects => generated 403 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:54.653326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1359eb7-d715-485e-9861-283492b68911 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.673061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1359eb7-d715-485e-9861-283492b68911 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.785357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.786929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.787083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.787465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.788183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.792012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.837016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1698/3432] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:16:54 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:54.840556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.861467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d747c9-5d01-43e5-9fb8-a67ef68c9d4f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.875810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.893708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.893708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.896962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:54.897972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:54.900771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:54.934522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1735/3433] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:16:54.940212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:54.953387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:54.967493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f533314-e495-4b54-8cd4-91ae97e78555 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:54.974704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:54.975378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:54.975685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:54.975970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] PATH_INFO: `/v3/projects/62fb395289c941e989ae20930b9554ed/users/a7ac88d7eef44b9193b5afb3cc2f27b7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.017976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fb395289c941e989ae20930b9554ed, user_id=a7ac88d7eef44b9193b5afb3cc2f27b7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:55.020704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:55.045185 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1699/3434] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:54 2022] PUT /identity/v3/projects/62fb395289c941e989ae20930b9554ed/users/a7ac88d7eef44b9193b5afb3cc2f27b7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:55.049258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:55.064702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb7e19-3983-4a08-8cd3-5d9854f6b0e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:55.168334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:55.197095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:55.197727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:55.197999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:55.198436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.199102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:55.200985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b592758-2f8b-42d5-be02-dd7e82ae5306 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:55.217015 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1736/3435] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:16:55.230773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:55.253059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd95e0-4554-41ec-85e0-65da19243b4d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:55.265739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:55.266450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:55.266725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:55.267036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] PATH_INFO: `/v3/projects/62fb395289c941e989ae20930b9554ed/users/a7ac88d7eef44b9193b5afb3cc2f27b7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.270623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fb395289c941e989ae20930b9554ed, user_id=a7ac88d7eef44b9193b5afb3cc2f27b7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:55.274766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:55.333854 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1700/3436] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:55 2022] PUT /identity/v3/projects/62fb395289c941e989ae20930b9554ed/users/a7ac88d7eef44b9193b5afb3cc2f27b7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:55.343319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:55.343612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:55.343886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.403102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] MFA Rules not processed for user `a7ac88d7eef44b9193b5afb3cc2f27b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:55.404345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:55.559242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1737/3437] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:55.559871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:55.582262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61edc-e0d2-4c0d-bf67-3f9aea3fc133 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:55.593457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ac88d7eef44b9193b5afb3cc2f27b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62fb395289c941e989ae20930b9554ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:55.594479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:55.594806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:55.595233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.596806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:55.597597 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:16:55.597597 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:16:55.597597 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:16:55.598653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:55.638322 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1701/3438] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:16:55 2022] POST /identity/v3/roles => generated 239 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:55.640326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:55.657516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15afea-60ec-4a84-9a34-892022252521 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:55.667564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ac88d7eef44b9193b5afb3cc2f27b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62fb395289c941e989ae20930b9554ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:55.668576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:55.669760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:55.670429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] PATH_INFO: `/v3/projects/da98433355e64e3683134a7b1fc4ee10/users/12177165ef35462fb753059ceb00501f/roles/356e1fb7b7d3436d9121d7e485ff1ee6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:55.675741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorizing `identity:create_grant(project_id=da98433355e64e3683134a7b1fc4ee10, user_id=12177165ef35462fb753059ceb00501f, role_id=356e1fb7b7d3436d9121d7e485ff1ee6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:55.696225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fcad1-1992-4927-be0b-680bb61590cb tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:55.742465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:55.749123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1738/3439] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:16:55 2022] PUT /identity/v3/projects/da98433355e64e3683134a7b1fc4ee10/users/12177165ef35462fb753059ceb00501f/roles/356e1fb7b7d3436d9121d7e485ff1ee6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:55.895534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed0e58-903c-458b-be87-f28201a49e27 tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:56.072468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12177165ef35462fb753059ceb00501f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da98433355e64e3683134a7b1fc4ee10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-355327296'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:56.073269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:56.073703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:56.074034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] PATH_INFO: `/v3/users/12177165ef35462fb753059ceb00501f/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:56.075160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: Authorizing `identity:create_application_credential(user_id=12177165ef35462fb753059ceb00501f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:56.076789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:56.190146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:56.207626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:56.208207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:56.208300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:56.208746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1702/3440] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:16:55 2022] POST /identity/v3/users/12177165ef35462fb753059ceb00501f/application_credentials => generated 658 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:16:56.254997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] MFA Rules not processed for user `12177165ef35462fb753059ceb00501f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:56.256624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:56.419966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:56.435202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1739/3441] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:56 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 18 16:16:56.440360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:56.455730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e757d89-aa72-42b2-a16b-3dea4e0b6af3 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:56.461498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12177165ef35462fb753059ceb00501f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da98433355e64e3683134a7b1fc4ee10', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-355327296'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:56.462278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:56.462813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:56.462979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] PATH_INFO: `/v3/users/12177165ef35462fb753059ceb00501f/application_credentials/b231e2d4f22248b5b9a9ab68cf322ea7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:56.466046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: Authorizing `identity:delete_application_credential(user_id=12177165ef35462fb753059ceb00501f, application_credential_id=b231e2d4f22248b5b9a9ab68cf322ea7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:56.467730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:56.517483 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1703/3442] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:16:56 2022] DELETE /identity/v3/users/12177165ef35462fb753059ceb00501f/application_credentials/b231e2d4f22248b5b9a9ab68cf322ea7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:56.522160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:56.606774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e0c9-9b45-4002-a3f9-badd3c3360bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:56.620813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ac88d7eef44b9193b5afb3cc2f27b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62fb395289c941e989ae20930b9554ed', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:56.621827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:56.624184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:56.624422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] PATH_INFO: `/v3/roles/356e1fb7b7d3436d9121d7e485ff1ee6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:56.628645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorizing `identity:delete_role(role_id=356e1fb7b7d3436d9121d7e485ff1ee6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:56.628645 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:16:56.628645 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:16:56.628645 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:16:56.629420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:56.688480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] Invalidating the token cache because role 356e1fb7b7d3436d9121d7e485ff1ee6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:56.689125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:56.690027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0e0c5f5d-5a74-4fda-abdb-33a3577295dc tempest-ApplicationCredentialsV3AdminTest-1737308031 tempest-ApplicationCredentialsV3AdminTest-1737308031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:56.692202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1740/3443] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:56 2022] DELETE /identity/v3/roles/356e1fb7b7d3436d9121d7e485ff1ee6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:56.697827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:56.699599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:56.791522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb91e-58fb-4896-aa66-37204b368bd7 tempest-ApplicationCredentialsV3AdminTest-2032880453 tempest-ApplicationCredentialsV3AdminTest-2032880453-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:56.889969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:56.890942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:56.891504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:56.891843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] PATH_INFO: `/v3/users/12177165ef35462fb753059ceb00501f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:56.893335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12177165ef35462fb753059ceb00501f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:56.896710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:56.980881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12177165ef35462fb753059ceb00501f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:56.981669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12177165ef35462fb753059ceb00501f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:56.997082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12177165ef35462fb753059ceb00501f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:57.000242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12177165ef35462fb753059ceb00501f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:57.015037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12177165ef35462fb753059ceb00501f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:57.054501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1704/3444] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:56 2022] DELETE /identity/v3/users/12177165ef35462fb753059ceb00501f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:16:57.060433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:57.061226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:57.061598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:57.090461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:57.092530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:57.188516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1741/3445] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:16:57.205225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:57.208507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:57.216077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:57.309112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078387b1-f8b4-4700-8fed-f94a269723b2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:57.313303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:57.313925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:57.314203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:57.314474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:57.326505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:57.328984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:57.342426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1705/3446] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:16:57.950549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:57.952733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:57.970346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5803a-e09f-4994-8b66-e73b7c724e5e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:58.002399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:58.002928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:58.003220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:58.003503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] PATH_INFO: `/v3/projects/da98433355e64e3683134a7b1fc4ee10` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:58.009946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da98433355e64e3683134a7b1fc4ee10)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:58.012682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:58.127134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da98433355e64e3683134a7b1fc4ee10', 'request_id': 'req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.131253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:16:58.147753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da98433355e64e3683134a7b1fc4ee10', 'request_id': 'req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.160579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da98433355e64e3683134a7b1fc4ee10', 'request_id': 'req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.198294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] The token cache is being invalidate because project da98433355e64e3683134a7b1fc4ee10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:58.198294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.198294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cc4cf9d-8e9d-45b9-a363-e42c202a7849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.198294 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1742/3447] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:57 2022] DELETE /identity/v3/projects/da98433355e64e3683134a7b1fc4ee10 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:16:58.199000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:58.208330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3816e9d-b2b2-4793-a5e0-a515bf6e870b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:58.288702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:58.289087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:58.289458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:58.318498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:58.319485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:58.320300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:58.320580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] PATH_INFO: `/v3/users/a7ac88d7eef44b9193b5afb3cc2f27b7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:58.322638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] MFA Rules not processed for user `f3bfadddfac24b69b7ae873925514f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:58.324853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:58.328731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ac88d7eef44b9193b5afb3cc2f27b7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:58.330747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:58.439445 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1743/3448] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:16:58.454355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ac88d7eef44b9193b5afb3cc2f27b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.456904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ac88d7eef44b9193b5afb3cc2f27b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.471826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ac88d7eef44b9193b5afb3cc2f27b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.478084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ac88d7eef44b9193b5afb3cc2f27b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.490087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8e838346-d45a-4ca2-a8cf-cc7e74670467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ac88d7eef44b9193b5afb3cc2f27b7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:58.532668 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1706/3449] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:16:58 2022] DELETE /identity/v3/users/a7ac88d7eef44b9193b5afb3cc2f27b7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:16:59.253566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:16:59.256286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:59.296593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786892f-addf-4f0a-b232-de082eea3a42 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:16:59.534343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:16:59.535174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:59.535555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:59.535923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] PATH_INFO: `/v3/projects/62fb395289c941e989ae20930b9554ed` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:59.537294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fb395289c941e989ae20930b9554ed)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:16:59.540555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:16:59.673240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fb395289c941e989ae20930b9554ed', 'request_id': 'req-3d078a34-2bbc-436c-9d29-8fc484c41110'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:59.692180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fb395289c941e989ae20930b9554ed', 'request_id': 'req-3d078a34-2bbc-436c-9d29-8fc484c41110'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:59.709531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fb395289c941e989ae20930b9554ed', 'request_id': 'req-3d078a34-2bbc-436c-9d29-8fc484c41110'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:59.741204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] The token cache is being invalidate because project 62fb395289c941e989ae20930b9554ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:16:59.741846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:59.744658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d078a34-2bbc-436c-9d29-8fc484c41110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:16:59.748695 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1744/3450] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:16:59 2022] DELETE /identity/v3/projects/62fb395289c941e989ae20930b9554ed => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:16:59.759487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50a20-4286-4023-8e72-e041b88e394c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:59.762214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50a20-4286-4023-8e72-e041b88e394c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:59.764817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a50a20-4286-4023-8e72-e041b88e394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:59.868658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-86a50a20-4286-4023-8e72-e041b88e394c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:16:59.875277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-86a50a20-4286-4023-8e72-e041b88e394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:16:59.936760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:16:59.942822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:16:59.943181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:16:59.996652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:00.021115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:00.022862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:00.046634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:00.126877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1707/3451] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:00.128643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca666cef-2f9f-458f-993c-03b800408e7f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.128915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca666cef-2f9f-458f-993c-03b800408e7f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.129334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca666cef-2f9f-458f-993c-03b800408e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.173163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ca666cef-2f9f-458f-993c-03b800408e7f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:00.175747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca666cef-2f9f-458f-993c-03b800408e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:00.190339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1708/3452] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:00.192166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.192548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.192915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.224133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:00.228722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:00.249767 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1745/3453] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:16:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:00.251637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.311543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf13339-822f-4741-b5b5-7e43fe6bbb38 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.329070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.329770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.330077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.330282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.330947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:00.331521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.333520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.364084 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1709/3454] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:00.371184 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1746/3455] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:00.374354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.376619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.378448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:00.390847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b70e89-138d-481a-a6fd-87688432a268 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.396861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.398556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.399522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.399522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.400241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.402543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.457343 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1710/3456] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:00 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:00.465541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.593181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5e7e6-4a01-4e8e-86cd-e9e39e250a73 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.650318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb81fd7-a1d8-4d88-b426-e1be032817b1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.661431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.664163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.664807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.665249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.666275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.668480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.709864 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1711/3457] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:00 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:00.714615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.753113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f9281-165b-4729-bd6d-ee38e8869e00 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.765261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.766306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.766894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.767359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.769937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.772529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.774099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.774544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.778250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.783181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.804455 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1712/3458] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:00.810520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.854891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195a78-ff1b-4ddd-9d64-8c5ba87d4d73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:00.861242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:00.868901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:00.869902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:00.871685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:00.873051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:00.874325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.879614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.887344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:00.889393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:00.906299 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1713/3459] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:00.910822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1747/3460] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:17:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:17:00.925829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.951693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:00.953601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:00.993704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1f2e-5ec0-4121-ab4a-18b7dcfa1f39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:01.013105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:01.013789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.014062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.014330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] PATH_INFO: `/v3/projects/a8bd645aca0d4d9e9e7962feb478aef7/users/cebad4fb775d4630a69fa6210f61c003/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.025092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:01.059599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8bd645aca0d4d9e9e7962feb478aef7, user_id=cebad4fb775d4630a69fa6210f61c003, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:01.070566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed075496-7d4e-43a3-97e9-d6183b031278 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:01.088875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1ddc1-987e-4d68-a4c6-6939fd78fdaf service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:01.134535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1714/3461] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:00 2022] PUT /identity/v3/projects/a8bd645aca0d4d9e9e7962feb478aef7/users/cebad4fb775d4630a69fa6210f61c003/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:01.136034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.136434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.136922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.183210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:01.184116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.188964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.190078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.193192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:01.211397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:01.215885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:01.219847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] MFA Rules not processed for user `cebad4fb775d4630a69fa6210f61c003`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:01.221187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:01.238532 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1748/3462] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:17:01.404425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1715/3463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:01.409079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:01.579542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a1244-535b-4e66-89b7-c6e66b486559 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:01.584677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:01.585405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.586067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.586336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.587194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:01.589946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:01.634363 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1749/3464] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:01 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:01.639020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:01.659324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4e6a-3d09-44c9-9b20-9b397c414b53 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:01.811150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:01.812005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.812290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.812658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.813636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:01.816537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:01.920742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:01.924459 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1716/3465] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:01 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:01.967722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5eb4f-04b7-4e07-a821-0c036bc26837 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:01.982431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:01.986524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:01.986950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:01.992137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:01.994639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:01.996392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.043005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.052191 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1750/3466] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:02.056835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddca63a-6f9c-4446-b2b1-0e641d1ad90e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.061971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.063020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.063403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.063778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] PATH_INFO: `/v3/projects/22e8d1c387944237be99588b6742e865/users/0ead7bbdf2824331bf8394ebab72fbb7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.093365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e8d1c387944237be99588b6742e865, user_id=0ead7bbdf2824331bf8394ebab72fbb7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.098518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.146492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1717/3467] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:02 2022] PUT /identity/v3/projects/22e8d1c387944237be99588b6742e865/users/0ead7bbdf2824331bf8394ebab72fbb7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:02.146737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.170201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396757-58d1-40ff-965a-92915ca3c498 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.222709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:02.312453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.313125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.313453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.313721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.314406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.315984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8710d-4726-44fa-9d23-ad821446ef0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.340470 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1751/3468] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:02.347654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.393926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b70a2a-897d-459c-b631-83ebfdc88bda admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.422071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.424888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.427179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.427770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] PATH_INFO: `/v3/projects/22e8d1c387944237be99588b6742e865/users/0ead7bbdf2824331bf8394ebab72fbb7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.432303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e8d1c387944237be99588b6742e865, user_id=0ead7bbdf2824331bf8394ebab72fbb7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.436359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.463909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1718/3469] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:02 2022] PUT /identity/v3/projects/22e8d1c387944237be99588b6742e865/users/0ead7bbdf2824331bf8394ebab72fbb7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:02.464820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.465326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.465418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.503208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.506977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:02.510016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] MFA Rules not processed for user `0ead7bbdf2824331bf8394ebab72fbb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:02.511334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:02.554072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:02.608099 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1752/3470] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:02.630965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.650503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9373113-f4cf-4436-b688-1f99d43e1da9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.660570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.661935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.663464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.664303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.665849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.668097 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:02.668097 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:02.668097 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:02.670136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.695764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca154-8bd0-49ce-8b81-9ff65162b4ab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.714419 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1753/3471] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/services => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:02.716520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.741730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.742100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.742371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.742634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.751051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:02.770569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6da20-301f-4f3c-b87e-6af1eaecd349 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.773236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.775148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.781375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.782526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.783223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.783989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.785573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.787911 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:02.787911 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:02.787911 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:02.790697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.815863 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1719/3472] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:02 2022] GET /identity/v3/auth/tokens => generated 3441 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6508ee9c-b9c5-49b5-bd06-c7e32a755a1b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: On instance['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: On instance['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: 'False' Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise error Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'False' Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.833826 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:17:02.836965 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'False' Oct 18 16:17:02.839442 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:02.843463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1754/3473] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/endpoints => generated 283 bytes in 125 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:17:02.847015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.874882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4b278-7670-41ad-b771-636bfe86fa59 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:02.895040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.895040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.895040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.901961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:02.903301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:02.904629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:02.905418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:02.908841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:02.911117 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:02.911117 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:02.911117 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:02.913384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: On instance['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: On instance['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: 'True' Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise error Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'True' Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.933506 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:17:02.938325 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'True' Oct 18 16:17:02.940919 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:02.950797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1720/3474] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/endpoints => generated 281 bytes in 100 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:17:02.950921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:02.950921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:02.953078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:02.987523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12f1da-644a-4cf8-a69a-9dbd223877bc tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.009944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.010962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.011449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.011923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.013545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.017271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.090622 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-143564925. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:17:03.090622 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:17:03.090622 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:03.142662 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1755/3475] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3377 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:03.170937 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1721/3476] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:17:02 2022] POST /identity/v3/endpoints => generated 358 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:03.172332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.217562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e00ebf-b43b-4a2b-a47d-15b433d47ec4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.226609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:03.248917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.249947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.250253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.250567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/regions/tempest-region-143564925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.251131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-143564925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.252220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.254733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1756/3477] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:17:03 2022] GET /identity/v3/regions/tempest-region-143564925 => generated 178 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:03.258791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.273272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3653b4-049e-4dc4-8d1d-68d3b58a2f8a tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.280289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.281469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.282006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.282532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints/cc2ecbe88598413f9f5b53f452057f8e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.294687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cc2ecbe88598413f9f5b53f452057f8e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.297589 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:03.297589 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:03.297589 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:03.299401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: On instance['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: On instance['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: 'False' Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise error Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'False' Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.311115 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:17:03.312808 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'False' Oct 18 16:17:03.314856 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:17:03.321993 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1722/3478] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 18 16:17:03 2022] PATCH /identity/v3/endpoints/cc2ecbe88598413f9f5b53f452057f8e => generated 283 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:17:03.326363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.340504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2961-edbf-4daf-b5a2-3da52fc02a9e tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.354880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.355834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.357479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.358001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints/cc2ecbe88598413f9f5b53f452057f8e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.362993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cc2ecbe88598413f9f5b53f452057f8e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.364011 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:03.364011 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:03.364011 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:03.369017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.393049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cc2ecbe88598413f9f5b53f452057f8e', 'request_id': 'req-766d4a60-8208-4de9-9eec-d8c115e0fc2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:03.417923 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1757/3479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:03 2022] DELETE /identity/v3/endpoints/cc2ecbe88598413f9f5b53f452057f8e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:03.419184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.434632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a172-bd0b-43bb-8229-20ba6559191d tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.461435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.462089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.462368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.463152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/regions/tempest-region-143564925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.463806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-143564925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.465422 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:03.465422 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:03.465422 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:03.466942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.521321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1723/3480] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:17:03 2022] DELETE /identity/v3/regions/tempest-region-143564925 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:03.524093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.540982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a60-8208-4de9-9eec-d8c115e0fc2b tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.585213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.587491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.588092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.589755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.602310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.608577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.677032 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-170671301. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:17:03.677032 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:17:03.677032 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:03.730967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1758/3481] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:17:03 2022] POST /identity/v3/endpoints => generated 359 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:03.735582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.750308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836473a9-ff2f-4ebf-9b14-990133a46068 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.826451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.827322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.827611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.830047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/regions/tempest-region-170671301` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.830047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-170671301)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.830047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.835378 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1724/3482] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:17:03 2022] GET /identity/v3/regions/tempest-region-170671301 => generated 178 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:03.836874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.859274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3fde9-7448-465b-83c8-380c9a406e0f tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.873529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.874627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.874627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.874850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints/cd0c4d6babe64747b93c7235105f072d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.891964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=cd0c4d6babe64747b93c7235105f072d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.892604 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:03.892604 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:03.892604 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:03.893713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: On instance['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: On instance['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: 'True' Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise error Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'True' Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.902318 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:17:03.904890 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['enabled']: Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'True' Oct 18 16:17:03.907807 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:03.910095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:03.910968 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1759/3483] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Oct 18 16:17:03 2022] PATCH /identity/v3/endpoints/cd0c4d6babe64747b93c7235105f072d => generated 281 bytes in 75 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:17:03.929365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8e6d1-c7fa-4eab-a7d8-624f08f55f04 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:03.944468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:03.947278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:03.947665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:03.947922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/endpoints/cd0c4d6babe64747b93c7235105f072d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:03.950613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=cd0c4d6babe64747b93c7235105f072d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:03.951057 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:03.951057 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:03.951057 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:03.952668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:03.974143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'cd0c4d6babe64747b93c7235105f072d', 'request_id': 'req-8871dc44-0e0a-4c90-825a-04055bfd58ba'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.002096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:04.003746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1725/3484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:17:03 2022] DELETE /identity/v3/endpoints/cd0c4d6babe64747b93c7235105f072d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:04.019447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645f20-7fa5-44b7-96b0-d60ab8ba49ad tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:04.052624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:04.053412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:04.053976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:04.054258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/regions/tempest-region-170671301` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:04.055550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-170671301)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:04.056913 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:04.056913 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:04.056913 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:04.063529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:04.119917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1760/3485] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:17:04 2022] DELETE /identity/v3/regions/tempest-region-170671301 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:04.128153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:04.144496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dc44-0e0a-4c90-825a-04055bfd58ba tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:04.180442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ead7bbdf2824331bf8394ebab72fbb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22e8d1c387944237be99588b6742e865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:04.181378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:04.181714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:04.182077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] PATH_INFO: `/v3/services/7e2b19fab38d4fd0a36172684fd01fda` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:04.182777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7e2b19fab38d4fd0a36172684fd01fda)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:04.184108 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:04.184108 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:04.184108 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:04.185199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7101e2-6c83-4e19-b76a-fb179e7c7387 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:04.263061 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1726/3486] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:04 2022] DELETE /identity/v3/services/7e2b19fab38d4fd0a36172684fd01fda => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:04.264476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:04.438497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77c6cc-f666-4f51-875d-1e67ec1b2740 tempest-EndpointsNegativeTestJSON-531453386 tempest-EndpointsNegativeTestJSON-531453386-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:04.465922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:04.466716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:04.466995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:04.467389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] PATH_INFO: `/v3/users/cebad4fb775d4630a69fa6210f61c003` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:04.481115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebad4fb775d4630a69fa6210f61c003)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:04.481115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:04.624242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:04.653307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebad4fb775d4630a69fa6210f61c003'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.667303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebad4fb775d4630a69fa6210f61c003'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.669062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebad4fb775d4630a69fa6210f61c003'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.693840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebad4fb775d4630a69fa6210f61c003'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.695604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebad4fb775d4630a69fa6210f61c003'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:04.741760 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1761/3487] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:04 2022] DELETE /identity/v3/users/cebad4fb775d4630a69fa6210f61c003 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:04.747111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:04.747512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:04.747661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:04.829949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:04.836309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:04.867630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:04.916386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:04.919049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:05.047368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1727/3488] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:05.062379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:05.064204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:05.150630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d76b6-9694-4779-967a-83aafde0fe92 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:05.162569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:05.164031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:05.164716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:05.165135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:05.168557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:05.207115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71aa4e-0bc7-4bb1-89ba-090fce5b2dae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:05.219068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:05.222626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:05.222975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:05.223334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:05.254048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:05.258125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:05.290444 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1728/3489] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:17:05.347263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:05.349359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:05.421059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1762/3490] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:06.194763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:06.196524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:06.219489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea370de-874c-4cae-a827-21c147b40696 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:06.237956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:06.239184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:06.239184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:06.239184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] PATH_INFO: `/v3/projects/a8bd645aca0d4d9e9e7962feb478aef7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:06.242453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8bd645aca0d4d9e9e7962feb478aef7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:06.245918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:06.361857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8bd645aca0d4d9e9e7962feb478aef7', 'request_id': 'req-8c24a005-a10e-459e-841c-da83ee8f49b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.378971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8bd645aca0d4d9e9e7962feb478aef7', 'request_id': 'req-8c24a005-a10e-459e-841c-da83ee8f49b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.396572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8bd645aca0d4d9e9e7962feb478aef7', 'request_id': 'req-8c24a005-a10e-459e-841c-da83ee8f49b2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.426017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] The token cache is being invalidate because project a8bd645aca0d4d9e9e7962feb478aef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:06.426385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.429917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.432766 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1729/3491] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:06 2022] DELETE /identity/v3/projects/a8bd645aca0d4d9e9e7962feb478aef7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:06.437320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:06.462700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03e589-4a4f-4649-80e6-c5bd44bef986 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:06.555377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:06.611728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:06.612774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:06.613278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:06.613716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] PATH_INFO: `/v3/users/0ead7bbdf2824331bf8394ebab72fbb7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:06.626216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ead7bbdf2824331bf8394ebab72fbb7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:06.632178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:06.773862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ead7bbdf2824331bf8394ebab72fbb7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.804285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ead7bbdf2824331bf8394ebab72fbb7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.805352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ead7bbdf2824331bf8394ebab72fbb7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.821099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ead7bbdf2824331bf8394ebab72fbb7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.826703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-584d71bd-087c-4999-9bf4-4a2341e0e9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ead7bbdf2824331bf8394ebab72fbb7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:06.885760 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1763/3492] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:06 2022] DELETE /identity/v3/users/0ead7bbdf2824331bf8394ebab72fbb7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:08.088572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:08.089963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:08.141904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a005-a10e-459e-841c-da83ee8f49b2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:08.251273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:08.343592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:08.344231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:08.344506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:08.344797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] PATH_INFO: `/v3/projects/22e8d1c387944237be99588b6742e865` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:08.346340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e8d1c387944237be99588b6742e865)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:08.348890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:08.523410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e8d1c387944237be99588b6742e865', 'request_id': 'req-c97fd927-3646-407a-8dd7-009f45b9dca6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:08.543446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e8d1c387944237be99588b6742e865', 'request_id': 'req-c97fd927-3646-407a-8dd7-009f45b9dca6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:08.556475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e8d1c387944237be99588b6742e865', 'request_id': 'req-c97fd927-3646-407a-8dd7-009f45b9dca6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:08.588169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] The token cache is being invalidate because project 22e8d1c387944237be99588b6742e865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:08.588884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:08.590148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c97fd927-3646-407a-8dd7-009f45b9dca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:08.597148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1730/3493] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:08 2022] DELETE /identity/v3/projects/22e8d1c387944237be99588b6742e865 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:08.602989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:08.603525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:08.603525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:08.637488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:08.639203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:08.861554 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1764/3494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:08.863985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:08.864276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:08.864545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:08.907531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:08.909575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:08.930819 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1731/3495] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:08.932383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:08.946423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7cec7-91e5-4719-8a94-86fb967ee65c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:08.965935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:08.967380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:08.967822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:08.968359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:08.969725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:08.970257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:08.973188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.003009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1765/3496] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:09.010350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:09.028084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bef06-a883-4415-8a84-b1b5f8fd969b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:09.044271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:09.045510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.045909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.046289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.047032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:09.052207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.169380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1732/3497] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:09 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:09.171274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:09.192167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf63e78-945f-42ac-88d1-ce3fa8660f0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:09.313222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:09.363815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:09.364962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.365273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.365548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.367140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:09.370576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.405718 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1766/3498] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:09 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:09.410471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:09.449580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede45b-54ec-400b-a2ae-29dbbdc79d2c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:09.457715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:09.459062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.460074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.460489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.461290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:09.462905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.478694 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1733/3499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:09.482860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:09.495740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46197aba-d779-4e69-8a08-70713138662d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:09.500820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:09.501480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.501758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.502205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.502864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:09.504645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c0bc8-37b5-4ac3-92b7-faf9988a07a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.521551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1767/3500] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:09.524458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:09.535239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1712-77b7-475b-9250-aef24819fb75 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:09.543107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:09.543780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.544054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.544320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] PATH_INFO: `/v3/projects/1a6e0d32b1ae432dbd39afab2b173efd/users/0c4e71e6394447cea77f5a5eeac28f3d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.565118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6e0d32b1ae432dbd39afab2b173efd, user_id=0c4e71e6394447cea77f5a5eeac28f3d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:09.568081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:09.587596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1734/3501] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:09 2022] PUT /identity/v3/projects/1a6e0d32b1ae432dbd39afab2b173efd/users/0c4e71e6394447cea77f5a5eeac28f3d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:09.604120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:09.608471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:09.610744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:09.747282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] MFA Rules not processed for user `0c4e71e6394447cea77f5a5eeac28f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:09.751237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:10.053277 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1768/3502] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:10.059590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.255370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fc9d2-9a2b-4ccf-af82-17d97e078431 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.268578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.269377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.269715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.270138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.270755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.275657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:10.285123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:10.332133 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1735/3503] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:10 2022] POST /identity/v3/projects => generated 365 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:10.336279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.362747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b5b43-cfe2-4914-97ab-abdaa19762f6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.511484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.512482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.512939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.513533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.528518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.532016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:10.594202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1769/3504] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:10 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:10.594465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.614983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cf722-eeb8-4813-966c-1679caa17450 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.632250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.632903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.633975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.633975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.634621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.640128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:10.666689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1736/3505] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:10.671020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.700140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32251b-8d52-4bbd-94b3-5ca9478ae6cb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.707154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.709089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.709462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.710456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] PATH_INFO: `/v3/projects/93e7182dbc75414b826a556ea1dc95fd/users/6992b06eafe34ede9565e0dd0e931468/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.757205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7182dbc75414b826a556ea1dc95fd, user_id=6992b06eafe34ede9565e0dd0e931468, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.760374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:10.788712 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1770/3506] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:10 2022] PUT /identity/v3/projects/93e7182dbc75414b826a556ea1dc95fd/users/6992b06eafe34ede9565e0dd0e931468/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:10.792394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.804643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b424f-df0e-428a-b0bc-2e31348c8142 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.897269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.898625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.898803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.899402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.900183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.901968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912734b-274f-4be4-a33e-560924474868 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:10.918097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1737/3507] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:10.922166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:10.956432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b56e7f-3866-440f-a6a7-35b501512f5f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:10.972823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:10.974585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:10.974585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:10.974838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] PATH_INFO: `/v3/projects/93e7182dbc75414b826a556ea1dc95fd/users/6992b06eafe34ede9565e0dd0e931468/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:10.985492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7182dbc75414b826a556ea1dc95fd, user_id=6992b06eafe34ede9565e0dd0e931468, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:10.995955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.027248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:11.047530 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1771/3508] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:10 2022] PUT /identity/v3/projects/93e7182dbc75414b826a556ea1dc95fd/users/6992b06eafe34ede9565e0dd0e931468/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:11.060786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.061471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.061973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.128079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] MFA Rules not processed for user `6992b06eafe34ede9565e0dd0e931468`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:11.129957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:11.310607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1738/3509] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:11.314771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.337113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b8b61-e45a-4fdd-b10d-dc1fb7880dfc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.348962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.350046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.350552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.351228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.352120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.353411 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:11.353411 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:11.353411 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:11.356819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.392804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1772/3510] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:17:11 2022] POST /identity/v3/domains => generated 276 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:11.398043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.412195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35d764-7d4d-446a-942e-108f5edc105d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.541774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:11.549780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.550394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.550669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.550938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.551550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.552576 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:11.552576 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:11.552576 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:11.554434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.641500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1739/3511] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:11 2022] POST /identity/v3/groups => generated 280 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:11.645712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.659358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1bd63-2a34-443e-9be6-69069692c212 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.678647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.679664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.679808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.679979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.699747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:update_group(group_id=c4bf26b3a860489eabb1acaac9cf9b94)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.701619 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:11.701619 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:11.701619 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:11.703687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.742550 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1773/3512] 10.222.0.78 () {60 vars in 1247 bytes} [Tue Oct 18 16:17:11 2022] PATCH /identity/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94 => generated 292 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:11.746424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.761366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f991dc-0766-49dd-88df-0a9cc3ea43c3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.766804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.767653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.768099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.768535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.779239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:get_group(group_id=c4bf26b3a860489eabb1acaac9cf9b94)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.781642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.783854 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1740/3513] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:11 2022] GET /identity/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94 => generated 292 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:11.788192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.807928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b354de-c100-427f-b571-cddfc19e8092 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.813692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.814621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.815091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.816382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.818146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:update_group(group_id=c4bf26b3a860489eabb1acaac9cf9b94)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.821302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:11.859023 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1774/3514] 10.222.0.78 () {60 vars in 1246 bytes} [Tue Oct 18 16:17:11 2022] PATCH /identity/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94 => generated 307 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:11.862936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:11.876743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd2eb-a2c7-4e45-b700-daf594185c76 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:11.883687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:11.884493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:11.884844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:11.885234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:11.892230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c4bf26b3a860489eabb1acaac9cf9b94)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:11.894015 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:11.894015 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:11.894015 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:11.895441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:12.000664 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1741/3515] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:11 2022] DELETE /identity/v3/groups/c4bf26b3a860489eabb1acaac9cf9b94 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:12.005788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:12.029015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92789522-03f0-40f0-89fc-567af4f5db95 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:12.037295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:12.039948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:12.159193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:12.160318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:12.160831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:12.161365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:12.162373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:12.164770 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:12.164770 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:12.164770 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:12.166513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:12.233996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1775/3516] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:12 2022] POST /identity/v3/groups => generated 326 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:12.238328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:12.250866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97582-27aa-42ee-b395-60e8e165f0ff tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:12.274701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:12.276007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27089a6d-cdac-47b3-8c2c-4d5433cdcdf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:12.276843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:12.282982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:12.284459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:12.290967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:12.297682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:12.299618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:12.300035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:12.300311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:12.304070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:12.310300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:12.399917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1776/3517] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:12 2022] POST /identity/v3/users => generated 323 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:12.426482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:12.512910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0c3c-f3a4-4d8e-9884-914a2db21c3d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:12.526336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:12.527035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:12.527318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:12.527589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:12.626918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ac1f3c101ea2444497ed8d64bbe7e117)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:12.633679 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:12.633679 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:12.633679 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:12.635180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:12.692087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:12.694596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:12.716567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:12.727388 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1777/3518] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:17:12 2022] PUT /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:12.731402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:12.822516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1742/3519] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:17:12.972187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:13.017280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fefce-040c-40ce-9643-63d8031d8340 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:13.048772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:13.049849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:13.050325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:13.050803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:13.051937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:13.080798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:13.158885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1778/3520] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:12 2022] POST /identity/v3/users => generated 323 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:13.162894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:13.190487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed9b9-3455-4efc-b7d1-f5fb877213ec service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:13.199166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:13.199881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:13.200181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:13.200456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:13.242666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ff16f05de3374bf1bfc1f2968f6a6d0f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:13.246453 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:13.246453 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:13.246453 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:13.249365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:13.295367 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1743/3521] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:17:13 2022] PUT /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:13.301435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:13.319394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515337d-d414-417d-90f1-d66591c0a1c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:13.536754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:13.538521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:13.539177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:13.540460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:13.541967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:13.546827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:13.601988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1779/3522] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:13 2022] POST /identity/v3/users => generated 321 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:13.603854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:13.626078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dac1-27ad-4890-8c7d-fb5a8ca047be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:13.637746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:13.640875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:13.641319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:13.641698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:13.679148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=39f5e97535fe4618bf9e53d75674208b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:13.686314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:13.761175 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1744/3523] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:17:13 2022] PUT /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:13.762905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:13.784346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257417-b67a-466a-92a5-35ae8959f9c7 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.005613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.007340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.007617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.009159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.015428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dc4b6ce636054e179539de52fa85150d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.017496 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:14.017496 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:14.017496 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:14.022324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.128139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.128758 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1780/3524] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:17:13 2022] GET /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users => generated 1083 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:14.151620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dff0d2-1626-422d-a5c9-e8b27b435c50 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.168187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.172951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.173327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.173541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.186405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ac1f3c101ea2444497ed8d64bbe7e117)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.187475 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:14.187475 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:14.187475 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:14.188743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.243841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1745/3525] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 18 16:17:14 2022] HEAD /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:14.245699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.260419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fe79-1bde-406b-aedc-fcd74d456c67 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.267083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.268430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.269160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.269659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.275963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ac1f3c101ea2444497ed8d64bbe7e117)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.278880 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:14.278880 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:14.278880 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:14.280589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.296529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:14.337327 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1781/3526] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:17:14 2022] DELETE /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ac1f3c101ea2444497ed8d64bbe7e117 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:14.342958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.360313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c5a74-ca54-4ecd-91a7-895952697f3b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.520239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.520925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.521441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.522724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.527295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ff16f05de3374bf1bfc1f2968f6a6d0f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.533969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.572395 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1746/3527] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 18 16:17:14 2022] HEAD /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:14.574206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.596116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71266fbc-eb0b-4773-b1f0-075615316c7b tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.610782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.611880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.612401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.612910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.617965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=ff16f05de3374bf1bfc1f2968f6a6d0f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.625141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.644022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:14.681203 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1782/3528] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:17:14 2022] DELETE /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/ff16f05de3374bf1bfc1f2968f6a6d0f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:14.682238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.702572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dcac4-3d98-46b8-8815-176cd81f02b6 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:14.878797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:14.882300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:14.882515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:14.882668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:14.890841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=39f5e97535fe4618bf9e53d75674208b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:14.897940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:14.901062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:14.977250 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1747/3529] 10.222.0.78 () {58 vars in 1342 bytes} [Tue Oct 18 16:17:14 2022] HEAD /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:14.982281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:14.997622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4cce5-7245-46a7-a591-b696e33ed898 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:15.018063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:15.019139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:15.019731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:15.020254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:15.022740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dc4b6ce636054e179539de52fa85150d, user_id=39f5e97535fe4618bf9e53d75674208b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:15.026962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:15.059149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:15.068525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:INSERT=9,keystone:DELETE=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:15.115860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1783/3530] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:17:14 2022] DELETE /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users/39f5e97535fe4618bf9e53d75674208b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:15.125224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:15.160780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063c99f-bcf2-4a80-9423-46fdc047bec0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:15.453492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:15.454525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:15.454997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:15.465484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:15.471507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=dc4b6ce636054e179539de52fa85150d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:15.484396 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:15.484396 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:15.484396 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:15.486629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:15.538348 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1748/3531] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:17:15 2022] GET /identity/v3/groups/dc4b6ce636054e179539de52fa85150d/users => generated 145 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:15.544315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:15.586244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eaf0-103b-4da0-ac2f-c31cc7ade1c4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:15.604935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:15.606656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:15.607504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:15.608362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users/39f5e97535fe4618bf9e53d75674208b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:15.614921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_user(user_id=39f5e97535fe4618bf9e53d75674208b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:15.625972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:15.823677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:15.841680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:15.843930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:15.949380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:15.951329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f5e97535fe4618bf9e53d75674208b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.080605 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1784/3532] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:15 2022] DELETE /identity/v3/users/39f5e97535fe4618bf9e53d75674208b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:16.086217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:16.092754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:16.182736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014007c-222e-4a87-a90a-1e890e434cf4 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:16.416487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:16.417342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:16.420367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:16.420367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users/ff16f05de3374bf1bfc1f2968f6a6d0f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:16.421774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ff16f05de3374bf1bfc1f2968f6a6d0f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:16.423835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:16.620403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.621305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.657081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.659622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.682714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff16f05de3374bf1bfc1f2968f6a6d0f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:16.723939 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1749/3533] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:16 2022] DELETE /identity/v3/users/ff16f05de3374bf1bfc1f2968f6a6d0f => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:16.728577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:16.742546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ac558-789e-4d0f-b7d7-55bb13c70c3e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:16.843127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:16.844500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:16.864242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:17.010141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:17.011161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:17.011503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:17.011939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users/ac1f3c101ea2444497ed8d64bbe7e117` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:17.023290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ac1f3c101ea2444497ed8d64bbe7e117)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:17.032301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:17.056548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2df30-3092-42c0-be0e-45f7ed83672e tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:17.072231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:17.072958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:17.073230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:17.073498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] PATH_INFO: `/v3/users/cfc3e5f2e86f41a69e3179c1c246d3a7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:17.077512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc3e5f2e86f41a69e3179c1c246d3a7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:17.080704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:17.189123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc3e5f2e86f41a69e3179c1c246d3a7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.191057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc3e5f2e86f41a69e3179c1c246d3a7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.194451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.211870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc3e5f2e86f41a69e3179c1c246d3a7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.214496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc3e5f2e86f41a69e3179c1c246d3a7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.215057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.218501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.230017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc3e5f2e86f41a69e3179c1c246d3a7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.246808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.247432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1f3c101ea2444497ed8d64bbe7e117'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:17.273882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:17.317851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1785/3534] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:16 2022] DELETE /identity/v3/users/ac1f3c101ea2444497ed8d64bbe7e117 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:17.324823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:17.329087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:17.343038 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1750/3535] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:16 2022] DELETE /identity/v3/users/cfc3e5f2e86f41a69e3179c1c246d3a7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:17.543430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de8b0e-0dbc-476e-aee8-ae65d3cf87af tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:17.636832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:17.637806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:17.638352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:17.638752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dc4b6ce636054e179539de52fa85150d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:17.640467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dc4b6ce636054e179539de52fa85150d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:17.641786 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:17.641786 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:17.641786 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:17.643451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:17.733743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1786/3536] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:17 2022] DELETE /identity/v3/groups/dc4b6ce636054e179539de52fa85150d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:17.751318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:17.754406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:17.786771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c51d-e5de-4232-b52e-2999062748d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:17.976841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:17.978300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:17.979579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:17.980146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:17.982029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:17.987705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.049700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1751/3537] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:17 2022] POST /identity/v3/groups => generated 324 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:18.051175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.126924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600b28-ed9e-4582-a360-1b43ea0606fb tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.144646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.147562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.148971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.149516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.151228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.153471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.180728 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1787/3538] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:18 2022] POST /identity/v3/groups => generated 326 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:18.187556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.249124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999c1ba-f779-4755-af63-72920b1e2f53 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.261715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.263979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.264865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.265364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.266929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.276038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.324369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.325213 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1752/3539] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:18 2022] POST /identity/v3/groups => generated 326 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:18.346410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04909d-6229-4b6c-8ef2-864c2c6a86cc tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.373629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.375170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.375698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.376192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.377064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.378973 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:18.378973 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:18.378973 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:18.380566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.409379 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1788/3540] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Oct 18 16:17:18 2022] GET /identity/v3/groups => generated 1486 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:18.411944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.429597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a12bc3-c95e-48b4-a1c6-ceed7a2a5cd3 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.441426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.442765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.443119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.444478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/0c974da822fa41d495816de4042b988c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.449233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:18.457176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0c974da822fa41d495816de4042b988c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.459696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.466261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.469239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:18.535641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:18.567789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1753/3541] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:18 2022] DELETE /identity/v3/groups/0c974da822fa41d495816de4042b988c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:18.573541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.635759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb1149-5e8d-4d8b-95ac-76c1bb51d3b9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.798324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.801283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.802024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.802754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] PATH_INFO: `/v3/projects/676b034a9d2542e8899af31605f2b7fe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.804734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=676b034a9d2542e8899af31605f2b7fe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.811391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.826720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1533f1-99d5-4900-9f77-5c87ec35db83 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:18.848348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:18.848348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:18.848348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:18.848643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/0b586d628b9749a8990899b87c176b41` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:18.856499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0b586d628b9749a8990899b87c176b41)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:18.858453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:18.946804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676b034a9d2542e8899af31605f2b7fe', 'request_id': 'req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:18.961667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676b034a9d2542e8899af31605f2b7fe', 'request_id': 'req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:18.986506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1754/3542] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:18 2022] DELETE /identity/v3/groups/0b586d628b9749a8990899b87c176b41 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:18.991330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:18.992521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676b034a9d2542e8899af31605f2b7fe', 'request_id': 'req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:19.038610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] The token cache is being invalidate because project 676b034a9d2542e8899af31605f2b7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:19.039416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:19.040016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-00af731e-4ee4-4248-a91b-dcb0ef8d8d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:19.042778 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1789/3543] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:18 2022] DELETE /identity/v3/projects/676b034a9d2542e8899af31605f2b7fe => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:19.050644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5832-0253-48dc-aa4b-0dda81324b15 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.052230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5832-0253-48dc-aa4b-0dda81324b15 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.052760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5832-0253-48dc-aa4b-0dda81324b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.116032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3ef5832-0253-48dc-aa4b-0dda81324b15 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:19.118129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3ef5832-0253-48dc-aa4b-0dda81324b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:19.163609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203e1c-87b8-463a-9971-a3f7437f217d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.182344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.182344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.182344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.182911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/13f4a453bd3d4dafa166fd5da3fbc13f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.182911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=13f4a453bd3d4dafa166fd5da3fbc13f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.182911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.188639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:19.267162 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1755/3544] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:18 2022] DELETE /identity/v3/groups/13f4a453bd3d4dafa166fd5da3fbc13f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:19.272166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.277825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:19.283415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1790/3545] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:19.299425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.299716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.299994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.399722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:19.404175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:19.427047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:19.438222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff7655-35bc-4b80-bffd-0ac2a025cfd0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.454603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.455488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.456170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.456804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.457726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.463088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.533442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1756/3546] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/users => generated 321 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:19.541269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.560671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a400-533a-410d-8d94-3d42b3c4ce80 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.575507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.578487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.579010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.581370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.582302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.588159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.598764 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1791/3547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:19.601568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.626412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1757/3548] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/groups => generated 326 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:19.627299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b436276-ed9e-475d-876f-a069f2eaaecd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.631719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.642712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.643605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.643994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.644438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.645197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:19.645547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.647611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136bda-a2a4-45b4-9b9a-c0c45d4859d0 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.651597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.654407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.656592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.657177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.657826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dacc510cb7904ef4bb11b15c37a585fc/users/91d35defb2154332a634a4dbec643453` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.697781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dacc510cb7904ef4bb11b15c37a585fc, user_id=91d35defb2154332a634a4dbec643453)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.699837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.713071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1792/3549] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:19.713071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.738164 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1758/3550] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:17:19 2022] PUT /identity/v3/groups/dacc510cb7904ef4bb11b15c37a585fc/users/91d35defb2154332a634a4dbec643453 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:19.743775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.744945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682bdd-21b8-4c91-8704-67bd881f1439 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.861800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2da8-62e2-40ee-95bc-ffd4c5f058c1 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.879806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.881732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.882436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.883080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.886412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.891153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.902021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:19.947989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.949843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.952052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.952443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:19.952617 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1759/3551] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/groups => generated 326 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:19.953325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:19.956189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:19.956554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:19.979951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903457-5f3f-469a-9387-3e1f14d97ea8 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:19.987227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:19.988286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:19.988839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:19.989340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/54ff4bccc72547db9d625bc33d7e3f30/users/91d35defb2154332a634a4dbec643453` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.001037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=54ff4bccc72547db9d625bc33d7e3f30, user_id=91d35defb2154332a634a4dbec643453)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.004220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.051368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1793/3552] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:19 2022] POST /identity/v3/projects => generated 389 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:20.052528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.092306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1760/3553] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:17:19 2022] PUT /identity/v3/groups/54ff4bccc72547db9d625bc33d7e3f30/users/91d35defb2154332a634a4dbec643453 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:20.099574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.156237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4224-658a-459b-8a5c-07e4b22bc3c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.207845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:20.236774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f104-2e6e-4382-b487-154ac7459982 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.251885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.252780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.253271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.253681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users/91d35defb2154332a634a4dbec643453/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.254953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=91d35defb2154332a634a4dbec643453)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.257670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.278413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.279091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.279370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.279655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.280310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.283368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.290168 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1761/3554] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:17:20 2022] GET /identity/v3/users/91d35defb2154332a634a4dbec643453/groups => generated 838 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:20.291936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.308901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605fd0-e24f-45f7-8de9-6d99ae87a002 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.314642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.315341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.315635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.315956 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1794/3555] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:20 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:20.316148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/54ff4bccc72547db9d625bc33d7e3f30` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.317480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=54ff4bccc72547db9d625bc33d7e3f30)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.320511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.321698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.333713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7c55-59bd-4f93-8de3-e6da31ebb306 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.339955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.340558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.341082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.341385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.342218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.343837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.363098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1795/3556] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:20.363098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.378277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a98b7-f629-4a26-a534-ff6e4fbecdc6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.389399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.390246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.390529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.390861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.391961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.393359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.408715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1796/3557] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:20.414358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.437753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46504-65d0-48dc-9ac8-ee0c2ad84c70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.443818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.444585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.444864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.445173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] PATH_INFO: `/v3/projects/ebdd7d5c2a9f4c7f9505c5e983469e59/users/6eb8256cdb744f079cdfbcf7ef83e1d7/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.469131 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1762/3558] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:20 2022] DELETE /identity/v3/groups/54ff4bccc72547db9d625bc33d7e3f30 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:20.469684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdd7d5c2a9f4c7f9505c5e983469e59, user_id=6eb8256cdb744f079cdfbcf7ef83e1d7, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.472548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df216b52-fe4e-4f73-9078-d0de4cbab279 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.473670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.499587 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1797/3559] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:20 2022] PUT /identity/v3/projects/ebdd7d5c2a9f4c7f9505c5e983469e59/users/6eb8256cdb744f079cdfbcf7ef83e1d7/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:20.507038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.507456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.507762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.549279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:20.550639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:20.620842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79530aed-12ce-4e76-998f-8d3ed83bac2f tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.643927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:20.698349 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1798/3560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:20.711834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.715780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:20.720019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.720790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.721201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.721588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/groups/dacc510cb7904ef4bb11b15c37a585fc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.722889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dacc510cb7904ef4bb11b15c37a585fc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:20.725674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:20.822370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1763/3561] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:17:20 2022] DELETE /identity/v3/groups/dacc510cb7904ef4bb11b15c37a585fc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:20.826630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:20.873247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9608fd-c819-4267-bda6-816c22a3283f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.952671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:20.987400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3305943-8d4d-4702-a0c9-839fba852065 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:20.995858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:20.996807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:20.997225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:20.997594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/users/91d35defb2154332a634a4dbec643453` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:20.999207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91d35defb2154332a634a4dbec643453)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:21.001431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:21.036811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:21.037579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:21.038063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:21.038401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:21.108141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d35defb2154332a634a4dbec643453'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.109575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d35defb2154332a634a4dbec643453'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.121678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d35defb2154332a634a4dbec643453'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.123480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d35defb2154332a634a4dbec643453'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.138407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d35defb2154332a634a4dbec643453'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.156706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:21.178917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:21.182007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:21.190897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1764/3562] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:20 2022] DELETE /identity/v3/users/91d35defb2154332a634a4dbec643453 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:21.192209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:21.195975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:21.212253 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1799/3563] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:17:21.321674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4705-6982-4a46-a826-25255477d7a9 tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:21.332030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:21.333536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:21.335375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:21.337185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/domains/f6b987c0b3c44afca009731871369527` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:21.340058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f6b987c0b3c44afca009731871369527)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:21.341848 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:21.341848 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:21.341848 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:21.342849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:21.380202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.382032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.422047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.425352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.431033 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1765/3564] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:17:21 2022] PATCH /identity/v3/domains/f6b987c0b3c44afca009731871369527 => generated 277 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:21.439037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:21.460630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ac0f-7a24-4f83-b4c1-531042957e02 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:21.620906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6992b06eafe34ede9565e0dd0e931468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93e7182dbc75414b826a556ea1dc95fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:21.621783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:21.622283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:21.622595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] PATH_INFO: `/v3/domains/f6b987c0b3c44afca009731871369527` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:21.654341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f6b987c0b3c44afca009731871369527)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:21.656350 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:21.656350 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:21.656350 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:21.669993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:21.722696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.731526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f6b987c0b3c44afca009731871369527'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.836755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:21.849071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.864454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.878836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.922419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] The token cache is being invalidate because project f6b987c0b3c44afca009731871369527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:21.923085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.928733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.969384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.971507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.972626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26650526-7f3c-4950-b2ff-0549149d978d tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f6b987c0b3c44afca009731871369527', 'request_id': 'req-26650526-7f3c-4950-b2ff-0549149d978d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:21.994074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1800/3565] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:17:21 2022] DELETE /identity/v3/domains/f6b987c0b3c44afca009731871369527 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:21.999796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:22.003842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:22.156232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d1595-beb0-4c6e-ac53-31934a9825be tempest-GroupsV3TestJSON-15197879 tempest-GroupsV3TestJSON-15197879-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:22.247529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:22.248252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:22.248517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:22.248780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] PATH_INFO: `/v3/users/0c4e71e6394447cea77f5a5eeac28f3d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:22.250027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4e71e6394447cea77f5a5eeac28f3d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:22.252251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:22.260372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:22.332018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4e71e6394447cea77f5a5eeac28f3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:22.332961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4e71e6394447cea77f5a5eeac28f3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:22.342113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4e71e6394447cea77f5a5eeac28f3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:22.343153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4e71e6394447cea77f5a5eeac28f3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:22.352842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4e71e6394447cea77f5a5eeac28f3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:22.381695 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1766/3566] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:21 2022] DELETE /identity/v3/users/0c4e71e6394447cea77f5a5eeac28f3d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:22.386933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:22.389009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:22.389622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:22.446446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:22.448555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:22.673450 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1801/3567] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:22.694079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:22.695862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:22.874680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910319ce-047e-453b-a2ce-bb1598b75903 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:22.888835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:22.889714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:22.890109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:22.890381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:22.917811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:22.924802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:22.967974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1767/3568] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:25.275593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:25.280312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:25.336353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51fe57-1387-4d32-b66a-0ecbc16d1577 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:25.360731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:25.361386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:25.361805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:25.361964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] PATH_INFO: `/v3/projects/1a6e0d32b1ae432dbd39afab2b173efd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:25.368427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6e0d32b1ae432dbd39afab2b173efd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:25.371634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:25.542034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6e0d32b1ae432dbd39afab2b173efd', 'request_id': 'req-2c3136b7-4dfa-477d-ba14-a87dff518669'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:25.558002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6e0d32b1ae432dbd39afab2b173efd', 'request_id': 'req-2c3136b7-4dfa-477d-ba14-a87dff518669'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:25.569819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6e0d32b1ae432dbd39afab2b173efd', 'request_id': 'req-2c3136b7-4dfa-477d-ba14-a87dff518669'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:25.607481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] The token cache is being invalidate because project 1a6e0d32b1ae432dbd39afab2b173efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:25.607830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:25.617554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:25.619621 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1802/3569] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:25 2022] DELETE /identity/v3/projects/1a6e0d32b1ae432dbd39afab2b173efd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:25.624215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:25.662968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247f30-e416-4069-862c-6d7b3f0e4e15 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:25.935135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:25.935135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:25.935135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:25.935135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] PATH_INFO: `/v3/users/6992b06eafe34ede9565e0dd0e931468` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:25.935718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6992b06eafe34ede9565e0dd0e931468)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:25.940154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:26.036648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:26.085458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6992b06eafe34ede9565e0dd0e931468'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:26.086570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6992b06eafe34ede9565e0dd0e931468'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:26.104587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6992b06eafe34ede9565e0dd0e931468'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:26.110585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6992b06eafe34ede9565e0dd0e931468'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:26.123256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bd946ec-e24c-4b5b-9d81-c4542ae92386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6992b06eafe34ede9565e0dd0e931468'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:26.171781 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1768/3570] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:25 2022] DELETE /identity/v3/users/6992b06eafe34ede9565e0dd0e931468 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:27.773094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:27.774987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:27.796715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3136b7-4dfa-477d-ba14-a87dff518669 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:27.884232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:27.926671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:27.927337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:27.927648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:27.928136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] PATH_INFO: `/v3/projects/93e7182dbc75414b826a556ea1dc95fd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:27.929525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e7182dbc75414b826a556ea1dc95fd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:27.931470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:28.057025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e7182dbc75414b826a556ea1dc95fd', 'request_id': 'req-1a8ed77b-d3e1-487c-b313-dc6a45586c91'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:28.079567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e7182dbc75414b826a556ea1dc95fd', 'request_id': 'req-1a8ed77b-d3e1-487c-b313-dc6a45586c91'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:28.129612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e7182dbc75414b826a556ea1dc95fd', 'request_id': 'req-1a8ed77b-d3e1-487c-b313-dc6a45586c91'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:28.168438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] The token cache is being invalidate because project 93e7182dbc75414b826a556ea1dc95fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:28.169144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:28.182249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8ed77b-d3e1-487c-b313-dc6a45586c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:28.189347 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1803/3571] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:27 2022] DELETE /identity/v3/projects/93e7182dbc75414b826a556ea1dc95fd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:28.194985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.195922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.196389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.246191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:28.249561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:28.435853 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1769/3572] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:28.436600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.437143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.437608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.472583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:28.474171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:28.485055 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1804/3573] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:28.488850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:28.503286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df20d70-e69a-48c8-b286-0ef65e0c4fdc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:28.513055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:28.513903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.514371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.514795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.515751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:28.516178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:28.519182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:28.581635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1770/3574] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:17:28.583240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:28.602832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d9c14-10fc-4cfc-9399-f8118b3f31ec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:28.636986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:28.637714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.638049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.638326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.638985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:28.640955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:28.707880 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1805/3575] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:28 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:28.713268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:28.735054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69fdd5-463c-4a28-ac60-a7370a3770bf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:28.872529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:28.873330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.874107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.874107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.874783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:28.880199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:28.918837 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1771/3576] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:28 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:28.922465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:28.945332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9b9f-0b89-41b2-9ec3-ac1305f39bd2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:28.954795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:28.955851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:28.956395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:28.957870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:28.959771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:28.962358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:28.976695 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1806/3577] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:28.980387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:29.000046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b73c3-1019-4ef8-ad48-f42f57be0c64 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:29.025514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:29.028162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:29.028523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:29.029348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:29.030828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:29.037585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6b174-ad10-4188-80de-5702ff300e79 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:29.065563 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1772/3578] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:29.069754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:29.096421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172cd28-df2f-41a7-8a13-7bf37209f8e7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:29.103555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:29.104921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:29.105457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:29.105953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] PATH_INFO: `/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d/users/84e6df13f0a74cd39c480b5b11e5abe4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:29.128963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42232160e4f4b89a1d07dae08cd5f6d, user_id=84e6df13f0a74cd39c480b5b11e5abe4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:29.135993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:29.175505 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1807/3579] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:29 2022] PUT /identity/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d/users/84e6df13f0a74cd39c480b5b11e5abe4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:29.189080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:29.189915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:29.190442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:29.236701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:29.247646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] MFA Rules not processed for user `84e6df13f0a74cd39c480b5b11e5abe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:29.250478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:29.527141 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1773/3580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:29.528372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:29.734391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a25936-e493-4e4f-b1ec-a13063078e1f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:29.754593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:29.755606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:29.756606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:29.756892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:29.761721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:29.766939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:29.793885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:29.841227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1808/3581] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:29 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:29.842647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:29.858283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8942a-7f18-4924-adc9-bf4bf7961890 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:29.987350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:29.988556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:29.989086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:29.989669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:29.991722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:29.999013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:30.049376 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1774/3582] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:29 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:30.059773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:30.109552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1103b-205d-4102-9272-7651170f8d2d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:30.119709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:30.121070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.121606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.122154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.123150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:30.129171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:30.152962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1809/3583] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:30.154610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:30.180290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914925d-6978-48d0-a566-a9aeff0e225e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:30.204651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:30.205927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.206209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.207641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] PATH_INFO: `/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5/users/b32c054eb20443889fbc54ea45cddc24/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.294821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6e7ae44adf4be885f6642fa898b8f5, user_id=b32c054eb20443889fbc54ea45cddc24, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:30.300856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:30.340474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1775/3584] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:30 2022] PUT /identity/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5/users/b32c054eb20443889fbc54ea45cddc24/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:30.344903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:30.364124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077d94d-4134-4ff6-894f-51e7c07bb8b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:30.524531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:30.525349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.525729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.526254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.527211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:30.530827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c1888-4caf-4e53-97b8-56123a9d66fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:30.558022 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1810/3585] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:30.563599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:30.587171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6abb5-0623-4ba3-addc-f985e14c9b0d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:30.594170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:30.595415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.595614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.595914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] PATH_INFO: `/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5/users/b32c054eb20443889fbc54ea45cddc24/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.600873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6e7ae44adf4be885f6642fa898b8f5, user_id=b32c054eb20443889fbc54ea45cddc24, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:30.603667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:30.639640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1776/3586] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:30 2022] PUT /identity/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5/users/b32c054eb20443889fbc54ea45cddc24/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:30.654607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.654923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.655176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.726160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] MFA Rules not processed for user `b32c054eb20443889fbc54ea45cddc24`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:30.727731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:30.948227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1811/3587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:30.952572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:30.969777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea93d-d836-42a6-a90f-399bc34344da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:30.981585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:30.982235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:30.982507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:30.982776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:30.998230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:get_project(project_id=f42232160e4f4b89a1d07dae08cd5f6d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.000324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.002723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1777/3588] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:17:30 2022] GET /identity/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d => generated 389 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:17:31.007412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.024608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2359566-1f81-4a8a-9c6d-dafb8876abe4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.065480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.070978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.071874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.072042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.072910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.075295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.171104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1812/3589] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:17:31 2022] POST /identity/v3/projects => generated 338 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:31.175745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.225481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a85ec-b6fa-41a4-b43a-b1710f958f03 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.375793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:31.401514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.402385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.402702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.403104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.404119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.405415 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:31.405415 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:31.405415 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:31.406810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.438989 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1778/3590] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects => generated 6954 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:31.445252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.477160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dec8c-4a6c-485d-b8fd-761212267d46 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.487040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.490160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.490495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.490792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.494000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:get_project(project_id=f42232160e4f4b89a1d07dae08cd5f6d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.496093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.503432 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1813/3591] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d => generated 389 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:31.506789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.524026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7958e9-3bef-482a-9bd9-66764cf8d3c1 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.539038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.540942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.541362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.541727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects/d738d879b51a4ccf876c458d279f8181` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.549028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:get_project(project_id=d738d879b51a4ccf876c458d279f8181)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.549028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.550454 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1779/3592] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects/d738d879b51a4ccf876c458d279f8181 => generated 338 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:31.556659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.569197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db02d-fa1a-4b07-953f-d9ade2ab5170 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.576431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.578115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.578820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.579335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.580201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.582643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.612691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1814/3593] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects => generated 6954 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:31.617928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.644791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351b4d-8d88-468d-a559-48a31068b575 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.665862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.666769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.667421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.668816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.670203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:31.673684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.693694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.733059 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1780/3594] 10.222.0.78 () {58 vars in 1166 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects?domain_id=default => generated 6623 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:31.739275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.769848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb9497-93dd-4af1-8981-ffd33d66a7f7 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.793306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.795012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.795174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.796312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.799130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.810697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:31.868232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1815/3595] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects => generated 6954 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:31.873562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:31.890798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fadd11-5867-4c49-844a-e637042a3d5d tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:31.904862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:31.905911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:31.906583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:31.907114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:31.908107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:31.908498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:31.912352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:32.015963 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1781/3596] 10.222.0.78 () {58 vars in 1166 bytes} [Tue Oct 18 16:17:31 2022] GET /identity/v3/projects?domain_id=default => generated 6623 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:32.025188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:32.049970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecc178-86a2-47b2-9021-3733c4b89880 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:32.077585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:32.079596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:32.084955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:32.086008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:32.090993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:32.096904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:32.113808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:32.182538 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1816/3597] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:17:32 2022] GET /identity/v3/projects => generated 6954 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:32.185757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:32.207108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cad19-fb0c-430e-bfa2-923c1f0a6d90 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:32.227662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:32.229050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:32.229472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:32.229831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:32.235020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1963562035) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:32.237591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:32.242451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:32.277557 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1782/3598] 10.222.0.78 () {58 vars in 1232 bytes} [Tue Oct 18 16:17:32 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1963562035 => generated 537 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:32.281938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:32.297005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d712-b178-413a-8689-be7d1e23ee27 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:32.312038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b32c054eb20443889fbc54ea45cddc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f6e7ae44adf4be885f6642fa898b8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:32.312706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:32.312984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:32.313274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] PATH_INFO: `/v3/projects/d738d879b51a4ccf876c458d279f8181` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:32.315292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d738d879b51a4ccf876c458d279f8181)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:32.319572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:32.495069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd738d879b51a4ccf876c458d279f8181', 'request_id': 'req-990d36b8-1933-4ac7-8f28-1fd0a8638756'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:32.520216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd738d879b51a4ccf876c458d279f8181', 'request_id': 'req-990d36b8-1933-4ac7-8f28-1fd0a8638756'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:32.539426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd738d879b51a4ccf876c458d279f8181', 'request_id': 'req-990d36b8-1933-4ac7-8f28-1fd0a8638756'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:32.566216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] The token cache is being invalidate because project d738d879b51a4ccf876c458d279f8181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:32.566508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:32.570858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-990d36b8-1933-4ac7-8f28-1fd0a8638756 tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:32.576756 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1817/3599] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:32 2022] DELETE /identity/v3/projects/d738d879b51a4ccf876c458d279f8181 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:32.579111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:32.580970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:32.725997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d45433-8d23-4dff-8bb3-b9771d3d26ee tempest-ListProjectsStaticTestJSON-540415413 tempest-ListProjectsStaticTestJSON-540415413-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:32.921838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:32.924466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:32.924868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:32.925269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] PATH_INFO: `/v3/users/84e6df13f0a74cd39c480b5b11e5abe4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:32.946756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e6df13f0a74cd39c480b5b11e5abe4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:32.955111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:33.066946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e6df13f0a74cd39c480b5b11e5abe4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:33.069201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e6df13f0a74cd39c480b5b11e5abe4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:33.075302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:33.109176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e6df13f0a74cd39c480b5b11e5abe4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:33.111062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e6df13f0a74cd39c480b5b11e5abe4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:33.127144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e6df13f0a74cd39c480b5b11e5abe4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:33.186826 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1783/3600] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:32 2022] DELETE /identity/v3/users/84e6df13f0a74cd39c480b5b11e5abe4 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:33.192557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:33.193887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:33.193887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:33.238668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:33.239994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:33.494878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1818/3601] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:33.519185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:33.523434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:33.744038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f849-9dcd-4781-bef2-cfdde30a9673 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:33.759096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:33.760490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:33.761241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:33.761965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:33.794865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:33.796930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:33.827829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1784/3602] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:34.656380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:34.659246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:34.684477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc228-ce2d-4b88-9725-5ab4176dc0d5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:34.701125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:34.701929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:34.702336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:34.702704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] PATH_INFO: `/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:34.704113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42232160e4f4b89a1d07dae08cd5f6d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:34.706313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:34.856795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42232160e4f4b89a1d07dae08cd5f6d', 'request_id': 'req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:34.875298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42232160e4f4b89a1d07dae08cd5f6d', 'request_id': 'req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:34.895098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42232160e4f4b89a1d07dae08cd5f6d', 'request_id': 'req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:34.925227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] The token cache is being invalidate because project f42232160e4f4b89a1d07dae08cd5f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:34.925631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:34.928017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:34.933615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1819/3603] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:34 2022] DELETE /identity/v3/projects/f42232160e4f4b89a1d07dae08cd5f6d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:34.937522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:34.953904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4081747-e084-42a5-bcb7-31d8c413b792 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:35.214248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:35.215076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:35.216207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:35.216616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] PATH_INFO: `/v3/users/b32c054eb20443889fbc54ea45cddc24` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:35.220242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32c054eb20443889fbc54ea45cddc24)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:35.228743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:35.382566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32c054eb20443889fbc54ea45cddc24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:35.383847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32c054eb20443889fbc54ea45cddc24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:35.421460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32c054eb20443889fbc54ea45cddc24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:35.422719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32c054eb20443889fbc54ea45cddc24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:35.440963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be6e7b79-34d6-444b-b8ac-c3f13ea40ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32c054eb20443889fbc54ea45cddc24'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:35.460851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:35.488657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1785/3604] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:34 2022] DELETE /identity/v3/users/b32c054eb20443889fbc54ea45cddc24 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:37.200880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:37.202496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:37.221260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:37.247873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcf4ec-7b09-45f5-bbf0-142942a4fba5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:37.364545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:37.366107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:37.366523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:37.366892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] PATH_INFO: `/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:37.368706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6e7ae44adf4be885f6642fa898b8f5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:37.372834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:37.513440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6e7ae44adf4be885f6642fa898b8f5', 'request_id': 'req-d25e231d-551b-42ee-afe6-635d48b9e3fb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:37.550444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6e7ae44adf4be885f6642fa898b8f5', 'request_id': 'req-d25e231d-551b-42ee-afe6-635d48b9e3fb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:37.571278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6e7ae44adf4be885f6642fa898b8f5', 'request_id': 'req-d25e231d-551b-42ee-afe6-635d48b9e3fb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:37.590861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] The token cache is being invalidate because project 8f6e7ae44adf4be885f6642fa898b8f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:37.591489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:37.592603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d25e231d-551b-42ee-afe6-635d48b9e3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:37.595633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1820/3605] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:37 2022] DELETE /identity/v3/projects/8f6e7ae44adf4be885f6642fa898b8f5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:37.602459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:37.603339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:37.603794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:37.673413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:37.674669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:37.806695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:37.807049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:37.808276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1786/3606] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:37.810838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:37.870072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:37.876155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:37.903562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1821/3607] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:37.905232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:37.924093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0167f-d3e5-4bcf-96bc-b77608189959 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:37.933532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:37.934176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:37.934456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:37.934733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:37.935400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:37.935703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:37.937376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:37.965386 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1787/3608] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:37.970143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:37.986284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11f306-46c5-4cd1-9e19-c6841821fa9e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:37.994372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:37.995938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:37.996471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:37.996965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:37.997941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:38.000526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:38.047057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1822/3609] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:37 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:38.050719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:38.072104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd593d1-1529-46cb-ad2f-0dbb317205d0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:38.192405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:38.194959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.195247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.195521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.196197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:38.198238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:38.249287 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1788/3610] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:38 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:38.251965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:38.280368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d804a3-3318-4dbb-8755-e3b1c273ea14 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:38.301808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:38.302995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.303266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.307398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.309454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:38.312964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c232-55d2-4d27-8ba7-9f7290bc2202 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:38.339418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1823/3611] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:38.340868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:38.357618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d5eb-99a4-4be4-b555-24262125d0b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:38.370673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:38.371672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.372150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.372588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.373462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:38.376635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:38.412396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.412762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.413105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.429124 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1789/3612] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:38.430151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:38.483045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60970865-2e1f-4317-bf81-885fdb637b44 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:38.483045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:38.483045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.483045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.485539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] PATH_INFO: `/v3/projects/626a0a2d348c410ab23058f837f4b7b4/users/0e4d1168ed0544c896796e481be8972a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.486104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] MFA Rules not processed for user `6eb8256cdb744f079cdfbcf7ef83e1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:38.486104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:38.516478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626a0a2d348c410ab23058f837f4b7b4, user_id=0e4d1168ed0544c896796e481be8972a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:38.519181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2e55-1b63-454a-ab81-ef14979ed8f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:38.550818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1790/3613] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:38 2022] PUT /identity/v3/projects/626a0a2d348c410ab23058f837f4b7b4/users/0e4d1168ed0544c896796e481be8972a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:38.562281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:38.563283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:38.563883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:38.599730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:38.650786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] MFA Rules not processed for user `0e4d1168ed0544c896796e481be8972a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:38.652055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:38.682792 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1824/3614] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:38.745093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:38.899756 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1791/3615] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:38.904261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:38.924814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930d9b8-24bb-4aa0-ae47-76f3427e2e26 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.047755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.048816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.049187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.049521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.050627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.054512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.118301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1825/3616] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:38 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:39.119428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.136336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91b4a4-6eaf-4d66-b581-b29444ebfa81 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.228593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.229349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.229853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.230285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.231022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.233311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.265795 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1792/3617] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:39 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:17:39.267492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.284769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.288912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:39.295781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50c55-0ea6-4efe-b8db-ec56bc727de2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.311817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.314381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.316981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.317355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.318596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.321427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.362790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1826/3618] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:39.364829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.403636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e4a74-d035-4fc3-81f8-a342c45006ed admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.414146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.417074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.417732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.418272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] PATH_INFO: `/v3/projects/b6460e8ab981419ca15be5756a256a88/users/f5283c6f2b804101809d881971aff8dd/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.447836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6460e8ab981419ca15be5756a256a88, user_id=f5283c6f2b804101809d881971aff8dd, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.451180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.478059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53166-e39b-414b-bfbc-b6178c0b828e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.479003 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1827/3619] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:39 2022] PUT /identity/v3/projects/b6460e8ab981419ca15be5756a256a88/users/f5283c6f2b804101809d881971aff8dd/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:39.480737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.483734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:39.584697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:39.622777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7eb99-87d5-4407-b408-b15ea025b3e7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.631122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.631781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.632950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.632950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.634434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:39.651324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.652751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.654368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.655161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.717313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:39.754036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.756477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.769749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.775298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.797575 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1793/3620] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:39.798396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:39.815128 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1828/3621] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:39.959776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7505b3-a4a6-42e3-9299-5407aa5a1e2e service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:39.968318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:39.969537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:39.969909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:39.970361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:39.971181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:39.974473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86024ac5-a2ab-473d-898f-310b59ec1bdc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:39.990329 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1794/3622] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:39.995421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.017269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de727c-505b-42ff-a92d-9b2025911dc8 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.036287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.037511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.037821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.038155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] PATH_INFO: `/v3/projects/b6460e8ab981419ca15be5756a256a88/users/f5283c6f2b804101809d881971aff8dd/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.043789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6460e8ab981419ca15be5756a256a88, user_id=f5283c6f2b804101809d881971aff8dd, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.047737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:40.074685 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1829/3623] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:39 2022] PUT /identity/v3/projects/b6460e8ab981419ca15be5756a256a88/users/f5283c6f2b804101809d881971aff8dd/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:40.079218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.079852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.081300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.133642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] MFA Rules not processed for user `f5283c6f2b804101809d881971aff8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:40.136224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:40.264749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:40.298663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1795/3624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:40.301620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.332170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0659-b4b6-4573-8ead-af9ed16180b8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.346106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.347250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.347714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.348185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.349183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.351005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:40.396812 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1830/3625] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:17:40 2022] POST /identity/v3/domains => generated 276 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:40.403280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.424579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd10016-1878-41d7-b0f5-074e8adc856f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.549033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.550333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.551290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.551290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.551879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.554731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:40.633122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1796/3626] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:40 2022] POST /identity/v3/users => generated 348 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:40.636087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.651667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8efd-488b-4423-877a-f05a811f15ac tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.666451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.667318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.667780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.668132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.668862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.670788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:40.715009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1831/3627] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:40 2022] POST /identity/v3/users => generated 324 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:40.722241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.739229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc435-e734-4a28-ae83-210bc60eee3c tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.747063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.747784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.748002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.748314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users/6feab2707a4d48cfa1193e99735a59f7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.797544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:get_user(user_id=6feab2707a4d48cfa1193e99735a59f7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.803357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:40.826031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.828015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:40.829731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1797/3628] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:17:40 2022] GET /identity/v3/users/6feab2707a4d48cfa1193e99735a59f7 => generated 348 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:40.837056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:40.857936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860566-cabe-478e-a306-09c3abbe2af0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:40.880434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:40.883948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:40.884666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:40.886217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:40.887397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Adding query filter params (domain_id=57c7ad3b8ae6483aa1e1c13b1b20beeb) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:40.887718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:40.890963 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:40.890963 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:40.890963 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:40.893720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.001534 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1798/3629] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 18 16:17:40 2022] GET /identity/v3/users?domain_id=57c7ad3b8ae6483aa1e1c13b1b20beeb => generated 485 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:41.002637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.027648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11eea3-8c51-4b17-b598-96c37b9c3d45 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.043051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.045352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.046423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.046749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.048374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.051032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.056711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe176c-8303-4952-92b7-14fa38c8ce30 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.062353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.063012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.063500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.063949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.067377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:41.131071 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1799/3630] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:41 2022] GET /identity/v3/users => generated 8878 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:41.136720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.152708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb98c9-fc75-4f29-a341-cbb506455939 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.169589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.170215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.170486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.170750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.176284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1717362243) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:41.176594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.183718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.266779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.268358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.298630 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1832/3631] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:41.313326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.315211 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1800/3632] 10.222.0.78 () {58 vars in 1189 bytes} [Tue Oct 18 16:17:41 2022] GET /identity/v3/users?name=tempest-test_user-1717362243 => generated 476 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:41.335957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04d3d-344b-46e2-b103-13c19db70ac1 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.348413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.360404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.363069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.363587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.364540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:41.365178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.366537 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:41.366537 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:41.366537 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:41.368613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.370808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:41.424828 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1833/3633] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Oct 18 16:17:41 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:17:41.430672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.443810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b59d5-b191-4909-a767-c28c1221acff tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.465924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.466580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.468495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.468774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users/9f84cc323e474a90aa97f7347d52672d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.522456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9f84cc323e474a90aa97f7347d52672d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.527950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.695651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f84cc323e474a90aa97f7347d52672d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:41.697754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f84cc323e474a90aa97f7347d52672d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:41.699960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.705684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:41.746360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f84cc323e474a90aa97f7347d52672d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:41.747449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f84cc323e474a90aa97f7347d52672d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:41.767823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f84cc323e474a90aa97f7347d52672d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:41.778429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:41.813299 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1801/3634] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:41 2022] DELETE /identity/v3/users/9f84cc323e474a90aa97f7347d52672d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:41.815395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:41.821971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:41.851990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586e73-8827-4a80-b790-50228cd6667a tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.918538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-340d-47b1-81fc-d3547b684cc1 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:41.924443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.925414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.925760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.926140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/users/6feab2707a4d48cfa1193e99735a59f7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.926857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:41.928250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:41.928610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:41.934604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6feab2707a4d48cfa1193e99735a59f7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:41.934835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:41.934949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:41.935057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:41.994218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6feab2707a4d48cfa1193e99735a59f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.011407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6feab2707a4d48cfa1193e99735a59f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.095760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6feab2707a4d48cfa1193e99735a59f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.106041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6feab2707a4d48cfa1193e99735a59f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.121162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:42.123587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:42.137915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6feab2707a4d48cfa1193e99735a59f7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.178364 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1834/3635] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:42.192473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1802/3636] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:41 2022] DELETE /identity/v3/users/6feab2707a4d48cfa1193e99735a59f7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:42.196587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:42.212900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6ece5-6848-4a89-b6f4-02e9c33e58aa service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:42.366530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:42.406954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:42.410208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:42.411403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:42.411403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/domains/57c7ad3b8ae6483aa1e1c13b1b20beeb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:42.416382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=57c7ad3b8ae6483aa1e1c13b1b20beeb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:42.417596 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:42.417596 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:42.417596 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:42.419583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:42.477551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.481447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.550802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.551777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77223875-ffd5-4855-81a5-a5617e988ef8 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.557873 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1835/3637] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:17:42 2022] PATCH /identity/v3/domains/57c7ad3b8ae6483aa1e1c13b1b20beeb => generated 277 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:17:42.560157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:42.562739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:42.600666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d5d64-996e-4d97-a641-7379f944aac4 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:42.819511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5283c6f2b804101809d881971aff8dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6460e8ab981419ca15be5756a256a88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:42.820502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:42.820967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:42.821496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] PATH_INFO: `/v3/domains/57c7ad3b8ae6483aa1e1c13b1b20beeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:42.838649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:42.839014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:42.839525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:42.854345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:42.861056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=57c7ad3b8ae6483aa1e1c13b1b20beeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:42.862859 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:42.862859 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:17:42.862859 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:17:42.864642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:42.915617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.924716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:42.931048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:42.932454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:43.165695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.198340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.275838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.363635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] The token cache is being invalidate because project 57c7ad3b8ae6483aa1e1c13b1b20beeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:43.366942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.369831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.377491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1836/3638] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 541 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:43.405461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:43.406969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:43.461695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.462658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.495052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '57c7ad3b8ae6483aa1e1c13b1b20beeb', 'request_id': 'req-13d1eda2-4aa8-447d-805d-9ddec8974bd0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:43.534282 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1803/3639] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:17:42 2022] DELETE /identity/v3/domains/57c7ad3b8ae6483aa1e1c13b1b20beeb => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:43.541708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:43.548016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:43.705488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2172a85-6c86-4857-9c67-3447b0a4de89 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:43.792226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:43.847124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:43.850629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:43.850929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:43.852318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:43.858453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:43.916443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1eda2-4aa8-447d-805d-9ddec8974bd0 tempest-UsersV3TestJSON-1618552429 tempest-UsersV3TestJSON-1618552429-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:43.946628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:43.947606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:43.947889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:43.951312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] PATH_INFO: `/v3/users/0e4d1168ed0544c896796e481be8972a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:43.970422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4d1168ed0544c896796e481be8972a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:43.976628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:44.060865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:44.084014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3013763-f2ea-4fc9-b71f-cf3f2202215c service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:44.114285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1837/3640] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:17:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:44.155434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:44.164014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4d1168ed0544c896796e481be8972a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:44.169801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4d1168ed0544c896796e481be8972a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:44.206429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4d1168ed0544c896796e481be8972a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:44.208073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4d1168ed0544c896796e481be8972a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:44.251208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4d1168ed0544c896796e481be8972a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:44.304123 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1804/3641] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:43 2022] DELETE /identity/v3/users/0e4d1168ed0544c896796e481be8972a => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:44.309824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:44.310563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:44.310563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:44.336773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:44.338934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:44.565996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1838/3642] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:44.632649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:44.634921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:44.891740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab7fda-6c2d-42d3-bdb5-8458a0ba036e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:44.916603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:44.918385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:44.918885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:44.919381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:44.972962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:44.975936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:45.044245 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1805/3643] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:47.242197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:47.244899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:47.282427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ada1da-03d2-41a2-b2f0-5595a5b5ebb6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:47.312725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:47.313850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:47.314326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:47.314797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] PATH_INFO: `/v3/projects/626a0a2d348c410ab23058f837f4b7b4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:47.326627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626a0a2d348c410ab23058f837f4b7b4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:47.330249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:47.524428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626a0a2d348c410ab23058f837f4b7b4', 'request_id': 'req-df9d6e82-b1ae-479c-9175-300637a20062'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:47.559294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626a0a2d348c410ab23058f837f4b7b4', 'request_id': 'req-df9d6e82-b1ae-479c-9175-300637a20062'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:47.597901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626a0a2d348c410ab23058f837f4b7b4', 'request_id': 'req-df9d6e82-b1ae-479c-9175-300637a20062'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:47.674762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] The token cache is being invalidate because project 626a0a2d348c410ab23058f837f4b7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:47.675256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:47.683201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df9d6e82-b1ae-479c-9175-300637a20062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:47.694596 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1839/3644] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:47 2022] DELETE /identity/v3/projects/626a0a2d348c410ab23058f837f4b7b4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:47.700406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:47.717861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88def023-7954-4af9-b0b7-ef285250e786 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:48.012113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:48.016612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:48.016889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:48.020855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] PATH_INFO: `/v3/users/f5283c6f2b804101809d881971aff8dd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:48.032716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5283c6f2b804101809d881971aff8dd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:48.047558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:48.224246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5283c6f2b804101809d881971aff8dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:48.227159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5283c6f2b804101809d881971aff8dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:48.261320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5283c6f2b804101809d881971aff8dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:48.261969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5283c6f2b804101809d881971aff8dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:48.283627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5283c6f2b804101809d881971aff8dd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:48.299550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:48.332354 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1806/3645] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:47 2022] DELETE /identity/v3/users/f5283c6f2b804101809d881971aff8dd => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:49.250444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78263-b636-4e52-859a-8ec4859c8ab7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:49.251409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78263-b636-4e52-859a-8ec4859c8ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:49.251917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a78263-b636-4e52-859a-8ec4859c8ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:49.310760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-78a78263-b636-4e52-859a-8ec4859c8ab7 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:49.314506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-78a78263-b636-4e52-859a-8ec4859c8ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:49.331891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:49.355352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:49.357705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:49.475019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db399b-9e77-4052-9caa-d9a551135e78 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:49.498284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:49.498964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:49.499250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:49.499522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] PATH_INFO: `/v3/projects/b6460e8ab981419ca15be5756a256a88` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:49.510743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6460e8ab981419ca15be5756a256a88)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:49.514473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:49.542777 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1840/3646] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:49.637673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6460e8ab981419ca15be5756a256a88', 'request_id': 'req-acc453f0-7587-4064-ab55-289ad70ee3e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:49.653098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6460e8ab981419ca15be5756a256a88', 'request_id': 'req-acc453f0-7587-4064-ab55-289ad70ee3e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:49.670824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6460e8ab981419ca15be5756a256a88', 'request_id': 'req-acc453f0-7587-4064-ab55-289ad70ee3e5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:49.691475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] The token cache is being invalidate because project b6460e8ab981419ca15be5756a256a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:49.691771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:49.697669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-acc453f0-7587-4064-ab55-289ad70ee3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:49.699700 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1807/3647] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:49 2022] DELETE /identity/v3/projects/b6460e8ab981419ca15be5756a256a88 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:49.704682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:49.704980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:49.705285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:49.749377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:49.753922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:49.972108 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1841/3648] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:49.973923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:49.974381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:49.974778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.027641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:50.037770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:50.050281 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1808/3649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:50.055262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.070374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5e67-f954-4907-92b5-e9a4843cab6a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.075425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.076042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.076325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.076600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.077323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:50.077623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.079631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.095474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1842/3650] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:50.101041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.112635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679be3e0-9790-4d79-9ba1-429b2893b174 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.118915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.120025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.120404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.120781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.122309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.124090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.180345 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1809/3651] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:50 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:50.186110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.202769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5559eda-28ae-439c-af05-0105878c5271 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.330883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.332107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.332565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.334086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.335592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.340116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.390430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1843/3652] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:50 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:50.394498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.411359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81222c-f498-4502-93e3-09d1b560bd96 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.425239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.426938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.427935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.429207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.431120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.436193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.454340 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1810/3653] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:50.462739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.531114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a4ec-7ae3-42da-9711-7d63de9b2c8f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.553541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.555435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.557079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.557497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.559278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.571430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26442ed4-be95-41a5-8e96-d37a919733e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.608430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:50.609318 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1844/3654] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:50.639178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a4e-8e34-47c2-bb35-3d90c0d91546 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:50.647330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:50.650700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.652319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.653215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] PATH_INFO: `/v3/projects/e13548092b5b45ab89945553ddd56999/users/a12c7b4a80e046a3968e0cefa8e4114b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.697850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13548092b5b45ab89945553ddd56999, user_id=a12c7b4a80e046a3968e0cefa8e4114b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:50.703732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:50.750440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1811/3655] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:50 2022] PUT /identity/v3/projects/e13548092b5b45ab89945553ddd56999/users/a12c7b4a80e046a3968e0cefa8e4114b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:50.761905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dda03-2b3f-4125-953c-f79a8ac15978 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:50.762389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dda03-2b3f-4125-953c-f79a8ac15978 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:50.763034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dda03-2b3f-4125-953c-f79a8ac15978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:50.886299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c95dda03-2b3f-4125-953c-f79a8ac15978 None None] MFA Rules not processed for user `a12c7b4a80e046a3968e0cefa8e4114b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:50.887843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c95dda03-2b3f-4125-953c-f79a8ac15978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:50.894743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:51.066562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1845/3656] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:51.071405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:51.106049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:51.246968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb03fa4-91f2-4abe-806a-688e79bbbe0a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:51.262929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:51.263728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.263999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.264270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.264907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:51.266883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:51.309428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae949-588a-450d-8402-511ab74faa2b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.309708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae949-588a-450d-8402-511ab74faa2b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.310011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae949-588a-450d-8402-511ab74faa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.397883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-361ae949-588a-450d-8402-511ab74faa2b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:51.408683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1812/3657] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:51 2022] POST /identity/v3/projects => generated 371 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:51.410314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:51.410559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-361ae949-588a-450d-8402-511ab74faa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:51.622698 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1846/3658] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:17:51.650480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb9a5d-297c-4507-ac2b-3aa16ce8bde1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:51.656806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae949-588a-450d-8402-511ab74faa2b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:51.658368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-361ae949-588a-450d-8402-511ab74faa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:51.671785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:51.672641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.672959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.673280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.673844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:51.675832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:51.829452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1813/3659] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:51 2022] POST /identity/v3/users => generated 292 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:51.857369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:51.871119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1ed7e-284f-4480-973b-84767770dbd6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:51.884164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:51.884933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.885392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.887270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.888372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:51.891646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:51.915522 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1814/3660] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:51.927098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:51.935360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae949-588a-450d-8402-511ab74faa2b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:51.954687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:51.956328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.956920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.957460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.961412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653aeb5-422d-45d6-90e3-05c2f2a652a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:51.991140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:51.991496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:51.992528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:51.993093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:51.993503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] PATH_INFO: `/v3/projects/8a18891f563c4e929caa55d4e5d0fac4/users/c97b242a84fc4366b0feaf0389728d2e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:51.994532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:52.043018 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1847/3661] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:17:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:17:52.091431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a18891f563c4e929caa55d4e5d0fac4, user_id=c97b242a84fc4366b0feaf0389728d2e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:52.111118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:52.163505 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1815/3662] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:51 2022] PUT /identity/v3/projects/8a18891f563c4e929caa55d4e5d0fac4/users/c97b242a84fc4366b0feaf0389728d2e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:52.169201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:52.185569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5e4c-3da1-4b7a-972e-d87f441101f1 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:52.379673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:52.444715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:52.446183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:52.447004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:52.447290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:52.450476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:52.456091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74f2d-d8cb-46b9-8f89-5f3e61ab6b43 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:52.496824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:52.499945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1848/3663] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:17:52.535013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60425547-3afb-41e1-a0e1-55058853ed49 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:52.559488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:52.560799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:52.568110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:52.568679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] PATH_INFO: `/v3/projects/8a18891f563c4e929caa55d4e5d0fac4/users/c97b242a84fc4366b0feaf0389728d2e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:52.576811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a18891f563c4e929caa55d4e5d0fac4, user_id=c97b242a84fc4366b0feaf0389728d2e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:52.589970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:52.659402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:52.659683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:52.662129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:52.678962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1816/3664] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:17:52 2022] PUT /identity/v3/projects/8a18891f563c4e929caa55d4e5d0fac4/users/c97b242a84fc4366b0feaf0389728d2e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:17:52.779516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] MFA Rules not processed for user `c97b242a84fc4366b0feaf0389728d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:52.780878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:53.094849 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1849/3665] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:53.100974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:53.144312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb7500-e0aa-42cb-9f02-f36da665fec4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:53.166559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:53.167094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:53.167372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:53.167641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:53.173457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:53.175355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:53.316128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1817/3666] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:17:53 2022] POST /identity/v3/projects => generated 359 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:53.320506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:53.341061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e466448-764c-4b0d-9786-c8f12ec0201e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:53.512760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:53.513893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:53.513893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:53.514213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:53.514601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:53.517072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:53.595431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:53.606858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1850/3667] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:53 2022] POST /identity/v3/users => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:17:53.609859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f163-288e-4a4f-a831-48a976db614c tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:53.637566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:53.638483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:53.638984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:53.639453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:53.640396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:17:53.640899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:53.643178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217693d8-86ab-458a-bb03-11689bbb5207 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:53.717733 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1818/3668] 10.222.0.78 () {58 vars in 1157 bytes} [Tue Oct 18 16:17:53 2022] GET /identity/v3/users?domain_id=default => generated 8305 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:17:53.719267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:53.748453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e8745-192a-4243-8843-10d500299716 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:53.767268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:53.768243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:53.768649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:53.769118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/users/8c71680bff864c2cbd9068534186b0e1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:53.803708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:update_user(user_id=8c71680bff864c2cbd9068534186b0e1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:53.809352 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:17:53.809352 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:17:53.809352 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:17:53.816281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:53.894405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:53.958343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invalidating the token cache because user 8c71680bff864c2cbd9068534186b0e1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:53.958785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:53.959931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:53.967221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:53.967554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:53.967830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:53.976287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:53.986783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1851/3669] 10.222.0.78 () {60 vars in 1244 bytes} [Tue Oct 18 16:17:53 2022] PATCH /identity/v3/users/8c71680bff864c2cbd9068534186b0e1 => generated 485 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:17:54.012861 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.auth.plugins.core [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] User is disabled: 8c71680bff864c2cbd9068534186b0e1: AssertionError: User is disabled: 8c71680bff864c2cbd9068534186b0e1 Oct 18 16:17:54.045609 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:17:54.056123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:54.058500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:54.081108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1819/3670] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:53 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 112 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 18 16:17:54.110867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b51fd-623a-4b0a-bcea-0dc04017b32d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:54.128830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:54.130347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:54.131121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:54.132800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/users/8c71680bff864c2cbd9068534186b0e1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:54.192639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:54.228637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8c71680bff864c2cbd9068534186b0e1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:54.239906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:54.477257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:54.515531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:54.519713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:54.568872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:54.574004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c71680bff864c2cbd9068534186b0e1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:54.710721 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1852/3671] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:54 2022] DELETE /identity/v3/users/8c71680bff864c2cbd9068534186b0e1 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:54.717938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:54.722160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:54.974622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5450d39-9141-4b8e-807c-b66a052b5bf6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:54.984304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:54.985418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:54.985926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:54.986417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/projects/7dd413b9165b4f8ea00a97a9143ac098` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:54.989909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7dd413b9165b4f8ea00a97a9143ac098)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:54.992523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:55.211738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd413b9165b4f8ea00a97a9143ac098', 'request_id': 'req-7c281b72-758f-4894-9669-4d44d6d42a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:55.230658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd413b9165b4f8ea00a97a9143ac098', 'request_id': 'req-7c281b72-758f-4894-9669-4d44d6d42a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:55.274181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd413b9165b4f8ea00a97a9143ac098', 'request_id': 'req-7c281b72-758f-4894-9669-4d44d6d42a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:55.332050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] The token cache is being invalidate because project 7dd413b9165b4f8ea00a97a9143ac098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:55.332603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:55.342424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:55.357295 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1820/3672] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:54 2022] DELETE /identity/v3/projects/7dd413b9165b4f8ea00a97a9143ac098 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:55.358906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:55.410178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2973d-db0c-44ed-b212-28aceb216186 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:55.607898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c97b242a84fc4366b0feaf0389728d2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a18891f563c4e929caa55d4e5d0fac4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:55.608878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:55.609502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:55.609917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:55.610753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:55.617049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-75d86070-2adb-4235-b91e-b9c554548a51 tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Could not find domain: 360ff71983eb497b84a62afab4780ceb.: keystone.exception.DomainNotFound: Could not find domain: 360ff71983eb497b84a62afab4780ceb. Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 360ff71983eb497b84a62afab4780ceb. Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:17:55.642912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:17:55.644195 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:17:55.645483 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:17:55.646919 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:17:55.646919 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:17:55.646919 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 360ff71983eb497b84a62afab4780ceb. Oct 18 16:17:55.646919 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:17:55.653098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1853/3673] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:17:55 2022] POST /identity/v3/users => generated 112 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 16:17:55.659819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:55.664018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:55.963980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c281b72-758f-4894-9669-4d44d6d42a6d tempest-UsersNegativeTest-1245890705 tempest-UsersNegativeTest-1245890705-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:55.994344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:55.995518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:55.996086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:55.996593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] PATH_INFO: `/v3/users/a12c7b4a80e046a3968e0cefa8e4114b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:56.001903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12c7b4a80e046a3968e0cefa8e4114b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:56.004589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:56.080250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:56.110059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12c7b4a80e046a3968e0cefa8e4114b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:56.117725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12c7b4a80e046a3968e0cefa8e4114b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:56.127854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12c7b4a80e046a3968e0cefa8e4114b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:56.141354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12c7b4a80e046a3968e0cefa8e4114b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:56.155246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12c7b4a80e046a3968e0cefa8e4114b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:56.203941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1821/3674] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:55 2022] DELETE /identity/v3/users/a12c7b4a80e046a3968e0cefa8e4114b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:56.205701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:56.206114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:56.206622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:56.247053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:17:56.248491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:56.464184 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1854/3675] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:17:56.508869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:56.510557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:56.760490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066e35c-72a0-417e-84e9-fe1cc6b54039 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:56.782332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:56.782332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:56.782332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:56.782332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:56.815993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:56.822486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:56.849365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1822/3676] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:17:57.942076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:57.946755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:57.976315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298ce6a-a457-43e3-9583-4a7f2199d99f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:58.015668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:58.016333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:58.016610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:58.016879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] PATH_INFO: `/v3/users/6eb8256cdb744f079cdfbcf7ef83e1d7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:58.027359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb8256cdb744f079cdfbcf7ef83e1d7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:58.029459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:58.058219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:58.226579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb8256cdb744f079cdfbcf7ef83e1d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:58.250808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb8256cdb744f079cdfbcf7ef83e1d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:58.251914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb8256cdb744f079cdfbcf7ef83e1d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:58.277473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb8256cdb744f079cdfbcf7ef83e1d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:58.280020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb8256cdb744f079cdfbcf7ef83e1d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:58.337114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1855/3677] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:57 2022] DELETE /identity/v3/users/6eb8256cdb744f079cdfbcf7ef83e1d7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:59.065168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:59.068107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:59.094570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0564-aeed-4f08-9819-8b80ce0cc842 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:59.400744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:59.401735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:59.402765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:59.404463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] PATH_INFO: `/v3/projects/e13548092b5b45ab89945553ddd56999` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:59.408669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13548092b5b45ab89945553ddd56999)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:59.413969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:59.582518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13548092b5b45ab89945553ddd56999', 'request_id': 'req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:59.590296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:17:59.601643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13548092b5b45ab89945553ddd56999', 'request_id': 'req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:59.621167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13548092b5b45ab89945553ddd56999', 'request_id': 'req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:59.659314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] The token cache is being invalidate because project e13548092b5b45ab89945553ddd56999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:17:59.659612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:59.663845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:17:59.668793 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1823/3678] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:59 2022] DELETE /identity/v3/projects/e13548092b5b45ab89945553ddd56999 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:17:59.673128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:59.675285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:59.681174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:17:59.687732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:17:59.713107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab11e-1809-40d7-9348-531110c09731 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:59.957649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749bb2-5168-4f1a-83a1-4f0e7ca0f423 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:17:59.970910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:59.972209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:59.972647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:59.973048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] PATH_INFO: `/v3/users/c97b242a84fc4366b0feaf0389728d2e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:59.980123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97b242a84fc4366b0feaf0389728d2e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:59.982370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:17:59.985138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:17:59.985524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:17:59.985849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] PATH_INFO: `/v3/projects/ebdd7d5c2a9f4c7f9505c5e983469e59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:17:59.987199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:17:59.990355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdd7d5c2a9f4c7f9505c5e983469e59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:17:59.997070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:00.211252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97b242a84fc4366b0feaf0389728d2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.225278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdd7d5c2a9f4c7f9505c5e983469e59', 'request_id': 'req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.228459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97b242a84fc4366b0feaf0389728d2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.229257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97b242a84fc4366b0feaf0389728d2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.246813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdd7d5c2a9f4c7f9505c5e983469e59', 'request_id': 'req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.259565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97b242a84fc4366b0feaf0389728d2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.261074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ac7bb00-4e5b-4252-9ff2-680bb1861698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97b242a84fc4366b0feaf0389728d2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.276384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdd7d5c2a9f4c7f9505c5e983469e59', 'request_id': 'req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.310229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] The token cache is being invalidate because project ebdd7d5c2a9f4c7f9505c5e983469e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:00.313517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.314544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ba243208-56a4-4d41-a5e8-d35bb2a6fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:00.319907 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1856/3679] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:17:59 2022] DELETE /identity/v3/users/c97b242a84fc4366b0feaf0389728d2e => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:00.325106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:00.325513 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1824/3680] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:17:59 2022] DELETE /identity/v3/projects/ebdd7d5c2a9f4c7f9505c5e983469e59 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:00.325645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:00.325914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:00.336820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:00.386418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:00.389791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:00.588926 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1857/3681] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:00.607226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:00.607656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:00.608253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:00.718401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:00.728504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:00.776292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1825/3682] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:00.781828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:00.825752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7204144-7d43-4b75-9ce9-99ac16bebc26 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:00.856363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:00.857038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:00.857333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:00.857631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:00.859341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:00.859677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:00.861544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:00.899884 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1858/3683] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:00.904724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:00.952658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0196d-1366-40a9-8e75-2c343c25130d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:00.981817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:00.984293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:00.984772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:00.985282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.000858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.010041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.136242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:01.147880 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1826/3684] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:00 2022] POST /identity/v3/projects => generated 397 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:01.171594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7753be-8510-4ac2-a3ef-2c0f65341fb1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:01.396675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:01.397330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.397799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.398288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.410539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.419327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.501393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:01.520518 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1859/3685] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:01 2022] POST /identity/v3/users => generated 299 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:01.524573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eaeff-7c86-4d79-ba3e-8cc876def280 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:01.550178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:01.555253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.557293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.557973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.559609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.564092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.596892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1827/3686] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:01.604822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:01.642519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437e2cf-d165-458d-85df-d31cbc3731f3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:01.679929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:01.682341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.683629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.685570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.687881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.695067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.740527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:01.742757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:01.752783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1860/3687] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:01.755748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:01.779321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b614575-4eda-4319-9796-f565b5d63595 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:01.781569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d88ad5-c31b-4e60-b0a6-921c60002672 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:01.803060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:01.804197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:01.804950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.805213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.805507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.805766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] PATH_INFO: `/v3/projects/8a18891f563c4e929caa55d4e5d0fac4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.806910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.808922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] PATH_INFO: `/v3/projects/f4faf70c703a4417bd7131aef1d7475d/users/7d7104a95b73405ab66140df742af14f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:01.812559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a18891f563c4e929caa55d4e5d0fac4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.830251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.874340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4faf70c703a4417bd7131aef1d7475d, user_id=7d7104a95b73405ab66140df742af14f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:01.887281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74f812-92bd-4f82-92d1-88e961d26156 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:01.957726 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1861/3688] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:01 2022] PUT /identity/v3/projects/f4faf70c703a4417bd7131aef1d7475d/users/7d7104a95b73405ab66140df742af14f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:01.961242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:01.975489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:01.976050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.043236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:02.075035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:02.080536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:02.142035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a18891f563c4e929caa55d4e5d0fac4', 'request_id': 'req-e3a5b552-9e75-4a30-94b9-10f6702f21b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:02.176101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a18891f563c4e929caa55d4e5d0fac4', 'request_id': 'req-e3a5b552-9e75-4a30-94b9-10f6702f21b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:02.188203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:02.225730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a18891f563c4e929caa55d4e5d0fac4', 'request_id': 'req-e3a5b552-9e75-4a30-94b9-10f6702f21b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:02.256867 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1862/3689] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:02.280652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:02.282268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:02.291646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] The token cache is being invalidate because project 8a18891f563c4e929caa55d4e5d0fac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:02.296130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:02.305641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3a5b552-9e75-4a30-94b9-10f6702f21b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:02.330821 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1828/3690] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:01 2022] DELETE /identity/v3/projects/8a18891f563c4e929caa55d4e5d0fac4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:02.333631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65973b-6d3d-4e20-8b04-b23a843617dc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:02.335626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65973b-6d3d-4e20-8b04-b23a843617dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:02.345136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65973b-6d3d-4e20-8b04-b23a843617dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.449342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b65b0-72b5-4422-84e0-25d5d5d1fb1a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:02.453999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f65973b-6d3d-4e20-8b04-b23a843617dc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:02.455500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f65973b-6d3d-4e20-8b04-b23a843617dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:02.475763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:02.477687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:02.478099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:02.480632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.521638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:02.528671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1829/3691] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:02.551598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:02.551598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:02.553936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:02.554223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:02.554500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.582413 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1863/3692] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:02.624491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:02.630272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:02.646337 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1830/3693] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:18:02.648011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:02.659707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38895-5316-4c17-b8ec-aa823af240fe service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:02.683789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:02.684296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:02.684712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:02.685682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.686953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:02.688226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:02.692838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:02.751451 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1864/3694] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:02.753717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:02.776767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c80fc-5b2f-4924-bc55-8bbb2ec6ecf4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:02.785313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:02.786871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:02.787595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:02.788096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:02.789456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:02.793413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:02.856325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1831/3695] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:02 2022] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:02.858001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:02.899515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223b765-168e-4679-a43d-4780c8be83cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:03.057420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:03.059924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.060704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.062365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.063345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:03.072500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:03.149418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1865/3696] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:02 2022] POST /identity/v3/users => generated 305 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:03.153605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:03.182414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a51f-85f7-4477-a136-ddd089776a39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:03.209193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:03.217479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.224252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.225348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.232195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:03.243362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:03.294025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1832/3697] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:03.297337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:03.319253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e154a-d0e5-4627-af55-206f55a7f7b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:03.334891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:03.335950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.336359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.336737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] PATH_INFO: `/v3/projects/0fc26f3531e1405eb3b962c2d82afea0/users/bf77707c898a471384d0b9614fe2b2c7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.358876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc26f3531e1405eb3b962c2d82afea0, user_id=bf77707c898a471384d0b9614fe2b2c7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:03.367009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:03.395925 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1866/3698] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:03 2022] PUT /identity/v3/projects/0fc26f3531e1405eb3b962c2d82afea0/users/bf77707c898a471384d0b9614fe2b2c7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:03.399596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:03.430078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1567352-a9f2-45f8-99bb-9f20598d5bd6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:03.648902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:03.658897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.659333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.660303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.662628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:03.665424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c13b9-a891-4771-a341-4871f7a5697e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:03.698833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1833/3699] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:03.703060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:03.720354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baca4f-3484-4722-a656-ceeebcac31c2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:03.736156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:03.738085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.740386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.740900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] PATH_INFO: `/v3/projects/0fc26f3531e1405eb3b962c2d82afea0/users/bf77707c898a471384d0b9614fe2b2c7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.748193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc26f3531e1405eb3b962c2d82afea0, user_id=bf77707c898a471384d0b9614fe2b2c7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:03.754012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:03.808599 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1867/3700] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:03 2022] PUT /identity/v3/projects/0fc26f3531e1405eb3b962c2d82afea0/users/bf77707c898a471384d0b9614fe2b2c7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:03.811126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:03.811535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:03.811907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:03.896124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] MFA Rules not processed for user `bf77707c898a471384d0b9614fe2b2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:03.898340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:04.091650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:04.146264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:04.149934 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1834/3701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:03 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:04.254645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:04.366942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d759-f317-4894-b9c9-43ab51306620 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:04.396774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:04.396774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:04.397214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:04.397214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:04.400124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:04.402345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:04.508096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:04.510716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1868/3702] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:04 2022] POST /identity/v3/projects => generated 397 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:04.539370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb014-1b03-4f29-90b7-9ae5f8e8fd0e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:04.753748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:04.755008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:04.755008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:04.755228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:04.755897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:04.757928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:04.827663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1835/3703] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:04 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:04.834225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:04.868142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a105d0-d6a0-4fee-aaa2-cf26cae17a55 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:04.903442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:04.907670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:04.907952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:04.908160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:04.909041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:04.926013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:05.011339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:05.012056 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1869/3704] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:05.040947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddea0b-3d57-43dc-a62b-357630e16d05 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:05.082065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:05.083209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:05.083680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:05.084167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:05.085401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:05.102393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eccdb-efd9-4f34-b4aa-bff992a5daa9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:05.174093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:05.190270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1836/3705] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:05.226694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce33e-c816-4e42-9003-f1900d2ac63f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:05.298665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:05.300461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:05.323899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:05.324650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] PATH_INFO: `/v3/projects/03753d7da4ef440682edbf550e5db076/users/4b021c3c644540d6bc9483fc29891629/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:05.430571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03753d7da4ef440682edbf550e5db076, user_id=4b021c3c644540d6bc9483fc29891629, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:05.465786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:05.503256 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1870/3706] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:05 2022] PUT /identity/v3/projects/03753d7da4ef440682edbf550e5db076/users/4b021c3c644540d6bc9483fc29891629/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:05.531072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:05.531633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:05.532030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:05.687545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] MFA Rules not processed for user `4b021c3c644540d6bc9483fc29891629`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:05.688867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:05.905041 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1837/3707] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:11.371385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:11.374443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:11.612697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6066cc-73af-446f-a051-9da6a6876f4e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:11.622730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:11.624556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:11.626231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:11.626785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:11.866810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:11.868243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092d8e6-decc-415a-954b-7453b8958163 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:11.912756 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1871/3708] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:13.353321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:13.597349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:13.611535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45877286-20ca-42ae-bce5-61cf7dd1c513 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:13.622136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:13.623391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:13.623995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:13.624601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] PATH_INFO: `/v3/users/bf77707c898a471384d0b9614fe2b2c7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:13.627889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf77707c898a471384d0b9614fe2b2c7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:13.634621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:13.852872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf77707c898a471384d0b9614fe2b2c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:13.857716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf77707c898a471384d0b9614fe2b2c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:13.894029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf77707c898a471384d0b9614fe2b2c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:13.895810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf77707c898a471384d0b9614fe2b2c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:13.921118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf77707c898a471384d0b9614fe2b2c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:13.989405 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1838/3709] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:13 2022] DELETE /identity/v3/users/bf77707c898a471384d0b9614fe2b2c7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:13.994767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:13.995306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:13.995601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:14.045978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:14.048979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:14.131928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:14.317627 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1872/3710] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:14.487377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:14.491174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:14.670559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa115ac-e1fb-4d03-bdea-fc2d54ea3dcd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:14.678418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:14.679231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:14.679517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:14.679886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:14.700811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:14.702325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:14.721750 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1839/3711] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:17.308943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:17.312015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:17.347753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81618f-e3d2-4d31-af70-9c7f8e4e2385 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:17.369376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:17.371182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:17.371746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:17.372248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] PATH_INFO: `/v3/projects/0fc26f3531e1405eb3b962c2d82afea0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:17.374585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc26f3531e1405eb3b962c2d82afea0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:17.379307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:17.493015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc26f3531e1405eb3b962c2d82afea0', 'request_id': 'req-6356cc68-fe50-4f3c-b87b-e164e808212d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.503141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc26f3531e1405eb3b962c2d82afea0', 'request_id': 'req-6356cc68-fe50-4f3c-b87b-e164e808212d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.517463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc26f3531e1405eb3b962c2d82afea0', 'request_id': 'req-6356cc68-fe50-4f3c-b87b-e164e808212d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.538958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] The token cache is being invalidate because project 0fc26f3531e1405eb3b962c2d82afea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:17.539518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.540470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.546975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:17.547603 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1873/3712] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:17 2022] DELETE /identity/v3/projects/0fc26f3531e1405eb3b962c2d82afea0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:17.564508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba6d8-d6b5-4c47-8f17-d5d2dad207c9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:17.719927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:17.723188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:17.724192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:17.724630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] PATH_INFO: `/v3/users/4b021c3c644540d6bc9483fc29891629` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:17.727259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b021c3c644540d6bc9483fc29891629)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:17.730626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:17.771778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:17.847266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b021c3c644540d6bc9483fc29891629'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.848301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b021c3c644540d6bc9483fc29891629'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.864737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b021c3c644540d6bc9483fc29891629'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.865439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b021c3c644540d6bc9483fc29891629'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.878706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6c2e1ee1-0609-4f0b-a0f3-5396cbb769df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b021c3c644540d6bc9483fc29891629'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:17.950749 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1840/3713] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:17 2022] DELETE /identity/v3/users/4b021c3c644540d6bc9483fc29891629 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:18.661506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:18.664673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:18.684318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cc68-fe50-4f3c-b87b-e164e808212d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:18.841699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:18.842828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:18.843279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:18.843429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] PATH_INFO: `/v3/projects/03753d7da4ef440682edbf550e5db076` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:18.844577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03753d7da4ef440682edbf550e5db076)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:18.847654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:18.991692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03753d7da4ef440682edbf550e5db076', 'request_id': 'req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:19.007282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:19.036615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03753d7da4ef440682edbf550e5db076', 'request_id': 'req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:19.052274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03753d7da4ef440682edbf550e5db076', 'request_id': 'req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:19.088507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] The token cache is being invalidate because project 03753d7da4ef440682edbf550e5db076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:19.089187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:19.090844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7d73cb2-2c81-45ce-a61b-576429a3d5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:19.093979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1874/3714] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:18 2022] DELETE /identity/v3/projects/03753d7da4ef440682edbf550e5db076 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:19.100918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.101534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.102463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.138601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:19.142043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:19.309034 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1841/3715] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:19.319412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884022-7316-447e-aa68-528cc817c143 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.322099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884022-7316-447e-aa68-528cc817c143 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.325017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884022-7316-447e-aa68-528cc817c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.374419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51884022-7316-447e-aa68-528cc817c143 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:19.375723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51884022-7316-447e-aa68-528cc817c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:19.392896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1875/3716] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:19.401216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:19.419794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0097e6-55cc-4716-956c-809fa7826278 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:19.435354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:19.435896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.436169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.436436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.438571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:19.438888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:19.449654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:19.496006 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1842/3717] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:19.497597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884022-7316-447e-aa68-528cc817c143 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:19.511285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884022-7316-447e-aa68-528cc817c143 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:19.525799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:19.526431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.526764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.527380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.528434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:19.530616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:19.610115 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1876/3718] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:19 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:19.615625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:19.634780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd93778-e526-41e3-ab44-8b0da7417b60 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:19.778621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:19.779716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.781534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.782257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.783371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:19.788112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:19.828659 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1843/3719] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:19 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:18:19.835418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:19.847251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cb932-716d-4bff-9935-b4c16e2b15ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:19.852941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:19.853741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.854098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.854456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.855193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:19.856880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:19.874844 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1877/3720] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:19.879208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:19.893548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da545-74ed-4da8-b82b-c5abd728f7dd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:19.905902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:19.907128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:19.907618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:19.908130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] PATH_INFO: `/v3/projects/6b799ae5683741d2b585bf633a8c10a5/users/4809bd8ecc944829a9b1f0dcec64c9d6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:19.938586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:19.946182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b799ae5683741d2b585bf633a8c10a5, user_id=4809bd8ecc944829a9b1f0dcec64c9d6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:19.950238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:19.975582 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1844/3721] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:19 2022] PUT /identity/v3/projects/6b799ae5683741d2b585bf633a8c10a5/users/4809bd8ecc944829a9b1f0dcec64c9d6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:19.979645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:20.011125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724862b-2059-43d4-bfdc-cfed33da24e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:20.184337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:20.185092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.185384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.185656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.186548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:20.188302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:20.213021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:20.229246 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1878/3722] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:20.240582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d24c09-dbe8-4bf1-8920-483e183f420a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:20.248398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:20.249803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.250307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.250821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] PATH_INFO: `/v3/projects/6b799ae5683741d2b585bf633a8c10a5/users/4809bd8ecc944829a9b1f0dcec64c9d6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.253706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b799ae5683741d2b585bf633a8c10a5, user_id=4809bd8ecc944829a9b1f0dcec64c9d6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:20.258836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d407b5-95ff-4028-be61-7e6760e5141a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:20.283512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:20.284335 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1845/3723] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:20 2022] PUT /identity/v3/projects/6b799ae5683741d2b585bf633a8c10a5/users/4809bd8ecc944829a9b1f0dcec64c9d6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:20.296895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.297257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.297468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.300153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:20.362540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] MFA Rules not processed for user `4809bd8ecc944829a9b1f0dcec64c9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:20.367061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:20.552642 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1846/3724] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:20.558472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:20.585324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af3cbd-b742-4b6b-ab2e-73007913c67d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:20.674458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:20.721105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe88e8-6c3e-48e8-8da8-c7c44fa25b5a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:20.736121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:20.737075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.737609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.738059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.739103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:20.741365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b3eb-9b09-499e-8b48-f0c39f3dd9f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:20.795364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:20.796272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.796830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.797400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.804120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:20.828760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:20.830870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:20.831006 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1847/3725] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:20 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:18:20.831969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.832789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.833078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.844226 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1879/3726] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:20.849988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:20.863205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f679c-8273-4fbf-a5d5-aa0624fb9bd2 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:20.890207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] MFA Rules not processed for user `1cc60ef5fff74c2eab3f81450c33a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:20.893505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:20.984707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:20.985507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:20.985919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:20.986291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:20.987040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:20.989482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:21.028247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1880/3727] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:20 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:21.029383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:21.042923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b955fb-7eac-4888-8e80-fc5a0f68d858 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:21.048906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:21.049686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.050128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.050323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.052628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:21.053821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:21.065760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:21.071578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1881/3728] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:21.077614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:21.100806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3431d9e-4d6e-4881-9a9f-73363d257f90 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:21.125554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:21.126481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.126965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.127408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.128317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:21.132170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed57f-4a94-45b3-ad40-c34d48b221d3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:21.139552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1848/3729] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:21.155298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1882/3730] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:21.159688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:21.183421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a725dd5-c6f4-4435-8090-3c4b6667a01a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:21.189224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:21.190377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.190750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.191121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] PATH_INFO: `/v3/projects/0cb107f23ad0426ca3a322a19693d57a/users/ddfc5b96438b4595a6860cfe0e117d5d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.219044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb107f23ad0426ca3a322a19693d57a, user_id=ddfc5b96438b4595a6860cfe0e117d5d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:21.226296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:21.266516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1849/3731] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:21 2022] PUT /identity/v3/projects/0cb107f23ad0426ca3a322a19693d57a/users/ddfc5b96438b4595a6860cfe0e117d5d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:21.268259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5039-d415-4ee7-8af4-ce937cd2a652 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.268608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5039-d415-4ee7-8af4-ce937cd2a652 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.268793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5039-d415-4ee7-8af4-ce937cd2a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.356692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3aaf5039-d415-4ee7-8af4-ce937cd2a652 None None] MFA Rules not processed for user `ddfc5b96438b4595a6860cfe0e117d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:21.360152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3aaf5039-d415-4ee7-8af4-ce937cd2a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:21.495058 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1883/3732] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:21.510795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:21.512672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:21.630266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01652a25-c81d-4e5a-bb9b-86e87e42e955 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:21.634822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:21.635587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.635895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.636283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.762559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:21.764600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cf012-6458-44bf-bf3f-be29cf64b965 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:21.780355 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1850/3733] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:21.797715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:21.797998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:21.798270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:21.861514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] MFA Rules not processed for user `7d7104a95b73405ab66140df742af14f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:21.862910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:21.880506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.046358 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1884/3734] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:22.058533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:22.059015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:22.060469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:22.109847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] MFA Rules not processed for user `7d7104a95b73405ab66140df742af14f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:22.111090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:22.134176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1851/3735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:22.470426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:22.544978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:22.548218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:22.639948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2efe71-34b4-43e0-97c8-fd58a2e0959c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:22.646582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:22.647868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:22.648277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:22.651045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] PATH_INFO: `/v3/users/4809bd8ecc944829a9b1f0dcec64c9d6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:22.658252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=4809bd8ecc944829a9b1f0dcec64c9d6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:22.666571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:22.688040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:22.709520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a116e-687a-4db4-8f16-465c35f8e84b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:22.731175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:22.731799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:22.732073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:22.732339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:22.744557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:22.747295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03483dc-3316-4517-9938-8d9df004bcf0 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:22.768549 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1852/3736] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:18:22.812329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4809bd8ecc944829a9b1f0dcec64c9d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:22.824674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4809bd8ecc944829a9b1f0dcec64c9d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:22.827917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4809bd8ecc944829a9b1f0dcec64c9d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:22.846720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4809bd8ecc944829a9b1f0dcec64c9d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:22.847194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4809bd8ecc944829a9b1f0dcec64c9d6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:22.877453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:22.877453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:22.880327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:22.894878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1885/3737] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:22 2022] DELETE /identity/v3/users/4809bd8ecc944829a9b1f0dcec64c9d6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:22.932019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:22.935847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:23.069975 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1853/3738] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:23.094330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:23.095891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:23.171237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:23.257239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1878d-c1fc-4b59-a331-22d097a60cde admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:23.258870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:23.259955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:23.260230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:23.260498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:23.271693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:23.272553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:23.283656 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1886/3739] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:23.309058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:23.310984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:23.328441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a332fa-4524-466b-8d12-e2a4d3eec9b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:23.334608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:23.335291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:23.335619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:23.335943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:23.338916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:23.356698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:23.365475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:23.385449 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1854/3740] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:26.105505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:26.107699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:26.133626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99513f07-75da-4301-8104-b0b289c818b5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:26.142845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:26.143882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:26.145024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:26.145720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] PATH_INFO: `/v3/projects/6b799ae5683741d2b585bf633a8c10a5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:26.147868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b799ae5683741d2b585bf633a8c10a5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:26.151108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:26.288265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b799ae5683741d2b585bf633a8c10a5', 'request_id': 'req-383c9675-353f-4114-adfb-dde94bed79a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.299269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b799ae5683741d2b585bf633a8c10a5', 'request_id': 'req-383c9675-353f-4114-adfb-dde94bed79a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.325124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b799ae5683741d2b585bf633a8c10a5', 'request_id': 'req-383c9675-353f-4114-adfb-dde94bed79a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.349875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] The token cache is being invalidate because project 6b799ae5683741d2b585bf633a8c10a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:26.350668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.351617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.362725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:26.365892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1887/3741] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:26 2022] DELETE /identity/v3/projects/6b799ae5683741d2b585bf633a8c10a5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:26.465995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7db485-0189-41cf-8864-ed76d9af1ff8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:26.716458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:26.717354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:26.717638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:26.717959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] PATH_INFO: `/v3/users/ddfc5b96438b4595a6860cfe0e117d5d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:26.719132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddfc5b96438b4595a6860cfe0e117d5d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:26.724724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:26.909098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddfc5b96438b4595a6860cfe0e117d5d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.911196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddfc5b96438b4595a6860cfe0e117d5d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.939757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddfc5b96438b4595a6860cfe0e117d5d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.945256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddfc5b96438b4595a6860cfe0e117d5d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:26.968719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26c00fec-15f5-48f6-8ceb-6b0a0b20109d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddfc5b96438b4595a6860cfe0e117d5d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:27.007587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:27.025541 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1855/3742] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:26 2022] DELETE /identity/v3/users/ddfc5b96438b4595a6860cfe0e117d5d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:28.443853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:28.446714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:28.476354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9675-353f-4114-adfb-dde94bed79a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:28.653065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:28.659076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:28.661318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:28.661619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] PATH_INFO: `/v3/projects/0cb107f23ad0426ca3a322a19693d57a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:28.665585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb107f23ad0426ca3a322a19693d57a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:28.669171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:28.818220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb107f23ad0426ca3a322a19693d57a', 'request_id': 'req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:28.832587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb107f23ad0426ca3a322a19693d57a', 'request_id': 'req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:28.835001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:28.866394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb107f23ad0426ca3a322a19693d57a', 'request_id': 'req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:28.902302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] The token cache is being invalidate because project 0cb107f23ad0426ca3a322a19693d57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:28.902914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:28.908243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c0365b1-b9ec-4b90-a6ce-c807d53e7600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:28.911638 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1888/3743] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:28 2022] DELETE /identity/v3/projects/0cb107f23ad0426ca3a322a19693d57a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:28.917130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb80b-33f5-4e2d-bbd9-004e5c6bbaa2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:28.917664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb80b-33f5-4e2d-bbd9-004e5c6bbaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:28.917664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cb80b-33f5-4e2d-bbd9-004e5c6bbaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:28.984599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b9cb80b-33f5-4e2d-bbd9-004e5c6bbaa2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:28.986239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b9cb80b-33f5-4e2d-bbd9-004e5c6bbaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:29.166770 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1856/3744] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:18:29.176323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.176846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.177230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.191146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.191146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.191146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.236875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:29.239221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:29.243352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:29.245080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:29.277548 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1889/3745] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:29.281557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.299748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb882d2-5c96-4d5b-afa7-ddec0db022c7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.320677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.322872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.323153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.323422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.326917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:29.327239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.331242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.373071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1890/3746] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:29.376124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.402427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bf7f-66d3-4b30-bf0c-000e056ebc67 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.424615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.425343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.427534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.427823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.429612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.434704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.472938 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1857/3747] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:29.491809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.498738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:29.503831 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1891/3748] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:29 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:29.509275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.671067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988abf-589c-496a-908f-c10851315857 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.679864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb9504-fab9-447e-af75-71f3f4727a02 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.686834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.688426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.688812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.689217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.690455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.699832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.753483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1892/3749] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:29 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:29.757921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.776618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:29.783807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a6a2-7941-4173-a7a8-bdcc5d66a3b6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.803586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.804500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.806075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.806468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.809118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.815840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.822603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.823522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.823928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.824204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.857869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1893/3750] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:29.857869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:29.901407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233323a-43bd-401c-8a13-e946eb0c6d93 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:29.910788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:29.912302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.912683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.913157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.913900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.917997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50e40-668c-4d30-8c95-48d77e0dec45 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.955735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1894/3751] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:29.961770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:29.962462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:29.963101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:29.982531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:29.985675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:29.998614 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1858/3752] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:18:30.000755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:30.014609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:30.015981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:30.023183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7223fe0-52d3-4334-a823-8187969b7bd8 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:30.043609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:30.053792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:30.054171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:30.054462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] PATH_INFO: `/v3/projects/9bc26a0654bd4a9fb88f29f5eb5ebee8/users/92333bea9f6545919ff7dafe654876c9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:30.106327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc26a0654bd4a9fb88f29f5eb5ebee8, user_id=92333bea9f6545919ff7dafe654876c9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:30.115066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490fcd3-bc88-4175-8389-d7abb96a9614 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:30.155344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1859/3753] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:29 2022] PUT /identity/v3/projects/9bc26a0654bd4a9fb88f29f5eb5ebee8/users/92333bea9f6545919ff7dafe654876c9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:30.156140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1895/3754] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:30.157033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:30.157778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:30.157894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:30.210035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] MFA Rules not processed for user `92333bea9f6545919ff7dafe654876c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:30.211119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:30.457695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:30.458827 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1860/3755] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:30.475158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5247e6-1838-4dac-81b9-cb15ee334184 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:30.500958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:30.751043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:30.777127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:30.778141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:30.778458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:30.779209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:30.788159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:30.921609 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1896/3756] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:30 2022] POST /identity/v3/projects => generated 365 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:30.927775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:30.951902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af032b-93d4-481d-8f61-33422d87c6a8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:31.072224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:31.095104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:31.096629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.098747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.099564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.100828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:31.103290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:31.145539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1861/3757] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:30 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:31.149348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:31.168879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647795-24ca-4736-bb27-5bf837c8c5a1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:31.176283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:31.177356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.177824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.178179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.179190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:31.183313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:31.200705 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1897/3758] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:31.211980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:31.232367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192f6a-5e51-47c9-a336-d66009b03c1f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:31.239741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:31.240698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.241294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.241746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.243236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:31.249339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10194c4-75c8-42ec-8273-048e13254f28 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:31.268530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1862/3759] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:31.274090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:31.301507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6998-2d37-40f2-9f29-277c86c0b8c1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:31.303945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:31.304848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.305163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.305472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] PATH_INFO: `/v3/projects/9f1d9eab0f124ca88ac191479b54ae07/users/2ddbf8cc27c64b8a8ca757d8241ab61d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.342409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1d9eab0f124ca88ac191479b54ae07, user_id=2ddbf8cc27c64b8a8ca757d8241ab61d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:31.345152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:31.372578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1898/3760] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:31 2022] PUT /identity/v3/projects/9f1d9eab0f124ca88ac191479b54ae07/users/2ddbf8cc27c64b8a8ca757d8241ab61d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:31.384182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.385697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.386217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.449131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] MFA Rules not processed for user `2ddbf8cc27c64b8a8ca757d8241ab61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:31.451588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:31.561247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1863/3761] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:31.577368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:31.579798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:31.718592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a10a8b-34c0-4295-828d-0264861f2a55 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:31.731019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:31.731542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:31.731768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:31.732037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:31.868601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:31.871867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:31.895036 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1899/3762] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:18:32.185988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:32.202278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98638-2041-43f2-900d-855c1591cf9b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:32.215099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:32.215946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:32.216224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:32.216507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:32.237786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:32.240716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b088-8c92-4274-a7f0-09159225a6b2 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:32.274042 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1864/3763] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:34.886555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:35.004921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:35.201531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236f67b-338f-455b-8ec0-b04d87df2eca service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:35.216477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:35.217576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:35.218065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:35.218545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] PATH_INFO: `/v3/users/92333bea9f6545919ff7dafe654876c9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:35.225218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92333bea9f6545919ff7dafe654876c9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:35.228844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:35.406417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92333bea9f6545919ff7dafe654876c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:35.420915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92333bea9f6545919ff7dafe654876c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:35.421718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92333bea9f6545919ff7dafe654876c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:35.434897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92333bea9f6545919ff7dafe654876c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:35.436212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92333bea9f6545919ff7dafe654876c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:35.482920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1900/3764] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:34 2022] DELETE /identity/v3/users/92333bea9f6545919ff7dafe654876c9 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:35.491428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:35.492835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:35.493468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:35.571739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:35.580090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:35.805055 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1865/3765] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:35.818465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:35.820299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:35.981367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa69cb-8c0b-46ae-9441-ebe81bd0688d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:35.992482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:35.992482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:35.992482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:35.992482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:36.017971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:36.019777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:36.038624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1901/3766] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:36.980442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:36.982069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:37.007584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fe45-9846-4ff6-8ca8-53324b79de35 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:37.022838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:37.023565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:37.023969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:37.024246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] PATH_INFO: `/v3/projects/9bc26a0654bd4a9fb88f29f5eb5ebee8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:37.027639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc26a0654bd4a9fb88f29f5eb5ebee8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:37.029638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:37.094899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:37.110188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc26a0654bd4a9fb88f29f5eb5ebee8', 'request_id': 'req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.124618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc26a0654bd4a9fb88f29f5eb5ebee8', 'request_id': 'req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.137218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc26a0654bd4a9fb88f29f5eb5ebee8', 'request_id': 'req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.158999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] The token cache is being invalidate because project 9bc26a0654bd4a9fb88f29f5eb5ebee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:37.159666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.161727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.164783 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1866/3767] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:36 2022] DELETE /identity/v3/projects/9bc26a0654bd4a9fb88f29f5eb5ebee8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:37.170276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:37.212579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f6c1c-bd2b-416c-9434-1eba817811be service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:37.349060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:37.395805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:37.396515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:37.396957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:37.397280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] PATH_INFO: `/v3/users/2ddbf8cc27c64b8a8ca757d8241ab61d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:37.403451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddbf8cc27c64b8a8ca757d8241ab61d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:37.408746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:37.552410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddbf8cc27c64b8a8ca757d8241ab61d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.570632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddbf8cc27c64b8a8ca757d8241ab61d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.571622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddbf8cc27c64b8a8ca757d8241ab61d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.584708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddbf8cc27c64b8a8ca757d8241ab61d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.585499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-071caea6-9baa-46bf-af80-54b404611be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddbf8cc27c64b8a8ca757d8241ab61d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:37.640731 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1902/3768] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:37 2022] DELETE /identity/v3/users/2ddbf8cc27c64b8a8ca757d8241ab61d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:38.502142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:38.505732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:38.523681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0b36f-7a5a-49c6-b40d-37fc1ecbec43 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:38.609749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:38.610560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:38.610936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:38.611307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] PATH_INFO: `/v3/projects/9f1d9eab0f124ca88ac191479b54ae07` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:38.612774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1d9eab0f124ca88ac191479b54ae07)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:38.621080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:38.694045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1d9eab0f124ca88ac191479b54ae07', 'request_id': 'req-4db98c37-aa14-40b6-a04a-a180383f374b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:38.704533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1d9eab0f124ca88ac191479b54ae07', 'request_id': 'req-4db98c37-aa14-40b6-a04a-a180383f374b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:38.716221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1d9eab0f124ca88ac191479b54ae07', 'request_id': 'req-4db98c37-aa14-40b6-a04a-a180383f374b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:38.746844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] The token cache is being invalidate because project 9f1d9eab0f124ca88ac191479b54ae07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:38.747448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:38.750295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4db98c37-aa14-40b6-a04a-a180383f374b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:38.755517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1867/3769] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:38 2022] DELETE /identity/v3/projects/9f1d9eab0f124ca88ac191479b54ae07 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:38.764732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:38.765376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:38.765834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:38.854917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:38.857314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:39.080494 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1903/3770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:39.225606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.225955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.226158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.272178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:39.281503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:39.303286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1868/3771] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:39.308400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.326764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097050-c33d-4c75-8817-f4a0d276f748 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.341349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.343296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.343845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.344453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.346127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:39.346882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.353212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:39.387139 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1904/3772] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:39.388043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.403531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0aa4a-fcc7-4992-b6e1-72adde809471 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.425840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.426474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.426751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.427210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.427876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.430047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:39.492284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1869/3773] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:39 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:18:39.493915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.524085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c834-41c1-47c1-a340-230c62b781e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.661995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:39.710862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.711554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.712746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.713177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.722733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.726810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:39.778210 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1905/3774] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:39 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:39.779090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.795037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1add3-40ca-4e80-ba4a-d7d182d91f06 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.806475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.807519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.808039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.808481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.809344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.811663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:39.842630 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1870/3775] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:39.844844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.864459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff01bc-f934-4c2c-95e9-7742a4e0e726 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.871523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.880025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.880695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.881172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.882215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.884057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbbe7c-97d1-4372-9970-5e62b497daaa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:39.910425 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1906/3776] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:39.914830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:39.936643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d8a5-8a1d-4e6e-a2a6-a920389adc5e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:39.952296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:39.953740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:39.955576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:39.956337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] PATH_INFO: `/v3/projects/dd9ed54820714c98bf1b3dba8ac41ebb/users/258fa205974d41be980663add84b59ca/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:39.989605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9ed54820714c98bf1b3dba8ac41ebb, user_id=258fa205974d41be980663add84b59ca, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:39.994850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:40.007759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:40.032223 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1871/3777] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:39 2022] PUT /identity/v3/projects/dd9ed54820714c98bf1b3dba8ac41ebb/users/258fa205974d41be980663add84b59ca/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:40.044067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:40.045209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:40.045760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:40.139046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] MFA Rules not processed for user `258fa205974d41be980663add84b59ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:40.140271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:40.338310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1907/3778] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:40.353197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:40.355060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:40.498652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc50c9-52e1-4ca3-87d6-9f6fd51cee24 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:40.504929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:40.506105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:40.506105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:40.506393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:40.539726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:40.541330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:40.564585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1872/3779] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:41.074829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:41.076765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:41.217546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d450-47c1-4164-b5a9-118af3f9760e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:41.225669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:41.227010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:41.227810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:41.228846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:41.232614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:41.398099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:41.399971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d1985-fe7a-453c-8b02-d09fbbcb810c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:41.408986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:41.424114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a22c4-bb63-4200-a5da-aa0d44aa6c89 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:41.442515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:41.443322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:41.443587 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1908/3780] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:41.443772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:41.444317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] PATH_INFO: `/v3/users/258fa205974d41be980663add84b59ca` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:41.445744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258fa205974d41be980663add84b59ca)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:41.449161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:41.556959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258fa205974d41be980663add84b59ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:41.558301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258fa205974d41be980663add84b59ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:41.569480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258fa205974d41be980663add84b59ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:41.570847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258fa205974d41be980663add84b59ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:41.586140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258fa205974d41be980663add84b59ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:41.633624 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1873/3781] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:41 2022] DELETE /identity/v3/users/258fa205974d41be980663add84b59ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:41.638214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:41.638491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:41.638762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:41.651909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:41.672696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:41.674295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:41.783473 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1909/3782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:18:41.816601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:41.818638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:41.927249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48552b8-f3b1-40a5-af1b-c77c7ad65d69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:41.942120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:41.942910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:41.943284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:41.943650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:41.963533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:41.965549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24f937-a021-4c9e-ba67-77469659e05f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:41.978744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1874/3783] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:42.903312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:42.904847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:42.930217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12ecd-8218-4365-bf89-5adfd4e5d0b9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:42.939299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:42.940359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:42.941668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:42.942140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] PATH_INFO: `/v3/users/edf8e722c29b4428a12703b05e0ebc2a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:42.943905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf8e722c29b4428a12703b05e0ebc2a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:42.947980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:43.054585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf8e722c29b4428a12703b05e0ebc2a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:43.070059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf8e722c29b4428a12703b05e0ebc2a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:43.071816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf8e722c29b4428a12703b05e0ebc2a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:43.091505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf8e722c29b4428a12703b05e0ebc2a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:43.093172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf8e722c29b4428a12703b05e0ebc2a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:43.120434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1910/3784] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:42 2022] DELETE /identity/v3/users/edf8e722c29b4428a12703b05e0ebc2a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:43.125253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:43.126397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:43.127119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:43.154681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:43.156373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:43.183283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:43.316525 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1875/3785] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:43.341096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:43.343270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:43.428880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cac7ed-4a2a-4da4-8cc5-e77c1aba232d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:43.435181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:43.435816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:43.436088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:43.436355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:43.452951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:43.454757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:43.472983 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1911/3786] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:43.795083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:43.798316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:43.908917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f997f71-1d5e-4d41-b42e-35181386a321 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:43.938639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:43.943431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:43.944122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:43.944786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] PATH_INFO: `/v3/projects/dd9ed54820714c98bf1b3dba8ac41ebb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:43.949989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9ed54820714c98bf1b3dba8ac41ebb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:43.976604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:44.094907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9ed54820714c98bf1b3dba8ac41ebb', 'request_id': 'req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.105957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:44.108683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:44.118788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9ed54820714c98bf1b3dba8ac41ebb', 'request_id': 'req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.146738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9ed54820714c98bf1b3dba8ac41ebb', 'request_id': 'req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.175558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3458e0-4b9b-4eec-b189-1dd40a40f323 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:44.185694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] The token cache is being invalidate because project dd9ed54820714c98bf1b3dba8ac41ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:44.185988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.187400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ac5691e4-ed69-4b5e-acf1-dbf860a5d086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.202795 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1876/3787] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:43 2022] DELETE /identity/v3/projects/dd9ed54820714c98bf1b3dba8ac41ebb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:44.204817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd324-640d-40e7-a03c-05c97a913ac5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.205841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd324-640d-40e7-a03c-05c97a913ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.205841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd324-640d-40e7-a03c-05c97a913ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.220764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:44.309917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f5ffd324-640d-40e7-a03c-05c97a913ac5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:44.317307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5ffd324-640d-40e7-a03c-05c97a913ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:44.400928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:44.402380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.402875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.403360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] PATH_INFO: `/v3/projects/9333cee966ee488888baa81cca159833` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.411003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9333cee966ee488888baa81cca159833)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:44.416756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:44.543233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1877/3788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:44.547421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.548025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.548752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.562595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9333cee966ee488888baa81cca159833', 'request_id': 'req-3a2050d0-5e89-42ee-bb09-da6266dee65a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.571469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9333cee966ee488888baa81cca159833', 'request_id': 'req-3a2050d0-5e89-42ee-bb09-da6266dee65a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.578256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:44.579546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:44.581834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9333cee966ee488888baa81cca159833', 'request_id': 'req-3a2050d0-5e89-42ee-bb09-da6266dee65a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.611011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] The token cache is being invalidate because project 9333cee966ee488888baa81cca159833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:44.614773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.616595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:44.620561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.629891 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1912/3789] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:44 2022] DELETE /identity/v3/projects/9333cee966ee488888baa81cca159833 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:18:44.637592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:44.639004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:44.767205 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1878/3790] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:44.772979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:44.784312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4599ab-c9a1-4088-a3b0-147189a1f006 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:44.790883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:44.791622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.792103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.792409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.793348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:44.793649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:44.795281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:44.797348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2050d0-5e89-42ee-bb09-da6266dee65a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:44.806450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:44.807130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.807396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.807667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] PATH_INFO: `/v3/users/8252ee4a252a44e9ae8794892bfadaea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.808876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8252ee4a252a44e9ae8794892bfadaea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:44.810814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:44.833694 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1879/3791] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:18:44.838543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:44.862765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585f58-aa6e-4ec4-9b26-504acf1401c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:44.876458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:44.877122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:44.877399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:44.877669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:44.878343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:44.880420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:44.919666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:44.923009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8252ee4a252a44e9ae8794892bfadaea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.942255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8252ee4a252a44e9ae8794892bfadaea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.943220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8252ee4a252a44e9ae8794892bfadaea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.969828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8252ee4a252a44e9ae8794892bfadaea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.974947 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1880/3792] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:44 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:18:44.975736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:44.976873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8252ee4a252a44e9ae8794892bfadaea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:44.977760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:45.022372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1913/3793] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:18:44 2022] DELETE /identity/v3/users/8252ee4a252a44e9ae8794892bfadaea => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:45.100642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808fa5c-b369-46b0-9d4a-318dbe52fe6f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:45.296891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:45.297977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.298267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.298666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.299423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:45.302590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:45.343581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1881/3794] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:44 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:45.349081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:45.412181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb5321-efb4-40c9-95a4-7e2a663893f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:45.423147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:45.424566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.425651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.426395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.427114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:45.429067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:45.445600 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1914/3795] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:45.451065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:45.463912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1f67-24d3-4e56-a40c-d1603efd90dc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:45.470358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:45.471068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.471454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.472073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.473272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:45.476225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff36d-2286-419f-b2d5-8165a8f49367 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:45.479402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:45.510683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1882/3796] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:45.511988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:45.524055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0a14-1084-4cad-8958-0314cb74756d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:45.531880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:45.532702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.533438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.533438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] PATH_INFO: `/v3/projects/763d85495b574efd930f2dda9ab8bcaf/users/d267b3088ea24884a74772ad1367f0c4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.584140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763d85495b574efd930f2dda9ab8bcaf, user_id=d267b3088ea24884a74772ad1367f0c4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:45.590955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:45.620888 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1915/3797] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:45 2022] PUT /identity/v3/projects/763d85495b574efd930f2dda9ab8bcaf/users/d267b3088ea24884a74772ad1367f0c4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:45.633212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.633563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.634410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.647330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:45.649669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:45.681861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] MFA Rules not processed for user `d267b3088ea24884a74772ad1367f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:45.683241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:45.777031 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1883/3798] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:45.802816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:45.804188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:45.821744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155829e1-0365-4d16-baba-3ee84f732d79 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:45.827954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:45.828745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.829721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.830104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] PATH_INFO: `/v3/projects/4c378fdcfd8543489f0b99fda82d836b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:45.832478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c378fdcfd8543489f0b99fda82d836b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:45.834925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:45.901639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c378fdcfd8543489f0b99fda82d836b', 'request_id': 'req-85d8e944-2ff7-41df-852e-4eefdd71a4b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:45.911063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c378fdcfd8543489f0b99fda82d836b', 'request_id': 'req-85d8e944-2ff7-41df-852e-4eefdd71a4b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:45.919462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c378fdcfd8543489f0b99fda82d836b', 'request_id': 'req-85d8e944-2ff7-41df-852e-4eefdd71a4b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:45.946189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:45.949249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] The token cache is being invalidate because project 4c378fdcfd8543489f0b99fda82d836b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:18:45.951556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:45.953737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85d8e944-2ff7-41df-852e-4eefdd71a4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:18:45.958117 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1916/3799] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:18:45 2022] DELETE /identity/v3/projects/4c378fdcfd8543489f0b99fda82d836b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:45.966297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa2ce-b42a-4ea4-900b-c46f863bae96 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:45.967410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa2ce-b42a-4ea4-900b-c46f863bae96 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:45.968632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaa2ce-b42a-4ea4-900b-c46f863bae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.036733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12fb3d-fc17-42f6-b7e9-b1f312e37b02 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.056017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bfeaa2ce-b42a-4ea4-900b-c46f863bae96 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:46.057754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bfeaa2ce-b42a-4ea4-900b-c46f863bae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:46.159567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.162033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.162033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.162033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.165631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:46.220262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1917/3800] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:46.223354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.223586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.224089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.274316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:46.275727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:46.300562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1918/3801] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:46.301798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.316720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74580c8-4d47-4328-ae23-66133a857df7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.322656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:46.335138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.335842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.336175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.336470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.336591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.337156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:18:46.337456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.341420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.342097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.376619 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1919/3802] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:18:46.377763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.377900 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1884/3803] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:18:46.397014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e641c7-5982-40b8-a917-986c6008cf0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.411948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.412581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.412861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.413415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.414076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.415963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.483177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1920/3804] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:46 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:46.487339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.518148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74439a60-6c12-441c-92d3-71568daf4d3a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.645459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.647633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.649242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.649700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.650708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.655409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.750411 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1885/3805] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:46 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:46.754844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.804968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c9d9-fc5a-41eb-8574-40430a60410f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.830418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.836189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.843538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.845698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.849392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.867980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.902389 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1921/3806] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:46.906945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.920792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252988c7-6885-4af8-a6cc-28a5d57f3139 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.927606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.928765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.929300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.930009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:46.931241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:46.933472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9cad-401d-4729-9cd0-2d4e00c74cd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:46.949989 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1886/3807] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:18:46.955061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:46.975637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4357d3-fc1b-432a-807a-c9f01a933c88 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:46.983057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:46.983914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:46.984687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:46.985219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] PATH_INFO: `/v3/projects/6cc9b0ddd863459ca89e442b6362dff6/users/d7875829b50540cb950fd805d969baa2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.008165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc9b0ddd863459ca89e442b6362dff6, user_id=d7875829b50540cb950fd805d969baa2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:47.011715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:47.038377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1922/3808] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:46 2022] PUT /identity/v3/projects/6cc9b0ddd863459ca89e442b6362dff6/users/d7875829b50540cb950fd805d969baa2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:47.052258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:47.052258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:47.052258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.106071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] MFA Rules not processed for user `d7875829b50540cb950fd805d969baa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:47.108395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:47.263171 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1887/3809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:18:47.264581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:47.393343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4d338-3f1a-4210-8754-2a9869af1bdd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:47.400489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:47.401414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:47.401764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:47.401972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.403222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:47.406940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:47.466269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:47.486044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1923/3810] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:18:47 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:47.492139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:47.509537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f90b-095f-4695-970f-0a24b6c40255 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:47.654676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:47.655604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:47.660472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:47.662169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.663907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:47.671975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:47.702458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:47.737233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1888/3811] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:18:47 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:18:47.742649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:47.771778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8618550-063c-4ff8-b54a-2d741a82caf4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:47.793964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:47.796331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:47.796741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:47.797231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.798209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:47.804297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:47.825634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1924/3812] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:47.832109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:47.853074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5f8cf-8f10-4ea8-bb39-8b6b9f4ddb8c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:47.862360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:47.863884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:47.864279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:47.864667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] PATH_INFO: `/v3/projects/1265442a420448dca3dd8bb3ebd30b33/users/9895b06667a7463297c8151854551ca1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:47.889556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1265442a420448dca3dd8bb3ebd30b33, user_id=9895b06667a7463297c8151854551ca1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:47.896913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:47.926829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:47.957884 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1889/3813] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:47 2022] PUT /identity/v3/projects/1265442a420448dca3dd8bb3ebd30b33/users/9895b06667a7463297c8151854551ca1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:47.991433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7e29e-9f69-4db5-b49d-205d053055d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:48.169831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:48.170699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:48.171084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:48.171483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:48.172479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:48.174273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2978-bfbe-4cf0-b571-5affa4af6381 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:48.188041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1925/3814] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:18:48.192637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:48.235384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c03df8-f8e3-4b10-9b53-83a29bd87f0a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:48.246973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:48.249570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:48.250323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:48.250814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] PATH_INFO: `/v3/projects/1265442a420448dca3dd8bb3ebd30b33/users/9895b06667a7463297c8151854551ca1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:48.254209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1265442a420448dca3dd8bb3ebd30b33, user_id=9895b06667a7463297c8151854551ca1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:48.263081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8e8c9-63b9-47be-9716-74bf61f38872 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:48.298279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1890/3815] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:18:48 2022] PUT /identity/v3/projects/1265442a420448dca3dd8bb3ebd30b33/users/9895b06667a7463297c8151854551ca1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:18:48.321454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:48.322005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:48.322467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:48.411176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] MFA Rules not processed for user `9895b06667a7463297c8151854551ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:48.413257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:48.539733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1926/3816] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:48.559808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:48.565541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:48.566678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:48.618499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] MFA Rules not processed for user `d7875829b50540cb950fd805d969baa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:48.636816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:48.806612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1891/3817] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:49.243499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:49.244963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:49.430394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:18:49.495184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5a089-2c6c-4f61-8c54-1410f5f0582b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:49.515065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:49.516668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:49.517373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:49.517872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:49.558031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:49.561663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5d756-8d54-48da-ac80-97b01f601f85 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:49.606659 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1927/3818] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:53.327792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:53.334534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:53.670622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e39c2-58e3-449a-90ed-f14005d5d3f7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:53.683238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:53.684431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:53.684961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:53.685773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:53.689631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:53.723858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:53.745907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:53.792521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1892/3819] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:18:55.009699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:55.011110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:55.011869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:55.096955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:18:55.098816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:55.360026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1928/3820] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:18:58.511776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:18:58.527369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbede04-7d10-495a-bb52-c9c3100cc256 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:18:58.559438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:18:58.562326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:18:58.563946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:18:58.564367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:18:58.572599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:18:58.623409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:18:58.629296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f038c-6da4-4250-9e4b-ab53ea034287 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:18:58.670769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1893/3821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:02.603980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:02.605952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:02.928124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:02.928659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:02.928659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:02.963965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:02.966030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:03.015213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dd0a8-50e9-4e95-a6f3-bc744063241f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:03.018967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:03.021879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:03.022661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:03.023030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:03.023543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] PATH_INFO: `/v3/users/16bd1444400e47de84f0c1c15cc42c66` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:03.025074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16bd1444400e47de84f0c1c15cc42c66)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:03.028069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:03.165810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16bd1444400e47de84f0c1c15cc42c66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.179412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16bd1444400e47de84f0c1c15cc42c66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.180589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16bd1444400e47de84f0c1c15cc42c66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.181067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1894/3822] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:03.221021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:03.222999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16bd1444400e47de84f0c1c15cc42c66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.225133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16bd1444400e47de84f0c1c15cc42c66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.226923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:03.237435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:03.283270 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1929/3823] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:02 2022] DELETE /identity/v3/users/16bd1444400e47de84f0c1c15cc42c66 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:03.351689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997a5e8-4400-4268-8cd6-d677f745dea2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:03.439759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:03.441286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:03.441557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:03.441820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:03.445997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:03.593827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:03.595552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:03.639336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1895/3824] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:19:03.642735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:03.646731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:03.781747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b22e6-3f6a-41c2-ada2-1e97da543fc7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:03.795843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:03.798509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:03.799234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:03.799848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] PATH_INFO: `/v3/projects/5daf1d849d91426d94f338ed22af5f9a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:03.802278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5daf1d849d91426d94f338ed22af5f9a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:03.805712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:03.976959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5daf1d849d91426d94f338ed22af5f9a', 'request_id': 'req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:03.998371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5daf1d849d91426d94f338ed22af5f9a', 'request_id': 'req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.013942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5daf1d849d91426d94f338ed22af5f9a', 'request_id': 'req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.033214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] The token cache is being invalidate because project 5daf1d849d91426d94f338ed22af5f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:04.033753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.036673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.041942 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1930/3825] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:03 2022] DELETE /identity/v3/projects/5daf1d849d91426d94f338ed22af5f9a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:04.043130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:04.060547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccbb3f-2a76-4482-b0d1-86aa68661644 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:04.067838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:04.150659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:04.151738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:04.155371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:04.156010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] PATH_INFO: `/v3/users/d0b9fb48d25e4d31bf1138664582b086` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:04.157716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b9fb48d25e4d31bf1138664582b086)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:04.160696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:04.237827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b9fb48d25e4d31bf1138664582b086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.238804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b9fb48d25e4d31bf1138664582b086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.257053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b9fb48d25e4d31bf1138664582b086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.258084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b9fb48d25e4d31bf1138664582b086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.270874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33f1bd8d-58d0-459c-a0d2-de00427a1ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b9fb48d25e4d31bf1138664582b086'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.318426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1896/3826] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:04 2022] DELETE /identity/v3/users/d0b9fb48d25e4d31bf1138664582b086 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:19:04.446673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:04.448110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:04.462990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ef82-4b68-4681-a2ff-04b85dd8ed00 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:04.583547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:04.584346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:04.584457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:04.584802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] PATH_INFO: `/v3/users/d267b3088ea24884a74772ad1367f0c4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:04.585911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d267b3088ea24884a74772ad1367f0c4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:04.587813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:04.624166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:04.698845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd267b3088ea24884a74772ad1367f0c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.714785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd267b3088ea24884a74772ad1367f0c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.717418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd267b3088ea24884a74772ad1367f0c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.734796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd267b3088ea24884a74772ad1367f0c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.735876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd267b3088ea24884a74772ad1367f0c4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:04.814364 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1931/3827] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:04 2022] DELETE /identity/v3/users/d267b3088ea24884a74772ad1367f0c4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:04.818501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:04.818816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:04.819337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:04.879923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:04.881651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:04.904228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:04.905898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:05.042527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47944758-6afb-4953-863c-85619c348d10 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:05.046011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1897/3828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:05.048400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:05.050066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.050066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.050507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] PATH_INFO: `/v3/projects/788b1946c0ce47939d50754a85309241` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.051619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=788b1946c0ce47939d50754a85309241)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:05.054703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:05.074137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:05.079242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:05.153347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788b1946c0ce47939d50754a85309241', 'request_id': 'req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:05.160492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:05.175135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788b1946c0ce47939d50754a85309241', 'request_id': 'req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:05.205901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788b1946c0ce47939d50754a85309241', 'request_id': 'req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:05.237784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] The token cache is being invalidate because project 788b1946c0ce47939d50754a85309241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:05.239202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:05.240205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cc0091d4-9a81-432e-8b5f-df198e0d7b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:05.246104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1932/3829] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:04 2022] DELETE /identity/v3/projects/788b1946c0ce47939d50754a85309241 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:05.249527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1e19-fa67-442c-af8b-78c54fc673fd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.250077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1e19-fa67-442c-af8b-78c54fc673fd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.250512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb1e19-fa67-442c-af8b-78c54fc673fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.291600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8a869-4558-4bbb-a41d-30a5628b62c7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:05.336641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d0fb1e19-fa67-442c-af8b-78c54fc673fd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:05.338253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d0fb1e19-fa67-442c-af8b-78c54fc673fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:05.345124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:05.434985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:05.436362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.452745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.453494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.456694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:05.509134 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1933/3830] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:05.513698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.514085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.514398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.575193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:05.578513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:05.601761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1934/3831] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:05.607276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:05.607588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:05.608809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:05.628857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83773-e97c-42ba-a05c-e9a02ffe84f3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:05.633128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1898/3832] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:05.636464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:05.637675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.638121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.638575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.639430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:05.639901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:05.642733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:05.702700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1935/3833] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:05.704082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:05.720278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb360370-58b1-4e69-bb7c-003507e3698c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:05.734663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:05.737161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:05.749722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:05.750147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:05.750844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:05.752866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:05.840532 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1899/3834] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:05 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:05.841393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:05.884784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8052-6062-45ed-b2db-0456a4e091d3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.023650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.024413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.024686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.027088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.028184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.032613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.083126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1936/3835] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:05 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:06.089713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:06.119017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e03ad3-5269-45b9-9738-b03193e36c7a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.144369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.151340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.153484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.153934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.159527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.164401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.184703 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1900/3836] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:19:06.195145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:06.225946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46368a2-2d9c-42fa-aa1b-eacdf223f205 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.232538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.234120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.234888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.235229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.235951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.238358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df3122-8efc-40c9-af95-c185a7c4d11d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.253735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1937/3837] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:06.258156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:06.269808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9bc3d-257f-4c1b-9de2-78ad71ea8e01 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.277330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.278961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.279837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.280603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] PATH_INFO: `/v3/projects/eee97a09ef2f48b694ad82e7f5a93d5a/users/4b9a32a405e24a27bc8088db06d9d6fe/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.320979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee97a09ef2f48b694ad82e7f5a93d5a, user_id=4b9a32a405e24a27bc8088db06d9d6fe, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.326172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.350714 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1901/3838] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:06 2022] PUT /identity/v3/projects/eee97a09ef2f48b694ad82e7f5a93d5a/users/4b9a32a405e24a27bc8088db06d9d6fe/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:19:06.356541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.358397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.359760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.423569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:06.423569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:06.514680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:06.516434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:06.548697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1938/3839] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:06.570143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:06.572215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:06.598970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:06.631555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:06.685263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191f27-7297-467c-a634-74b4ddfb65eb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.695769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.696666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.696813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.697347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] PATH_INFO: `/v3/projects/763d85495b574efd930f2dda9ab8bcaf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.699702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763d85495b574efd930f2dda9ab8bcaf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.703411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.718919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc743b5-ac0f-4870-a6ef-2669a56a3302 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:06.734032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:06.735235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.735583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.735914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.756319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:06.758015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2375e-fd2f-4841-9988-d77021a32ecf service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:06.788689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763d85495b574efd930f2dda9ab8bcaf', 'request_id': 'req-0198de54-1b00-482e-9a60-e32ee3e95320'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:06.801812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763d85495b574efd930f2dda9ab8bcaf', 'request_id': 'req-0198de54-1b00-482e-9a60-e32ee3e95320'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:06.811232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1939/3840] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:19:06.813327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763d85495b574efd930f2dda9ab8bcaf', 'request_id': 'req-0198de54-1b00-482e-9a60-e32ee3e95320'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:06.847608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] The token cache is being invalidate because project 763d85495b574efd930f2dda9ab8bcaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:06.849087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:06.850567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0198de54-1b00-482e-9a60-e32ee3e95320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:06.855741 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1902/3841] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:06 2022] DELETE /identity/v3/projects/763d85495b574efd930f2dda9ab8bcaf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:19:06.860879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:06.861226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:06.861465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:06.935444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:06.942489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:07.120851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1940/3842] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:07.125771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.126438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.126438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.185706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:07.193459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:07.226312 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1903/3843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:07.227532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:07.243704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1eac9-2a06-46e5-bd97-3ec328940291 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:07.260622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:07.261319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.261608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.261874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.262540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:07.262836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:07.264834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:07.314083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1941/3844] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:07.317459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:07.341340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f340e30-61cf-4b9a-95a0-0fd484ac1bec None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:07.356278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:07.357281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.357733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.358191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.364733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:07.369277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:07.501858 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1904/3845] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:07.506408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:07.524116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c240d-9cda-48f1-b016-1619708311ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:07.739712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:07.741410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.741983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.742594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.744260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:07.750899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:07.826547 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1942/3846] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:07 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:19:07.827627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:07.851082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa02b1-b837-4967-8020-a014c7751fdb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:07.877051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:07.880306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.881180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.881899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.883288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:07.887530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:07.933778 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1905/3847] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:07.939787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:07.958859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f1cf-92f0-40c7-82f1-3351eb8d9c49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:07.966514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:07.968726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:07.969159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:07.969342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:07.970065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:07.974962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc2c0-67fa-48f6-ba8f-247a6dd1bc08 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:07.994264 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1943/3848] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:08.000912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:08.056124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfafef-f485-413f-889f-5c0c68083881 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:08.079570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:08.082464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:08.082954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:08.083437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] PATH_INFO: `/v3/projects/64c7c178204d49f68bb32756211cb17f/users/7419ed77ab464184b7f88cd99c544a05/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:08.114202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c7c178204d49f68bb32756211cb17f, user_id=7419ed77ab464184b7f88cd99c544a05, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:08.119999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:08.195016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1906/3849] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:07 2022] PUT /identity/v3/projects/64c7c178204d49f68bb32756211cb17f/users/7419ed77ab464184b7f88cd99c544a05/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:08.219158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:08.220109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:08.220911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:08.303814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] MFA Rules not processed for user `7419ed77ab464184b7f88cd99c544a05`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:08.306099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:08.317665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:08.458542 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1944/3850] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:08.517897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:08.525847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:08.655208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750244-78ad-4bc7-a821-d3a81a61acb0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:08.662265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:08.663363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:08.663845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:08.664388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:08.721141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:08.726730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3529be-92a7-4efe-a58e-9b497b170332 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:08.737571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:08.756625 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1907/3851] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:09.691449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:09.823356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a4ca9-0018-4b9d-ba18-0a83f00dd16a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:09.834321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:09.835106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:09.835393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:09.836908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] PATH_INFO: `/v3/users/7419ed77ab464184b7f88cd99c544a05` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:09.841657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7419ed77ab464184b7f88cd99c544a05)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:09.843942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:09.962595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7419ed77ab464184b7f88cd99c544a05'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:09.980024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7419ed77ab464184b7f88cd99c544a05'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:09.981456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7419ed77ab464184b7f88cd99c544a05'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:10.004760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7419ed77ab464184b7f88cd99c544a05'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:10.007247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7419ed77ab464184b7f88cd99c544a05'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:10.078206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1945/3852] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:09 2022] DELETE /identity/v3/users/7419ed77ab464184b7f88cd99c544a05 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:10.087267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32df6d-662a-4c4d-9f17-48da1cbe2bde None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:10.087768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32df6d-662a-4c4d-9f17-48da1cbe2bde None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:10.088188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32df6d-662a-4c4d-9f17-48da1cbe2bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:10.181621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1c32df6d-662a-4c4d-9f17-48da1cbe2bde None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:10.188864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c32df6d-662a-4c4d-9f17-48da1cbe2bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:10.532273 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1908/3853] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:10.870708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:10.880262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:11.081683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:11.239788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cddf3c4-4f2b-475a-a002-85bec9fdadaf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:11.265660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:11.266303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:11.266600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:11.266868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:11.304437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:11.306068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:11.343756 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1946/3854] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:13.729620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ce34d-ae21-4cb3-a51b-1798a00a31d4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:13.730144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ce34d-ae21-4cb3-a51b-1798a00a31d4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:13.730144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ce34d-ae21-4cb3-a51b-1798a00a31d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:13.778704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c9ce34d-ae21-4cb3-a51b-1798a00a31d4 None None] MFA Rules not processed for user `7d7104a95b73405ab66140df742af14f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:13.779887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c9ce34d-ae21-4cb3-a51b-1798a00a31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:13.912116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1909/3855] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:13.923264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:13.926596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:13.983999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adb90-e545-41f6-aa5d-4f932840288f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:14.009879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:14.010698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.011056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.011945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] PATH_INFO: `/v3/projects/64c7c178204d49f68bb32756211cb17f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.015174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c7c178204d49f68bb32756211cb17f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:14.020344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:14.148276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c7c178204d49f68bb32756211cb17f', 'request_id': 'req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:14.161596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c7c178204d49f68bb32756211cb17f', 'request_id': 'req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:14.173413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c7c178204d49f68bb32756211cb17f', 'request_id': 'req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:14.205678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] The token cache is being invalidate because project 64c7c178204d49f68bb32756211cb17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:14.206274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:14.207480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daf33f84-9a9f-4cf5-9c96-0ac850e5330a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:14.211085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1947/3856] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:13 2022] DELETE /identity/v3/projects/64c7c178204d49f68bb32756211cb17f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:14.216827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.218481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.218481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.263515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:14.265044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:14.422551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1910/3857] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:14.431768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.432050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.432459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.489245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:14.490829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:14.511652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1948/3858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:14.517406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:14.528064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f271c4-7dbd-4c1a-8357-4381ca18606a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:14.543152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:14.543786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.544061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.544326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.544984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:14.545303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:14.546951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:14.588210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1911/3859] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:14.592859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:14.612374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60afb11-5f47-4758-8894-fde199bb1d99 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:14.632644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:14.633363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.633684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.634060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.634930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:14.650049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:14.711126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1949/3860] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:14 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:14.711839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:14.723567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75a8d-f793-4dde-868a-c6adadfd4caf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:14.812310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:14.889748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:14.890504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:14.890813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:14.891105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:14.891787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:14.899098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:14.966510 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1912/3861] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:14 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:14.968292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:14.991508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f07d1-31db-45ff-963b-c6b06dcdd4ac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:15.003016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:15.003732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:15.004013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:15.004286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:15.004949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:15.006937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:15.045562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:15.057548 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1950/3862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:15.063628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6cc93-83bd-4148-a257-0029e0df90fa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:15.077879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:15.079038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:15.079544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:15.080039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:15.081826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:15.083902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa0ec2-c3db-4698-818b-3dfabc49558d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:15.113737 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1913/3863] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:19:15.114772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:15.141364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db32e-43a1-40db-9389-830aaddee6cc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:15.154691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:15.156670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:15.158851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:15.159214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] PATH_INFO: `/v3/projects/ce81a7dc3d724efeb54658c02a708a66/users/317b67994dc74376b2099fb688a870b9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:15.201107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce81a7dc3d724efeb54658c02a708a66, user_id=317b67994dc74376b2099fb688a870b9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:15.208128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:15.237991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1951/3864] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:15 2022] PUT /identity/v3/projects/ce81a7dc3d724efeb54658c02a708a66/users/317b67994dc74376b2099fb688a870b9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:19:15.256676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:15.257381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:15.257772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:15.300895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] MFA Rules not processed for user `317b67994dc74376b2099fb688a870b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:15.302496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:15.494354 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1914/3865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:15.508516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:15.510594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:15.714318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:15.725529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d707e4d-f26c-469f-978c-6998b784e0eb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:15.746003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:15.748793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:15.748793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:15.749397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:15.770853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:15.773615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ff92e-9016-4309-8c1c-ddb48f088143 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:15.795575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1952/3866] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:19:15.859919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:16.073646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c807ebc-e884-4861-b5a9-813fb0615e73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:16.081917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:16.085813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:16.086218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:16.086609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] PATH_INFO: `/v3/users/317b67994dc74376b2099fb688a870b9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:16.088430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317b67994dc74376b2099fb688a870b9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:16.090562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:16.189783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:16.196226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317b67994dc74376b2099fb688a870b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:16.198802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317b67994dc74376b2099fb688a870b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:16.222013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317b67994dc74376b2099fb688a870b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:16.224229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317b67994dc74376b2099fb688a870b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:16.239496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317b67994dc74376b2099fb688a870b9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:16.275406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:16.276339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:16.276772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:16.287231 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1915/3867] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:15 2022] DELETE /identity/v3/users/317b67994dc74376b2099fb688a870b9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:16.301280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:16.302979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:16.457557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1953/3868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:16.468568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:16.470451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:16.621339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b4d8-8150-4a4b-b4de-0d5753cb56a1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:16.634926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:16.635624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:16.635904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:16.636175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:16.655875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:16.657392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687084-8dbf-4e08-aa12-2973db91d89b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:16.686675 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1916/3869] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:18.201920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:18.203445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:18.236233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e27ed6-e8c4-4ad2-9250-60e5e801840b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:18.256466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:18.259850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:18.262654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:18.265796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] PATH_INFO: `/v3/projects/ce81a7dc3d724efeb54658c02a708a66` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:18.272542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce81a7dc3d724efeb54658c02a708a66)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:18.285420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:18.420306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce81a7dc3d724efeb54658c02a708a66', 'request_id': 'req-aadd6236-77ac-48f9-91c4-ba34a3f808d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:18.429624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce81a7dc3d724efeb54658c02a708a66', 'request_id': 'req-aadd6236-77ac-48f9-91c4-ba34a3f808d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:18.437781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce81a7dc3d724efeb54658c02a708a66', 'request_id': 'req-aadd6236-77ac-48f9-91c4-ba34a3f808d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:18.466780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] The token cache is being invalidate because project ce81a7dc3d724efeb54658c02a708a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:18.467811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:18.468767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aadd6236-77ac-48f9-91c4-ba34a3f808d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:18.470632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1954/3870] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:18 2022] DELETE /identity/v3/projects/ce81a7dc3d724efeb54658c02a708a66 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:18.476596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:18.477511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:18.477799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:18.550947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:18.555685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:18.778421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:18.779302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:18.779753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:18.789687 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1917/3871] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:18.815683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:18.818288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:18.834435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:18.845272 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1955/3872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:18.846658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f375b15-745d-4da1-a0aa-c17840d8541a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:18.852410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:18.853057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:18.853335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:18.853781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:18.854438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:18.854734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:18.856763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:18.876751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:18.884374 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1918/3873] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:18.889569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90de7d-9537-4d82-8e93-46ee581e884d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:18.895511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:18.896689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:18.897097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:18.897545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:18.898706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:18.901648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:18.947415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1956/3874] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:18 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:18.952844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:18.977978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6651-3725-4d2c-82f2-2c547cc390aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:19.050776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:19.078161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:19.078693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:19.079007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:19.079249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:19.079858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:19.082893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:19.120037 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1919/3875] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:18 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:19.122631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:19.170219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbc5a9-6fef-4bfb-aa2e-0bf46747d1e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:19.199229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:19.199939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:19.200663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:19.200663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:19.201160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:19.209998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:19.232660 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1957/3876] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:19.237773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:19.253344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f98446-7d43-4bc4-ab56-e5c11acc517b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:19.259926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:19.260645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:19.260921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:19.261268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:19.262091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:19.264572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7087951-e0b8-450d-b1e5-f6d60d8aaab6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:19.287794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:19.291065 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1920/3877] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:19.304972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cfc4c-937f-4e27-9c5e-8872761ab61a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:19.313047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:19.314502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:19.315550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:19.316342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] PATH_INFO: `/v3/projects/cfdea28432344e73bd9f9532fadf22a3/users/d6c69436c1974d05b5e9fc0c6f972804/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:19.346051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdea28432344e73bd9f9532fadf22a3, user_id=d6c69436c1974d05b5e9fc0c6f972804, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:19.350328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:19.387521 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1958/3878] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:19 2022] PUT /identity/v3/projects/cfdea28432344e73bd9f9532fadf22a3/users/d6c69436c1974d05b5e9fc0c6f972804/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:19:19.395624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:19.396024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:19.396264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:19.445911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] MFA Rules not processed for user `d6c69436c1974d05b5e9fc0c6f972804`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:19.447301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:19.614899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1921/3879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:19.663422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:19.666967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:19.808855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:19.822503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:19.824627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:20.014819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4284-5f30-423c-9e73-4d77390600bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:20.026721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:20.029249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:20.030045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:20.030432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:20.052590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:20.055785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de1a29-a1e7-4e99-8b66-2cb5de39ed05 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:20.092886 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1959/3880] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:19:20.121229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702344-6d20-4e85-951b-421c044fc3cf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:20.131003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:20.131440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:20.133242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:20.133242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:20.139512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:20.282897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:20.338628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:20.341752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010f1be-b114-4139-93cd-c202c69ef0d3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:20.378748 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1922/3881] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:19:20.428161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b23b-ae49-400e-9dda-c9de950f425a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:20.429307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b23b-ae49-400e-9dda-c9de950f425a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:20.429876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7b23b-ae49-400e-9dda-c9de950f425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:20.500940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-87d7b23b-ae49-400e-9dda-c9de950f425a None None] MFA Rules not processed for user `d7875829b50540cb950fd805d969baa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:20.508748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87d7b23b-ae49-400e-9dda-c9de950f425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:20.711908 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1960/3882] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:21.139474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:21.141437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:21.141941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:21.217950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] MFA Rules not processed for user `4b9a32a405e24a27bc8088db06d9d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:21.219394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:21.366952 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1923/3883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:21.382519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:21.382905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:21.384055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:21.438290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] MFA Rules not processed for user `4b9a32a405e24a27bc8088db06d9d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:21.439551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:21.460822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1961/3884] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:21.735325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:21.763111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3037a94-3d34-4619-a9e5-869dc558ed39 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:21.790374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:21.791171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:21.791342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:21.791512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:21.810821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:21.814024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:21.829255 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1924/3885] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:30.993780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:31.021755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491143ac-f2bd-4ed4-8494-04bff104c919 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:31.029754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:31.030647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:31.031109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:31.031691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:31.034397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:31.201844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:31.203318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:31.214842 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1962/3886] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:31.822349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=47 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:37.963299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:37.968158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:38.004967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0713e-d8bd-44f1-9110-5c07489a2f88 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:38.014224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:38.020107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:38.020107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:38.020107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] PATH_INFO: `/v3/users/466ba2f759a34d11b6dd8887bb49554d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:38.020769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466ba2f759a34d11b6dd8887bb49554d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:38.025200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:38.136154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466ba2f759a34d11b6dd8887bb49554d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:38.137404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466ba2f759a34d11b6dd8887bb49554d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:38.152708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466ba2f759a34d11b6dd8887bb49554d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:38.153805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466ba2f759a34d11b6dd8887bb49554d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:38.170190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466ba2f759a34d11b6dd8887bb49554d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:38.216152 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1925/3887] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:37 2022] DELETE /identity/v3/users/466ba2f759a34d11b6dd8887bb49554d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:38.968417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:39.000886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cd000-1d42-4d7d-9ec0-9c0935aa5cd9 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:39.123214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:39.135605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:39.136936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:39.137715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:39.138374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:39.141623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:39.353114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:39.355810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:39.406150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:39.408826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57925dd1-932d-4be5-9d58-108f40359b7e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:39.459555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1963/3888] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:39.669905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad52c5-4535-4d6b-aba9-2f1e7d8e59f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:39.703246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:39.708675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:39.709745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:39.710034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] PATH_INFO: `/v3/projects/09f13c8b99d641b0b30333ec27f72b9a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:39.716412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f13c8b99d641b0b30333ec27f72b9a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:39.724930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:39.992368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f13c8b99d641b0b30333ec27f72b9a', 'request_id': 'req-be1f046c-4825-45c2-8bd0-3740cf076aa9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:40.009604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f13c8b99d641b0b30333ec27f72b9a', 'request_id': 'req-be1f046c-4825-45c2-8bd0-3740cf076aa9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:40.019944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f13c8b99d641b0b30333ec27f72b9a', 'request_id': 'req-be1f046c-4825-45c2-8bd0-3740cf076aa9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:40.049643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] The token cache is being invalidate because project 09f13c8b99d641b0b30333ec27f72b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:40.050092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:40.053069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-be1f046c-4825-45c2-8bd0-3740cf076aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:40.056406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1926/3889] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:39 2022] DELETE /identity/v3/projects/09f13c8b99d641b0b30333ec27f72b9a => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:40.063747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41148771-e208-4974-8478-6fed119a8d46 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.065348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41148771-e208-4974-8478-6fed119a8d46 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.065892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41148771-e208-4974-8478-6fed119a8d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.104596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-41148771-e208-4974-8478-6fed119a8d46 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:40.108411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-41148771-e208-4974-8478-6fed119a8d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:40.249971 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1964/3890] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:40.263495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.265051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.265835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.280780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:40.314137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:40.316741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:40.347161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1927/3891] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:40.350001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41148771-e208-4974-8478-6fed119a8d46 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:40.377249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41148771-e208-4974-8478-6fed119a8d46 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:40.387546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:40.388192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.388507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.388783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.389580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:40.390168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:40.392608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:40.418138 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1965/3892] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:40.423925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:40.441245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55fa77-f4b8-466b-a74b-a887d03bb771 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:40.454894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:40.455957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.456302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.456577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.457306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:40.459322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:40.570894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1928/3893] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:40 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:19:40.581974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:40.620397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c2dd-ba2e-4322-96aa-f66bdef86fca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:40.745431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:40.746555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.747163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.748210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.748758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:40.750928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:40.806879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1966/3894] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:40 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:40.813995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:40.837967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c67ab-deff-42ab-86a2-5b641024a6e1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:40.849568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:40.851412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.852519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.853508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.868164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:40.874520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:40.909997 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1929/3895] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:40.914029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:40.942606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248ae50-f2d9-4eff-b3b4-6e801a508ae3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:40.960471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:40.967855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:40.969082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:40.971563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:40.972911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:40.976492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288c9a5-efdc-42a3-9eec-367fe514867f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:40.998359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1967/3896] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:41.005594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:41.025864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df287-04f1-404d-b544-cd9e5667ce6f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:41.035796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:41.037858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:41.038514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:41.039183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] PATH_INFO: `/v3/projects/31333817b5a74a6c9bb6cfcfb4ec940a/users/9d2663d26c42412c8acb3ded09320213/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:41.072359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31333817b5a74a6c9bb6cfcfb4ec940a, user_id=9d2663d26c42412c8acb3ded09320213, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:41.078474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:41.118039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1930/3897] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:41 2022] PUT /identity/v3/projects/31333817b5a74a6c9bb6cfcfb4ec940a/users/9d2663d26c42412c8acb3ded09320213/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:41.124387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518809-3edb-4004-a824-c715169b09ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:41.125053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518809-3edb-4004-a824-c715169b09ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:41.126078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518809-3edb-4004-a824-c715169b09ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:41.151737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:41.178653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ac518809-3edb-4004-a824-c715169b09ba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:41.181176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac518809-3edb-4004-a824-c715169b09ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:41.316287 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1968/3898] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:41.344751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:41.349726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:41.544607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5609-6a4c-4107-86c9-682298f4df6a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:41.545324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5609-6a4c-4107-86c9-682298f4df6a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:41.545893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5609-6a4c-4107-86c9-682298f4df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:41.578358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee0f5609-6a4c-4107-86c9-682298f4df6a None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:41.581868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee0f5609-6a4c-4107-86c9-682298f4df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:41.587291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05139-9037-48bf-a2a3-aad300ff6a19 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:41.596346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:41.597681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:41.597681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:41.599198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:41.634974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:41.644582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:41.663673 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1931/3899] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:41.745039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1969/3900] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:41.823020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:41.825950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:41.884802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c093f54-dc32-48f6-b27d-b9876228481a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:41.894074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:41.895264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:41.895784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:41.896272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] PATH_INFO: `/v3/users/d6c69436c1974d05b5e9fc0c6f972804` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:41.898189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c69436c1974d05b5e9fc0c6f972804)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:41.901240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:42.047667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c69436c1974d05b5e9fc0c6f972804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:42.050387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c69436c1974d05b5e9fc0c6f972804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:42.084524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c69436c1974d05b5e9fc0c6f972804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:42.085965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c69436c1974d05b5e9fc0c6f972804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:42.099548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c69436c1974d05b5e9fc0c6f972804'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:42.147756 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1932/3901] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:41 2022] DELETE /identity/v3/users/d6c69436c1974d05b5e9fc0c6f972804 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:42.154737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:42.155621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:42.155621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:42.238277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:42.240531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:42.438505 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1970/3902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:42.507419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:42.511650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:42.528830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:42.700053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e3659-06d0-4147-91e3-cae9e87cf7f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:42.707300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:42.708683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:42.709371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:42.709965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:42.732608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:42.738287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531dd18-c25d-4d2b-a227-24a1260346c8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:42.765539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1933/3903] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:43.155741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:43.158207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:43.182556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe709ce-4b65-4a16-ae02-a8f6c214a608 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:43.201410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:43.202301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:43.202659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:43.203056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] PATH_INFO: `/v3/projects/cfdea28432344e73bd9f9532fadf22a3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:43.204976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdea28432344e73bd9f9532fadf22a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:43.208095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:43.383098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:43.388695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdea28432344e73bd9f9532fadf22a3', 'request_id': 'req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:43.404342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdea28432344e73bd9f9532fadf22a3', 'request_id': 'req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:43.420945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdea28432344e73bd9f9532fadf22a3', 'request_id': 'req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:43.446150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] The token cache is being invalidate because project cfdea28432344e73bd9f9532fadf22a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:43.446739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:43.451288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1a8c8e84-5c4d-4b4e-89bf-b373ca0a2819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:43.453989 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1971/3904] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:43 2022] DELETE /identity/v3/projects/cfdea28432344e73bd9f9532fadf22a3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:43.459663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:43.460345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:43.460841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:43.519185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:43.522623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:43.683679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1934/3905] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:43.694980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:43.695591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:43.696008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:43.727210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:43.728841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:43.753345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1972/3906] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:43.754711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:43.768357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b480a04-2dbf-4483-8d54-34a63c2eea8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:43.794776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:43.797385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:43.798646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:43.799156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:43.800725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:43.809334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:43.811490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:43.854126 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1935/3907] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:19:43.861288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:43.882781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b3326-5ba7-433f-8595-7a4b68599b57 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:43.895613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:43.897539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:43.898431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:43.899127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:43.900887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:43.908618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.002582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:44.003838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1973/3908] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:43 2022] POST /identity/v3/projects => generated 359 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:19:44.022914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5539f-91fd-461f-a94b-54952c3b8cf1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:44.153113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:44.153723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.154039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.154499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.154911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:44.156918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.225892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1936/3909] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:44 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:19:44.229826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:44.255209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc4e72-43cc-4ff5-b1d3-2883e15dc0b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:44.262174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:44.263408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.263813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.264357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.265094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:44.267464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.285142 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1974/3910] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:44.286022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:44.296778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219699f-5a5d-4983-ad7c-ba05b372d003 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:44.303420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:44.304048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.304372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.304653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.305390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:44.307007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c330c-2fd8-47e9-8e1e-26c569a4a052 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.341136 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1937/3911] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:19:44.346282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:44.357826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50211c-4528-4930-bd0d-119111eb8f66 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:44.364499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:44.365223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.365472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.365743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] PATH_INFO: `/v3/projects/8cc4291792d840a4bf55d314b1cb252b/users/c74194c9bf05412a9d20f5963ab90616/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.389096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc4291792d840a4bf55d314b1cb252b, user_id=c74194c9bf05412a9d20f5963ab90616, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:44.395704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.429465 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1975/3912] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:44 2022] PUT /identity/v3/projects/8cc4291792d840a4bf55d314b1cb252b/users/c74194c9bf05412a9d20f5963ab90616/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:44.431409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.432182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.432594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.479701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:44.504402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] MFA Rules not processed for user `c74194c9bf05412a9d20f5963ab90616`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:44.507716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:44.685970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1938/3913] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:44.725528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:44.728182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:44.856276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8adeda-832a-4e9f-9152-1a7ef121a31d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:44.862696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:44.863499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:44.863922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:44.864399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:44.878751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:44.880207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:44.891454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1976/3914] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:51.111582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:51.114749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:51.319604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94330922-28c1-43ef-a086-29b9895f4e8b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:51.327154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:51.328247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:51.328908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:51.330375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] PATH_INFO: `/v3/users/f3bfadddfac24b69b7ae873925514f1a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:51.333257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bfadddfac24b69b7ae873925514f1a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:51.336646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:51.461975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bfadddfac24b69b7ae873925514f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:51.462900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bfadddfac24b69b7ae873925514f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:51.483971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bfadddfac24b69b7ae873925514f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:51.486194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bfadddfac24b69b7ae873925514f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:51.512970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0ecbdf3-ce1c-43f4-9054-6da4a6f94d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bfadddfac24b69b7ae873925514f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:51.587107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1939/3915] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:19:51 2022] DELETE /identity/v3/users/f3bfadddfac24b69b7ae873925514f1a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:52.276482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:52.292410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f775-5402-44e1-b23f-b75e72e1901f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:52.382599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:52.383675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:52.385798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:52.386987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] PATH_INFO: `/v3/projects/6e1607209530428891cc7f9b2406e42c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:52.388683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1607209530428891cc7f9b2406e42c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:52.392017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:52.420921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:52.562327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1607209530428891cc7f9b2406e42c', 'request_id': 'req-100aa1f8-eacc-4505-b0b8-6f3b00570d88'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:52.580553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1607209530428891cc7f9b2406e42c', 'request_id': 'req-100aa1f8-eacc-4505-b0b8-6f3b00570d88'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:52.597056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1607209530428891cc7f9b2406e42c', 'request_id': 'req-100aa1f8-eacc-4505-b0b8-6f3b00570d88'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:52.630966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] The token cache is being invalidate because project 6e1607209530428891cc7f9b2406e42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:19:52.631489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:52.633115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-100aa1f8-eacc-4505-b0b8-6f3b00570d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:19:52.636380 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1977/3916] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:19:52 2022] DELETE /identity/v3/projects/6e1607209530428891cc7f9b2406e42c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:52.641220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:52.642639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:52.642639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:52.708296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:52.710337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:52.789363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:52.922438 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1940/3917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:19:52.925282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:52.925282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:52.925282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:52.988273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:52.990142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:53.006898 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1978/3918] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:53.008220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:53.053655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b94c-51ad-4b96-b6b6-96bdf5ca358f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:53.123460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:53.124439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:53.124877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:53.125355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:53.136310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:19:53.137028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:53.147667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:53.222193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1941/3919] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:19:53.224270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:53.242862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97e789-030b-4a5b-9d54-654143f7d35f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:53.262032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:53.263072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:53.263552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:53.264285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:53.265500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:53.271182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:53.353128 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1979/3920] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:19:53 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:53.356659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:53.397944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd2145-726e-4b0d-ae76-b7f89366f6cf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:53.786323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:53.790309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:53.794672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:53.795184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:53.796029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:53.799108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:53.860082 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1942/3921] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:19:53 2022] POST /identity/v3/users => generated 290 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:19:53.867303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:53.893799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e40f3-2cb2-4498-9325-45ecdd9a421a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:53.903718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:53.904789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:53.905426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:53.905975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:53.907868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:53.910055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:53.934177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1980/3922] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:53.948733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:53.966309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dac399-0277-49d4-a5eb-21c3c1068749 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:53.989172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:53.990426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:53.990867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:53.991276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:53.992241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:53.994304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5e524-7794-4f26-8e06-be5160918dfd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:54.017486 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1943/3923] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:19:54.023731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:54.056663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1ceaf-cd57-4466-9e6a-16f37167d345 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:54.076709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:54.078122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:54.078677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:54.079706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] PATH_INFO: `/v3/projects/0d9f40afe6f84b4cacbaad47846895ca/users/3821d9ad75e04711bdf8a93567115d92/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:54.130351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9f40afe6f84b4cacbaad47846895ca, user_id=3821d9ad75e04711bdf8a93567115d92, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:54.138442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ef79-66d9-42fa-a5b7-8eea1244b142 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:54.192141 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1981/3924] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:19:54 2022] PUT /identity/v3/projects/0d9f40afe6f84b4cacbaad47846895ca/users/3821d9ad75e04711bdf8a93567115d92/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:19:54.206362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:54.206818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:54.207273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:54.324138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] MFA Rules not processed for user `3821d9ad75e04711bdf8a93567115d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:54.326114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:54.583838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1944/3925] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:54.590442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95a15-18b8-418a-8000-aad34afed542 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:54.591424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95a15-18b8-418a-8000-aad34afed542 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:54.592842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95a15-18b8-418a-8000-aad34afed542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:54.652318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-22a95a15-18b8-418a-8000-aad34afed542 None None] MFA Rules not processed for user `3821d9ad75e04711bdf8a93567115d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:54.658131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22a95a15-18b8-418a-8000-aad34afed542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:54.713422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1982/3926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:55.242871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:19:55.244598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:55.273558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:19:55.409630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f6bb-6537-42ce-bbad-5adf742cbb15 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:19:55.421290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:19:55.422984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:55.422984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:55.423232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:55.441973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:19:55.445412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192f48b-84cc-4ca4-a874-b770cc2f1c47 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:19:55.479621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1945/3927] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:19:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:19:58.989641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:58.990417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:58.990417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:59.012776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] MFA Rules not processed for user `7d7104a95b73405ab66140df742af14f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:59.015430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:19:59.157921 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1983/3928] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:19:59.737788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:19:59.738371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:19:59.738371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:19:59.789285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] MFA Rules not processed for user `9d2663d26c42412c8acb3ded09320213`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:19:59.808530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:00.011839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1946/3929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:19:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:00.285094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:00.306575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1cb7f-7083-4da4-883b-027e33325913 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:00.314462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:00.325802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:00.326250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:00.327041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:00.338137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:00.340406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31c146-fbbe-4ba5-ab53-4cef3e7d843c service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:00.355053 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1984/3930] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:07.374116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:07.379718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:07.545026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b94dc7-8e35-4c80-9c07-36263f07a187 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:07.554906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:07.557092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:07.559442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:07.560195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] PATH_INFO: `/v3/users/d7875829b50540cb950fd805d969baa2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:07.564983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7875829b50540cb950fd805d969baa2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:07.570027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:07.682374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:07.709145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7875829b50540cb950fd805d969baa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:07.710083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7875829b50540cb950fd805d969baa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:07.726540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7875829b50540cb950fd805d969baa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:07.727607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7875829b50540cb950fd805d969baa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:07.740280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7875829b50540cb950fd805d969baa2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:07.780006 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1947/3931] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:07 2022] DELETE /identity/v3/users/d7875829b50540cb950fd805d969baa2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:07.784449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05340f-0678-4a5a-9416-a240784f987f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:07.785288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05340f-0678-4a5a-9416-a240784f987f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:07.785288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05340f-0678-4a5a-9416-a240784f987f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:07.849603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4e05340f-0678-4a5a-9416-a240784f987f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:07.850855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4e05340f-0678-4a5a-9416-a240784f987f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:07.894130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:08.035531 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1985/3932] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:08.096935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:08.103229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:08.274927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee7975-e66a-41ea-b4b2-bb5eb33ae1a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:08.283756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:08.284188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:08.284463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:08.284733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:08.305476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:08.306935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:08.328067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1948/3933] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:09.591445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:09.591923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:09.592022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:09.630303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] MFA Rules not processed for user `9d2663d26c42412c8acb3ded09320213`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:09.631531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:09.786192 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1986/3934] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:10.088518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:10.090605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:10.126792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f0f5-0d46-4403-b8ff-97fb39b3a981 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:10.138274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:10.139571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:10.140553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:10.141524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] PATH_INFO: `/v3/projects/6cc9b0ddd863459ca89e442b6362dff6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:10.144767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc9b0ddd863459ca89e442b6362dff6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:10.148949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:10.258624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc9b0ddd863459ca89e442b6362dff6', 'request_id': 'req-ed234ceb-7c27-4acd-8299-041bcfb5deb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.306541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc9b0ddd863459ca89e442b6362dff6', 'request_id': 'req-ed234ceb-7c27-4acd-8299-041bcfb5deb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.337580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc9b0ddd863459ca89e442b6362dff6', 'request_id': 'req-ed234ceb-7c27-4acd-8299-041bcfb5deb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.387867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] The token cache is being invalidate because project 6cc9b0ddd863459ca89e442b6362dff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:10.388314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.389273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.399200 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1949/3935] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:10 2022] DELETE /identity/v3/projects/6cc9b0ddd863459ca89e442b6362dff6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:10.403532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:10.423659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efb89-3e58-4518-9443-56910c271dbc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:10.561083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:10.561816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:10.562098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:10.562405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] PATH_INFO: `/v3/users/9895b06667a7463297c8151854551ca1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:10.565852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9895b06667a7463297c8151854551ca1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:10.568669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:10.700077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9895b06667a7463297c8151854551ca1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.735818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9895b06667a7463297c8151854551ca1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.737145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9895b06667a7463297c8151854551ca1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.755013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9895b06667a7463297c8151854551ca1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.756264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-756d2509-4e54-491d-aafe-fa79175108d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9895b06667a7463297c8151854551ca1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:10.769037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:10.806225 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1987/3936] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:10 2022] DELETE /identity/v3/users/9895b06667a7463297c8151854551ca1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:11.600804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:11.602860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:11.639569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed234ceb-7c27-4acd-8299-041bcfb5deb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:11.774701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:11.941452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:11.942105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:11.942373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:11.945479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] PATH_INFO: `/v3/projects/1265442a420448dca3dd8bb3ebd30b33` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:11.946935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1265442a420448dca3dd8bb3ebd30b33)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:11.948864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:12.158662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1265442a420448dca3dd8bb3ebd30b33', 'request_id': 'req-f6a3fa41-aab3-4558-81d5-31d774996931'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:12.180141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1265442a420448dca3dd8bb3ebd30b33', 'request_id': 'req-f6a3fa41-aab3-4558-81d5-31d774996931'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:12.209576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1265442a420448dca3dd8bb3ebd30b33', 'request_id': 'req-f6a3fa41-aab3-4558-81d5-31d774996931'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:12.260883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] The token cache is being invalidate because project 1265442a420448dca3dd8bb3ebd30b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:12.263074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:12.273932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f6a3fa41-aab3-4558-81d5-31d774996931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:12.285637 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1950/3937] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:11 2022] DELETE /identity/v3/projects/1265442a420448dca3dd8bb3ebd30b33 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:12.291747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:12.292548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:12.292979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:12.362708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:12.365296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:12.568627 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1988/3938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:12.578538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:12.579298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:12.579962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:12.642406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:12.652961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:12.683913 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1951/3939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:12.689872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:12.713679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6471-c705-4354-84d3-027fa0105caf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:12.723285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:12.724644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:12.725292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:12.725943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:12.727451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:12.728123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:12.739471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:12.780255 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1989/3940] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:20:12.785994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:12.807450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124c06-0800-4100-a1f6-35aa1f37234c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:12.824985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:12.825693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:12.825971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:12.826238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:12.826939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:12.828932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:12.900099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1952/3941] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:12 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:12.904249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:12.926098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000c220-47b7-4995-a611-ff227dbde2dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:13.183361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:13.184915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:13.185641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:13.186718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:13.190362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:13.203777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:13.331379 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1990/3942] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:12 2022] POST /identity/v3/users => generated 297 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:13.335958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:13.381625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61118e-8c6c-4ee1-ada1-fca839229322 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:13.415527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:13.417464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:13.426545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:13.426979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:13.428417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:13.440069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:13.481054 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1953/3943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:13.485944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:13.513028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20226-3be3-4df3-a1d9-291d2645c284 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:13.533632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:13.535055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:13.535783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:13.536481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:13.538266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:13.547870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532318b-be5e-4c2b-bad7-55d0ec497dd3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:13.593449 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1991/3944] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:13.600027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:13.624912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9569af-29c8-4e51-9dc0-7a0e49db60c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:13.642288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:13.643233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:13.644247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:13.645260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] PATH_INFO: `/v3/projects/2137dcdad6004d0c8038949a765d259e/users/61cf7ea9fbe3487294ed6d52cfa2fec0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:13.681135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2137dcdad6004d0c8038949a765d259e, user_id=61cf7ea9fbe3487294ed6d52cfa2fec0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:13.686641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:13.719836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1954/3945] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:13 2022] PUT /identity/v3/projects/2137dcdad6004d0c8038949a765d259e/users/61cf7ea9fbe3487294ed6d52cfa2fec0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:13.741163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:13.741984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:13.742557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:13.919305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] MFA Rules not processed for user `61cf7ea9fbe3487294ed6d52cfa2fec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:13.920854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:14.145282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:14.227829 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1992/3946] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:14.232919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:14.415825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366eea5-4127-4b76-a360-16748947d187 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:14.426476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:14.426476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:14.426476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:14.426476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:14.426861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:14.426861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:14.436334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:14.479813 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1955/3947] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:14 2022] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:14.491728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:14.506964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba2cf-55ae-4656-bd8a-211ee23c0007 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:14.660691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:14.661871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:14.664554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:14.670462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:14.672630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:14.681560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:14.743657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1993/3948] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:14 2022] POST /identity/v3/users => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:14.747046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:14.758242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:14.760460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:14.771383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a85a9-40a4-42bb-be4e-2d11083dc296 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:14.781369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:14.783547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:14.783987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:14.784362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:14.787321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:14.787921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3d766-2096-442d-a29c-dd84f9a35d97 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:14.800381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:14.801804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:14.802862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:14.803139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:14.803413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] PATH_INFO: `/v3/users/3821d9ad75e04711bdf8a93567115d92` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:14.807451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3821d9ad75e04711bdf8a93567115d92)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:14.812067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:14.828422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1956/3949] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:20:14.833488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:14.835839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:14.854491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cf75-ab1e-4b1c-acfe-3c88716ca8d9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:14.863250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:14.864782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:14.865193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:14.865730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] PATH_INFO: `/v3/users/4b9a32a405e24a27bc8088db06d9d6fe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:14.867304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9a32a405e24a27bc8088db06d9d6fe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:14.869820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:14.912004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3821d9ad75e04711bdf8a93567115d92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.930760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3821d9ad75e04711bdf8a93567115d92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.931813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3821d9ad75e04711bdf8a93567115d92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.958548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3821d9ad75e04711bdf8a93567115d92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.960624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3821d9ad75e04711bdf8a93567115d92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.986702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9a32a405e24a27bc8088db06d9d6fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:14.988948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9a32a405e24a27bc8088db06d9d6fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.007870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1994/3950] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:14 2022] DELETE /identity/v3/users/3821d9ad75e04711bdf8a93567115d92 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:15.012216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9a32a405e24a27bc8088db06d9d6fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.013765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9a32a405e24a27bc8088db06d9d6fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.014309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:15.019325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.038326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-521ecb30-596e-4c1c-ad4d-96d78c0eb44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9a32a405e24a27bc8088db06d9d6fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.146159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1957/3951] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:14 2022] DELETE /identity/v3/users/4b9a32a405e24a27bc8088db06d9d6fe => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:15.146159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:15.148457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:15.150120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:15.232484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:15.236794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.249347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:15.337582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428444-8e94-4ec4-849d-acb884d21f67 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:15.461151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1958/3952] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:15.464361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:15.467959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.509444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aeba2-ea92-42c6-970a-19a9c5cd10cf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:15.532624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:15.533936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:15.534898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:15.537541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] PATH_INFO: `/v3/users/c74194c9bf05412a9d20f5963ab90616` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:15.541689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74194c9bf05412a9d20f5963ab90616)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:15.551761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:15.579486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:15.585230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:15.590445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:15.591507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] PATH_INFO: `/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c/users/a84f763a413440cca929a08e26074cd7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:15.633330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a4dbcfc6e46d3b2d6358bd168074c, user_id=a84f763a413440cca929a08e26074cd7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:15.643262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:15.675628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:15.679739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74194c9bf05412a9d20f5963ab90616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.680680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74194c9bf05412a9d20f5963ab90616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.691494 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1995/3953] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:15 2022] PUT /identity/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c/users/a84f763a413440cca929a08e26074cd7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:15.692764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:15.695450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.712948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74194c9bf05412a9d20f5963ab90616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.715229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74194c9bf05412a9d20f5963ab90616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.733751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74194c9bf05412a9d20f5963ab90616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:15.793093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1959/3954] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:15 2022] DELETE /identity/v3/users/c74194c9bf05412a9d20f5963ab90616 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:15.794127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:15.800789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.836072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee989ac-782c-4723-b840-58ab8c6a7ab4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:15.903995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41aac-9609-455c-84a8-021860cfc8b0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:15.912377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:15.913235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:15.913664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:15.913949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:15.914618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:15.916555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:15.948537 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1960/3955] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:15.948537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:15.951820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.964590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:15.965466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:15.965873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:15.966249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:15.968677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:15.992181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26c42a-fbd9-43aa-beb5-186e97493391 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:16.000794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:16.001904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:16.002572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.003733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.003733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] PATH_INFO: `/v3/projects/eee97a09ef2f48b694ad82e7f5a93d5a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.010597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee97a09ef2f48b694ad82e7f5a93d5a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:16.011800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d95f-0f54-42cb-8726-ac3d2a39c4dc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:16.013573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:16.057536 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1996/3956] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:16.059785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430837-d472-47f5-8f36-ac1d607f35d7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.060419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430837-d472-47f5-8f36-ac1d607f35d7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.061100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27430837-d472-47f5-8f36-ac1d607f35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.110474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-27430837-d472-47f5-8f36-ac1d607f35d7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:16.111812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27430837-d472-47f5-8f36-ac1d607f35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.144044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'request_id': 'req-7a05e546-c885-4746-8647-88d73b8053a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:16.169561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'request_id': 'req-7a05e546-c885-4746-8647-88d73b8053a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:16.192805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee97a09ef2f48b694ad82e7f5a93d5a', 'request_id': 'req-7a05e546-c885-4746-8647-88d73b8053a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:16.271313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:16.284164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] The token cache is being invalidate because project eee97a09ef2f48b694ad82e7f5a93d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:16.286052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:16.286052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:16.290265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1961/3957] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:15 2022] DELETE /identity/v3/projects/eee97a09ef2f48b694ad82e7f5a93d5a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:16.292773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:16.295986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.400239 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1997/3958] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:16.401807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.404142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.404450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.466627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:16.467882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.486294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:16.489744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1998/3959] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:16.490933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:16.497532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.569687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05e546-c885-4746-8647-88d73b8053a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:16.598277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:16.599448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.599959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.600450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] PATH_INFO: `/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c/users/a84f763a413440cca929a08e26074cd7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.603323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3a4dbcfc6e46d3b2d6358bd168074c, user_id=a84f763a413440cca929a08e26074cd7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:16.607278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4db609-2f58-483e-8eae-9773ea4cce8d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:16.642930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1962/3960] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:16 2022] PUT /identity/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c/users/a84f763a413440cca929a08e26074cd7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:16.645405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c37d3-df43-44a7-8042-c31865c34576 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.645934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c37d3-df43-44a7-8042-c31865c34576 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.646443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c37d3-df43-44a7-8042-c31865c34576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.664113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6b210-746b-4648-94b4-1d35d649788c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:16.700411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4f2c37d3-df43-44a7-8042-c31865c34576 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:16.705378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f2c37d3-df43-44a7-8042-c31865c34576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.827513 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1963/3961] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:16.830622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.831211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.834012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.840857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:16.842188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.843909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.846602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.868828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:16.870589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:16.886835 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 1999/3962] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:16.887862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:16.903051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d72842-36aa-4edc-9d43-39f4cdc75a11 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:16.913948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:16.914961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:16.915346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:16.915758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:16.917066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:16.917871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:16.921833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:16.936036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] MFA Rules not processed for user `a84f763a413440cca929a08e26074cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:16.938181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:16.952755 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2000/3963] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:16.956517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:16.986852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dcefd-e50e-41e1-88ed-d82af8e0d6e0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:17.009613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:17.010665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.011077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.011543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.014762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:17.022234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:17.148404 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2001/3964] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:17.151121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:17.156366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.245134 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1964/3965] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:17.245134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:17.297171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21febcf0-4d60-4651-a5b0-44a365f2eaf1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:17.319055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:17.350032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2007-eea4-4c96-a1e6-736d796ff0e6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:17.360347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:17.361582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.362074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.362522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] PATH_INFO: `/v3/projects/0d9f40afe6f84b4cacbaad47846895ca` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.364352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9f40afe6f84b4cacbaad47846895ca)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:17.367802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:17.439497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:17.442530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.443797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.444359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.445156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:17.447402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7f667-2059-47b1-9c51-1cd02ca0cd7c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:17.458484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:17.514565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1965/3966] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:17 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:17.518615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093165-7c32-4782-a309-00053dad9eef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.519477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093165-7c32-4782-a309-00053dad9eef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.521736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093165-7c32-4782-a309-00053dad9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.525826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9f40afe6f84b4cacbaad47846895ca', 'request_id': 'req-e89b7b62-27db-4dfa-83b7-86a55f2c0908'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:17.550796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9f40afe6f84b4cacbaad47846895ca', 'request_id': 'req-e89b7b62-27db-4dfa-83b7-86a55f2c0908'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:17.572578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0a093165-7c32-4782-a309-00053dad9eef None None] MFA Rules not processed for user `61cf7ea9fbe3487294ed6d52cfa2fec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:17.574252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9f40afe6f84b4cacbaad47846895ca', 'request_id': 'req-e89b7b62-27db-4dfa-83b7-86a55f2c0908'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:17.575527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a093165-7c32-4782-a309-00053dad9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.627030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] The token cache is being invalidate because project 0d9f40afe6f84b4cacbaad47846895ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:17.629335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:17.632048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:17.639622 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2002/3967] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:17 2022] DELETE /identity/v3/projects/0d9f40afe6f84b4cacbaad47846895ca => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:17.639622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:17.642070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.759111 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1966/3968] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:17.759111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.759111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.759111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.812057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:17.812933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b7b62-27db-4dfa-83b7-86a55f2c0908 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:17.816232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.827549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:17.830474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.830789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.831062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.835880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:17.837645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:17.843034 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1967/3969] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:17.845225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:17.846726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.864011 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2003/3970] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:17.864912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:17.871811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:17.899380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63badea0-b7ed-47fc-8a84-3fec620a5b13 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:17.915708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:17.917554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:17.917554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:17.917554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] PATH_INFO: `/v3/projects/8cc4291792d840a4bf55d314b1cb252b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:17.922439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc4291792d840a4bf55d314b1cb252b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:17.927174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.036279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef4c1a-94ac-481a-95e5-43f322cad1e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.094860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc4291792d840a4bf55d314b1cb252b', 'request_id': 'req-b64a3b8e-80e0-4f07-80c8-e888ccd14424'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:18.111823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc4291792d840a4bf55d314b1cb252b', 'request_id': 'req-b64a3b8e-80e0-4f07-80c8-e888ccd14424'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:18.132902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc4291792d840a4bf55d314b1cb252b', 'request_id': 'req-b64a3b8e-80e0-4f07-80c8-e888ccd14424'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:18.155407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:18.164376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] The token cache is being invalidate because project 8cc4291792d840a4bf55d314b1cb252b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:18.168484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:18.170008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b64a3b8e-80e0-4f07-80c8-e888ccd14424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:18.173400 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2004/3971] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:17 2022] DELETE /identity/v3/projects/8cc4291792d840a4bf55d314b1cb252b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:18.182341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.182783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.186108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.218262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:18.220822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:18.250749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.251601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.252562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.252943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.259503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:18.309599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:18.381377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2005/3972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:18.382856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:18.385420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:18.401719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda71e-df01-4555-9819-3d310f249fbf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.412144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.413063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.413612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.414686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.415570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.417582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d0ec0-4347-4cfc-bad0-4b00e41c92fe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.448235 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2006/3973] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:18.465912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.470143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.471131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.488883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.491385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.532176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1968/3974] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:18.533741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:18.535447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:18.537312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:18.569421 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2007/3975] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:18.571763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:18.582117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0b42-718d-45e7-9fce-89f07fb902c5 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.597364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.598591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.598966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.599492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.601194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:18.601737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.603424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4933336-6ca1-43f9-b93b-c52534253e8f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.625085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9b533-5882-4772-a3b1-6dfa08d817b6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.627180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.628893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.630880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.631783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] PATH_INFO: `/v3/projects/fd1f47477049427ab12ec7adb829c5f5/users/f24f528b90ed4813a69cd8e5bdda5d36/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.686609 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1969/3976] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:18.691047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.692781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.693532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.703589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1f47477049427ab12ec7adb829c5f5, user_id=f24f528b90ed4813a69cd8e5bdda5d36, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.717735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.731353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:18.734137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:18.755862 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1970/3977] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:18.757416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:18.787206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2008/3978] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:18 2022] PUT /identity/v3/projects/fd1f47477049427ab12ec7adb829c5f5/users/f24f528b90ed4813a69cd8e5bdda5d36/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:18.787206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:18.791410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5b9db-a9d9-4925-8dfa-7e22e64d1328 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.907428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d191a4-5a3f-4810-aa91-9c7a8f9c0834 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:18.913615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.914854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.915347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.915629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:18.917148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.917439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.917701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.918287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:18.919067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:18.919374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.921651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04db60d-59e1-4c67-8f14-cfcb58f99ae3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.925894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:18.934394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:18.946803 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2009/3979] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:18.970586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:18.971560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:18.971840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.006868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:19.008271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:19.012554 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1971/3980] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:19.014003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.129287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:19.169180 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2010/3981] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:19.169180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.169799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9278876-4d70-4b3a-9c16-22dfb1755ef7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.186606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.198860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.199214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.199384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.201626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.203681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ca5f-7010-496f-9d45-7c194ec7eda4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.208393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.217995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.219461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.223090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.224818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.226948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.232201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.270936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2011/3982] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:19 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:19.271799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.274900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:19.291054 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1972/3983] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:19 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:19.292565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.327483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:19.380716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1b43-a539-48e6-b85b-a906f8cacd97 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.449226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43cc7-d012-46ba-a899-69c8e9f69a34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.459704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.460603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.461090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.461615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.463092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.465211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.469510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.470778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.471343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.472138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.481871 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1973/3984] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:19.483185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.495455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.498423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.505405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ba73c-6d23-4c9f-920b-23deacaabdca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.512324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.513242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.513659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.514406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.515423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.518915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.522773 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2012/3985] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:19.524186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.539942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09799491-a71d-4813-949c-fac8934b6837 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.547053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.547958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.548365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.548816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.550134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.552215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.559230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1974/3986] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:19 2022] POST /identity/v3/users => generated 287 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:19.560794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.566910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2013/3987] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:19.571786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.593129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80aa31-8630-4a87-bb81-759c3e7cd179 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.598134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d813967-751c-49e2-9a3b-f298e4d825d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.603595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.604823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.605569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.606637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] PATH_INFO: `/v3/projects/f7edbad9c1fb4c1a823575d5b5c6cd08/users/a51c470236904eb0a85bfee1703d3c71/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.612668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.614622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.614992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.615270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.615937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.617699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.637870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7edbad9c1fb4c1a823575d5b5c6cd08, user_id=a51c470236904eb0a85bfee1703d3c71, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.644123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d3dfd-6758-44c3-8223-4fc359704a80 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.656567 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1975/3988] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:19.660589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.680911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d1add-ab6b-4c81-a7d0-e79ef488ddf0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.708255 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2014/3989] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:19 2022] PUT /identity/v3/projects/f7edbad9c1fb4c1a823575d5b5c6cd08/users/a51c470236904eb0a85bfee1703d3c71/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:19.713537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.713819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.714211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.773070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:19.777691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:19.846723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.848017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.848582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.849210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.850762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.853317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:19.879436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1976/3990] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:19.885157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.912129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:19.916001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24b0e3-a157-4323-9296-c3dfb4b04232 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:19.939157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:19.939853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:19.940132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:19.941110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] PATH_INFO: `/v3/projects/3e6913cd56ee499d8bbf42e3f4170c03/users/51a56c49d8634116880d575fee62a533/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:19.960350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2015/3991] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:19.974935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:19.979969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:19.983575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6913cd56ee499d8bbf42e3f4170c03, user_id=51a56c49d8634116880d575fee62a533, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:19.988984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f46079-a977-4adf-ae51-f47a3c5f6f18 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.015631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1977/3992] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:19 2022] PUT /identity/v3/projects/3e6913cd56ee499d8bbf42e3f4170c03/users/51a56c49d8634116880d575fee62a533/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:20.045081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c2c5d-b2b8-4d9e-a922-389c7d1316d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.045365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c2c5d-b2b8-4d9e-a922-389c7d1316d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.045637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c2c5d-b2b8-4d9e-a922-389c7d1316d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.121690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-932c2c5d-b2b8-4d9e-a922-389c7d1316d0 None None] MFA Rules not processed for user `51a56c49d8634116880d575fee62a533`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:20.137990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-932c2c5d-b2b8-4d9e-a922-389c7d1316d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:20.170971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b7d10-6955-4fff-960d-96c808fac61a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:20.249393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:20.320117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:20.322811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.325060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.325842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.333183 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1978/3993] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:20.338039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.338325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.338599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.417210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] MFA Rules not processed for user `70ac3d341e8444fda9964798e94f0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:20.419067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:20.463428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:20.465221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.486153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2016/3994] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:20.487251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:20.518691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aee52f-c9ab-4b57-82a1-d07063f9351b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:20.537363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:20.538185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.538459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.538728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.539371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:20.542810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.576398 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1979/3995] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:20.616404 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2017/3996] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:20 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:20.617846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:20.639806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce2b2d-e476-4204-ace3-51998fd3a9b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:20.738431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:20.740655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.741159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.742146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.742898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:20.746682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.803160 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1980/3997] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:20 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:20.806266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:20.820533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab748-e953-474e-bb9e-3ad2d844fa74 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:20.827335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:20.828737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.829122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.829652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.830369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:20.832070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.861249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2018/3998] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:20.862899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:20.877168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282248f-9e5a-45cc-a6f8-01313b771366 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:20.885192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:20.886265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:20.886808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:20.887438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] PATH_INFO: `/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00/users/2f4ff8ae62e240408e7aae5537f4de0d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:20.917224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5675ab48ad334d6f9fb70f06ebb6bf00, user_id=2f4ff8ae62e240408e7aae5537f4de0d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:20.922633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:20.942545 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1981/3999] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:20 2022] PUT /identity/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00/users/2f4ff8ae62e240408e7aae5537f4de0d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:20.946203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:20.960701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6e48-c06d-454a-b54e-8e89a29371aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:21.023257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:21.127614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:21.130672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:21.132873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:21.135162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:21.138217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:21.142289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f984b2-8248-4c85-8704-3517e4aa2947 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:21.193265 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2019/4000] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:21.195440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:21.228228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47988c3c-862c-453d-a577-7ae0b0a4cd32 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:21.243935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:21.245204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:21.245878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:21.246435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] PATH_INFO: `/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00/users/2f4ff8ae62e240408e7aae5537f4de0d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:21.254093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5675ab48ad334d6f9fb70f06ebb6bf00, user_id=2f4ff8ae62e240408e7aae5537f4de0d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:21.263671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:21.293905 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1982/4001] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:21 2022] PUT /identity/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00/users/2f4ff8ae62e240408e7aae5537f4de0d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:21.305146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:21.305437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:21.305717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:21.344677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] MFA Rules not processed for user `2f4ff8ae62e240408e7aae5537f4de0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:21.346090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:21.458008 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2020/4002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:21.480873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:21.482998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:21.587379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:21.647186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecb69-93f9-4ca5-a247-7c5d12c49417 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:21.664538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:21.665365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:21.665644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:21.665920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:21.683172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:21.685260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e91cba-a0f4-42d5-8a7c-60a8cbbb1a5b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:21.715576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1983/4003] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:22.713884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:22.859116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb002-a463-4fea-84f8-e404e0a4b3c5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:22.866216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:22.866841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:22.867185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:22.867587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] PATH_INFO: `/v3/users/51a56c49d8634116880d575fee62a533` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:22.870181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a56c49d8634116880d575fee62a533)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:22.873155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:22.974018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a56c49d8634116880d575fee62a533'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:23.012138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a56c49d8634116880d575fee62a533'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:23.014109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a56c49d8634116880d575fee62a533'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:23.021269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:23.053281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a56c49d8634116880d575fee62a533'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:23.053281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a56c49d8634116880d575fee62a533'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:23.109039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2021/4004] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:22 2022] DELETE /identity/v3/users/51a56c49d8634116880d575fee62a533 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:23.112196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:23.112920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:23.113496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:23.165282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:23.166764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:23.306046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1984/4005] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:23.326098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:23.327591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:23.425144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b6e27-33e3-44bb-b2ae-b6ae0f7fd241 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:23.429932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:23.431177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:23.431433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:23.431801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:23.445495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:23.447250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:23.462313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2022/4006] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:24.339130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:24.349744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:24.372416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636a3b1-bc88-4e0f-9bf5-64059299d715 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:24.388566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:24.389249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:24.389517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:24.390329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] PATH_INFO: `/v3/projects/3e6913cd56ee499d8bbf42e3f4170c03` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:24.391693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6913cd56ee499d8bbf42e3f4170c03)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:24.394174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:24.522983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6913cd56ee499d8bbf42e3f4170c03', 'request_id': 'req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.545482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6913cd56ee499d8bbf42e3f4170c03', 'request_id': 'req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.576809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6913cd56ee499d8bbf42e3f4170c03', 'request_id': 'req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.606810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] The token cache is being invalidate because project 3e6913cd56ee499d8bbf42e3f4170c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:24.607102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.608909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.613487 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1985/4007] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:24 2022] DELETE /identity/v3/projects/3e6913cd56ee499d8bbf42e3f4170c03 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:24.618003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:24.632310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18da8e-6d35-449b-809c-e4f31b0521f7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:24.784394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:24.785685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:24.786289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:24.786788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] PATH_INFO: `/v3/users/2f4ff8ae62e240408e7aae5537f4de0d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:24.788340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4ff8ae62e240408e7aae5537f4de0d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:24.790410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:24.877951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4ff8ae62e240408e7aae5537f4de0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.891669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4ff8ae62e240408e7aae5537f4de0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.892397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4ff8ae62e240408e7aae5537f4de0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.900922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4ff8ae62e240408e7aae5537f4de0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.913213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f194a077-7ce6-4cef-b29c-f4ddb441ecfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4ff8ae62e240408e7aae5537f4de0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:24.968034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:24.979257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2023/4008] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:24 2022] DELETE /identity/v3/users/2f4ff8ae62e240408e7aae5537f4de0d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:27.666653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:27.669877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:27.711414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aac82-aee7-4e8a-b5bd-7522f0cf1ba4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:27.952879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:28.012003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:28.013037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.015451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.016457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] PATH_INFO: `/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.020178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5675ab48ad334d6f9fb70f06ebb6bf00)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:28.027244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:28.151817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5675ab48ad334d6f9fb70f06ebb6bf00', 'request_id': 'req-f29ad381-5d22-458c-a2f0-17aabda093b3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:28.166751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5675ab48ad334d6f9fb70f06ebb6bf00', 'request_id': 'req-f29ad381-5d22-458c-a2f0-17aabda093b3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:28.185023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5675ab48ad334d6f9fb70f06ebb6bf00', 'request_id': 'req-f29ad381-5d22-458c-a2f0-17aabda093b3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:28.199535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] The token cache is being invalidate because project 5675ab48ad334d6f9fb70f06ebb6bf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:28.200254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:28.201302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:28.204881 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1986/4009] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:27 2022] DELETE /identity/v3/projects/5675ab48ad334d6f9fb70f06ebb6bf00 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:28.210726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab155-8a3e-46c5-aa15-856a495ac192 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.211475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab155-8a3e-46c5-aa15-856a495ac192 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.215114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab155-8a3e-46c5-aa15-856a495ac192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.282343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c15ab155-8a3e-46c5-aa15-856a495ac192 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:28.287935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c15ab155-8a3e-46c5-aa15-856a495ac192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:28.325706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:28.327413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:28.570046 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2024/4010] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:28.571940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.572232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.572537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.612689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ad381-5d22-458c-a2f0-17aabda093b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:28.623072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:28.624005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.624899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.625447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.633953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:28.647482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:28.675593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:28.685564 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2025/4011] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:28.690455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:28.702844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dee58e-b8af-4926-bae8-ca40e835598e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:28.709092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:28.709768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.710658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.710658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.710941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:28.719507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:28.721656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:28.751731 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2026/4012] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:28.752962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:28.776315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1b99-f153-4864-b26c-da14c4c6abfa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:28.784195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:28.786064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:28.789100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:28.790367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:28.790645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:28.790913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:28.791548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:28.797945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:28.826955 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1987/4013] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:28.868125 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2027/4014] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:28 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:28.873451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:28.893856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33ca6d-5530-4295-828d-d8184f79c0ab service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:28.960393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:29.106602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.107824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.110815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.111237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.112029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.144535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:29.220158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1988/4015] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:28 2022] POST /identity/v3/users => generated 285 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:29.224623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:29.242777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad74ba-199e-4ff3-aa22-cf728044996a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:29.259027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.259777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.260162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.262007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.262856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.265078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:29.297135 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2028/4016] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:29.299335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:29.311031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf458b0-4669-4149-a1b9-4f5645761725 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:29.316253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.316866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.317273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.317542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.318254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.336333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f614c-92ce-460e-a408-95591d2e4872 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:29.378894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1989/4017] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:29.382087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:29.397516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2f737-9225-4039-ae72-0914bf5b87ee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:29.417321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.418026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.418352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.418759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] PATH_INFO: `/v3/projects/d95506db65ae4fde8a0914f1227e6e9f/users/4978be48cc2242b39b38771f7c4585e6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.467211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95506db65ae4fde8a0914f1227e6e9f, user_id=4978be48cc2242b39b38771f7c4585e6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.472829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:29.508944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.509254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.509525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.513355 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2029/4018] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:29 2022] PUT /identity/v3/projects/d95506db65ae4fde8a0914f1227e6e9f/users/4978be48cc2242b39b38771f7c4585e6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:29.550906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] MFA Rules not processed for user `4978be48cc2242b39b38771f7c4585e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:29.552256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:29.681079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1990/4019] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:29.682342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:29.838387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4d65a-d6bc-4d78-9dea-77227d4839a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:29.844850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.845605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.845955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.846332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.847080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.849227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:29.890951 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2030/4020] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:29 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:29.892056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:29.904388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023277f-595c-46ca-b5d2-b69c6857d7e9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:29.989408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:29.990214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:29.990694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:29.991083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:29.991977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:29.994141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.037911 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1991/4021] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:29 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:30.039416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:30.048493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:30.055956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbe80c-f04e-4caa-96aa-d673da2cde1d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:30.068794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:30.071033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.071580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.071994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.074390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:30.076237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.100119 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2031/4022] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:30.104658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:30.117598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8c47-25c4-4045-9e65-846c816083fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:30.123521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:30.124203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.124476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.124923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] PATH_INFO: `/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f/users/ccffabed494740409f8abb44713d3679/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.148166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5f5e4ed06f4035911579a7f1e2cc1f, user_id=ccffabed494740409f8abb44713d3679, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:30.152789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.157295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:30.190476 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1992/4023] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:30 2022] PUT /identity/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f/users/ccffabed494740409f8abb44713d3679/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:30.194974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:30.207273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd0684-1620-44ac-9478-cbbd5470c3f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:30.378017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:30.378570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.378741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.378945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.379601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:30.382888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16503d49-d3f9-43d8-8d84-60a8f8c1d896 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.421898 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2032/4024] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:30.423161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:30.434388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9d5f8-51a0-4836-b10e-30d469193e62 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:30.453898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:30.454727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.455007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.455273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] PATH_INFO: `/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f/users/ccffabed494740409f8abb44713d3679/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.458419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5f5e4ed06f4035911579a7f1e2cc1f, user_id=ccffabed494740409f8abb44713d3679, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:30.465021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.497731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1993/4025] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:30 2022] PUT /identity/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f/users/ccffabed494740409f8abb44713d3679/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:30.510827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.511700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.513365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.575418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] MFA Rules not processed for user `ccffabed494740409f8abb44713d3679`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:30.577444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:30.750740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2033/4026] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:30.770674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:30.773619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:30.913866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f865c3-6d0b-4b00-91ee-b173fe427eec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:30.925379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:30.926320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:30.926694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:30.927052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:30.945614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:30.947160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04a2a7-dbca-4f43-975e-eff274129b8c service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:30.961388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1994/4027] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:31.021267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:31.023914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:31.045224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84997ff-d5fe-420b-a094-ce0c2eeb0ae8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:31.049884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:31.050506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:31.050779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:31.051044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:31.216097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:31.218537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:31.233734 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2034/4028] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:33.007075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f32f1-beab-4f4e-86a4-87ed6c1f7a70 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:33.010528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f32f1-beab-4f4e-86a4-87ed6c1f7a70 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:33.011940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f32f1-beab-4f4e-86a4-87ed6c1f7a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:33.106773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-481f32f1-beab-4f4e-86a4-87ed6c1f7a70 None None] MFA Rules not processed for user `f24f528b90ed4813a69cd8e5bdda5d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:33.108369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-481f32f1-beab-4f4e-86a4-87ed6c1f7a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:33.297144 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1995/4029] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:33.339409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:33.356778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:33.526048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f2a4-b997-44c5-940e-358302d65895 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:33.544696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:33.545347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:33.545619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:33.545888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:33.565540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:33.567137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:33.591967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2035/4030] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:34.840488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:34.840949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:34.841075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:34.904907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] MFA Rules not processed for user `a51c470236904eb0a85bfee1703d3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:34.906300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:35.063117 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1996/4031] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:35.086756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:35.100438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b1364-c1f1-42b9-9971-9b7d6b34406d service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:35.106505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:35.107103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:35.107563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:35.107819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:35.118608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:35.120329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f15a-c283-4221-9df1-b84026758e5e service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:35.139488 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2036/4032] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:36.084451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:36.090436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:36.183419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec54f-e590-4030-b3bd-1f6cde7b1991 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:36.190923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:36.192334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:36.192912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:36.193643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] PATH_INFO: `/v3/users/4978be48cc2242b39b38771f7c4585e6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:36.195673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4978be48cc2242b39b38771f7c4585e6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:36.198146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:36.282102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4978be48cc2242b39b38771f7c4585e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:36.283417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4978be48cc2242b39b38771f7c4585e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:36.298512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4978be48cc2242b39b38771f7c4585e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:36.301254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4978be48cc2242b39b38771f7c4585e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:36.321338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4978be48cc2242b39b38771f7c4585e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:36.379464 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1997/4033] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:36 2022] DELETE /identity/v3/users/4978be48cc2242b39b38771f7c4585e6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:36.384134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5bd35-e0d8-41e3-949a-b026ca5a366f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:36.384976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5bd35-e0d8-41e3-949a-b026ca5a366f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:36.385435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5bd35-e0d8-41e3-949a-b026ca5a366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:36.460896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cfe5bd35-e0d8-41e3-949a-b026ca5a366f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:36.462161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfe5bd35-e0d8-41e3-949a-b026ca5a366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:36.669502 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2037/4034] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:36.700615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:36.703395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:36.886341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be728a3-20a0-4a88-84bd-faf32434e9b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:36.896754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:36.897606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:36.897883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:36.898148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:36.930441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:36.932094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779eb07-a82b-45f5-a4a8-e202dff14cb4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:36.969203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1998/4035] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:37.307231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:37.310745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:37.311149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:37.337697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] MFA Rules not processed for user `f24f528b90ed4813a69cd8e5bdda5d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:37.339613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:37.435140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2038/4036] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:38.236803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:38.237482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:38.237482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:38.276739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] MFA Rules not processed for user `a51c470236904eb0a85bfee1703d3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:38.281105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:38.351020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:38.449969 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 1999/4037] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:38.721044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:38.723662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:38.746074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036a89-ef10-43ea-94aa-881eda815fa4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:38.760733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:38.761450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:38.761732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:38.762006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] PATH_INFO: `/v3/projects/d95506db65ae4fde8a0914f1227e6e9f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:38.764813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95506db65ae4fde8a0914f1227e6e9f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:38.770019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:38.817369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:38.848518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95506db65ae4fde8a0914f1227e6e9f', 'request_id': 'req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:38.861457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95506db65ae4fde8a0914f1227e6e9f', 'request_id': 'req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:38.870141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95506db65ae4fde8a0914f1227e6e9f', 'request_id': 'req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:38.892161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] The token cache is being invalidate because project d95506db65ae4fde8a0914f1227e6e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:38.892552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:38.894108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:38.897045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2039/4038] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:38 2022] DELETE /identity/v3/projects/d95506db65ae4fde8a0914f1227e6e9f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:38.900200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:38.927131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cc518-1a3b-4fc9-aa6c-26fb0beef373 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:39.056245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:39.057025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:39.057438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:39.057814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] PATH_INFO: `/v3/users/ccffabed494740409f8abb44713d3679` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:39.059335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccffabed494740409f8abb44713d3679)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:39.062706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:39.137943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccffabed494740409f8abb44713d3679'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:39.138971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccffabed494740409f8abb44713d3679'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:39.169269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccffabed494740409f8abb44713d3679'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:39.170344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccffabed494740409f8abb44713d3679'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:39.186515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b2672128-cf22-44cd-8d47-dfc1521ff16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccffabed494740409f8abb44713d3679'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:39.237219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2000/4039] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:38 2022] DELETE /identity/v3/users/ccffabed494740409f8abb44713d3679 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:40.916131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:40.918277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:40.948458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bf85b-88bb-44b1-a40c-69f918fb5cd5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:41.116964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:41.117652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:41.118166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:41.118446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] PATH_INFO: `/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:41.122832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5f5e4ed06f4035911579a7f1e2cc1f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:41.125819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:41.211033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5f5e4ed06f4035911579a7f1e2cc1f', 'request_id': 'req-4208bc5b-d517-458c-82eb-c66c45a89ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:41.225135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5f5e4ed06f4035911579a7f1e2cc1f', 'request_id': 'req-4208bc5b-d517-458c-82eb-c66c45a89ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:41.235633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5f5e4ed06f4035911579a7f1e2cc1f', 'request_id': 'req-4208bc5b-d517-458c-82eb-c66c45a89ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:41.256506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] The token cache is being invalidate because project 1b5f5e4ed06f4035911579a7f1e2cc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:41.257075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:41.264854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4208bc5b-d517-458c-82eb-c66c45a89ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:41.272798 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2040/4040] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:40 2022] DELETE /identity/v3/projects/1b5f5e4ed06f4035911579a7f1e2cc1f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:41.274246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:41.275374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:41.276893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:41.339000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:41.342582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:41.471818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:41.518896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2001/4041] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:41.529372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:41.529783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:41.530060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:41.603974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:41.605714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:41.628698 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2041/4042] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:41.633433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:41.649216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7e172-8c72-48a4-8c79-a6bdc8e0b10c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:41.662756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:41.663532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:41.663959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:41.664319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:41.665497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:41.665497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:41.669749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:41.701032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2002/4043] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:20:41.707045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:41.718333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d3e9-f4e8-4b15-b189-cf8c60891821 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:41.731812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:41.732478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:41.732761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:41.733057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:41.734254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:41.739010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:41.842600 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2042/4044] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:41 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:41.843507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:41.865942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bc772-846c-456c-9b44-3b819b08a385 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.067755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.068394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.069502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.069824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.070857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.074089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.150475 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2003/4045] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:41 2022] POST /identity/v3/users => generated 289 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:42.156220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.177727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073be375-db35-4ce7-9c2d-2c5b43eb4bee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.195035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.196450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.196734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.197092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.197690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.206934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.211650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:42.232434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2043/4046] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:42.232648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.248883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06d880-3aa7-4856-94d2-a296f97a90cf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.257375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.258454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.258736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.259006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.259660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.261363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fdd18-de8a-476f-87b5-918c8db2820a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.277930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.283743 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2004/4047] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:42.290186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31b7e-3a2b-4c16-afd6-77a9f0b8e7cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.295536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.296472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.296943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.297485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] PATH_INFO: `/v3/projects/06bbd8ec3b364a87928d79095dc29e9c/users/dcbc241218fe47f28bd75adc193e1968/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.316628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bbd8ec3b364a87928d79095dc29e9c, user_id=dcbc241218fe47f28bd75adc193e1968, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.319633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.342375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2044/4048] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:42 2022] PUT /identity/v3/projects/06bbd8ec3b364a87928d79095dc29e9c/users/dcbc241218fe47f28bd75adc193e1968/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:42.353119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.353580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.354023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.412072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] MFA Rules not processed for user `dcbc241218fe47f28bd75adc193e1968`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:42.413834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:42.543874 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2005/4049] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:42.551660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.680183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5938941-d8d1-4107-9d7d-22052f1b355a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.687891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.689372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.689835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.690261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.691734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.694779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.741853 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2045/4050] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:42 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:42.745684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.758953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dcdcd-d8e4-4692-8085-4b69d583283d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.836888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:42.857894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.860260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.860666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.861301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.862489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.864663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.890413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2006/4051] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:42 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:42.894790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.907323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404031cc-db3e-40dc-a0b3-1d3a9b66fa43 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.911994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.912726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.913109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.913446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.914156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.915803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:42.927578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2046/4052] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:42.931882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:42.943869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203f25-6753-4d27-ae4e-48ff3da7781a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:42.951130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:42.953562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:42.956267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:42.956885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] PATH_INFO: `/v3/projects/49113047db204c52ad2a179f22fcfa2f/users/622d075df3a44bb8a171d5b15da767c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:42.993656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49113047db204c52ad2a179f22fcfa2f, user_id=622d075df3a44bb8a171d5b15da767c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:42.996631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:43.017249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2007/4053] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:42 2022] PUT /identity/v3/projects/49113047db204c52ad2a179f22fcfa2f/users/622d075df3a44bb8a171d5b15da767c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:43.021418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:43.050366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8d67f-ea1d-4a52-ba9c-fe122fd1e372 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:43.154609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:43.156168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:43.156685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:43.157364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:43.157673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:43.160236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a7b11-7328-4229-af06-6927d9e31e2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:43.171220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2047/4054] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:43.175764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:43.194539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe3f3c-8ab9-4e2e-a39b-83a53e42d573 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:43.201082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:43.201824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:43.202097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:43.202886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] PATH_INFO: `/v3/projects/49113047db204c52ad2a179f22fcfa2f/users/622d075df3a44bb8a171d5b15da767c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:43.209151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49113047db204c52ad2a179f22fcfa2f, user_id=622d075df3a44bb8a171d5b15da767c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:43.211754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:43.227468 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2008/4055] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:43 2022] PUT /identity/v3/projects/49113047db204c52ad2a179f22fcfa2f/users/622d075df3a44bb8a171d5b15da767c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:43.239871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:43.240380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:43.241715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:43.325401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] MFA Rules not processed for user `622d075df3a44bb8a171d5b15da767c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:43.326896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:43.382081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:43.533974 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2048/4056] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:43.546831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:43.549476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:43.690554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e35d9-9d50-4b49-ab0e-0df508c088c2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:43.697114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:43.697903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:43.698202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:43.698617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:43.839073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:43.841582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:43.879807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2009/4057] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:44.332893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:44.335005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:44.479129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb7d9a-9958-4100-9d6d-8a88f1296bff None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:44.499938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:44.500573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:44.500845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:44.501183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:44.504391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:44.703014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:44.705544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:44.733177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2049/4058] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:45.723430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:45.732536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:45.885742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:45.913328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88691-5866-4cff-910d-a6d3faac0af0 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:45.924255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:45.925386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:45.925386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:45.925575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] PATH_INFO: `/v3/users/7d7104a95b73405ab66140df742af14f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:45.949883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7104a95b73405ab66140df742af14f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:45.955410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:46.046706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7104a95b73405ab66140df742af14f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.048033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7104a95b73405ab66140df742af14f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.057244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7104a95b73405ab66140df742af14f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.058275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7104a95b73405ab66140df742af14f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.072855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7104a95b73405ab66140df742af14f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.104494 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2010/4059] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:45 2022] DELETE /identity/v3/users/7d7104a95b73405ab66140df742af14f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:46.441695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:46.443214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.458167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3c73-cbd2-4717-8832-f448dc4d268d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:46.557299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:46.560278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:46.560727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:46.561308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:46.564267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.573574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:46.578142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.609700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:46.703024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:46.703794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a47c2-5a66-4eb8-9381-a009fb938d5b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:46.704272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:46.713479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:46.714344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:46.714658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:46.714928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] PATH_INFO: `/v3/projects/f4faf70c703a4417bd7131aef1d7475d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:46.716073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4faf70c703a4417bd7131aef1d7475d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:46.718979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:46.723051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2050/4060] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:20:46.724168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:46.726340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.795680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4faf70c703a4417bd7131aef1d7475d', 'request_id': 'req-d984b7d8-d2fd-4d8c-8b47-73a29234473e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.804653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4faf70c703a4417bd7131aef1d7475d', 'request_id': 'req-d984b7d8-d2fd-4d8c-8b47-73a29234473e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.813947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4faf70c703a4417bd7131aef1d7475d', 'request_id': 'req-d984b7d8-d2fd-4d8c-8b47-73a29234473e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.829193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38bfa5-4239-4a09-a1af-c78219e4ab55 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:46.837285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:46.840930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] The token cache is being invalidate because project f4faf70c703a4417bd7131aef1d7475d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:46.841771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.844261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d984b7d8-d2fd-4d8c-8b47-73a29234473e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:46.849051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2011/4061] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:46 2022] DELETE /identity/v3/projects/f4faf70c703a4417bd7131aef1d7475d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:46.851268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:46.852086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:46.852689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:46.876908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:46.878519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.879808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:46.880447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:46.880722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:46.881048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:46.883064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:46.959809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:46.961374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435435ad-1421-4d04-ad19-78b31d568644 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:46.972353 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2051/4062] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:46.991276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2012/4063] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:46.991800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:46.992290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:46.992932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.029969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:47.031650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:47.060374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.075080 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2052/4064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:47.076345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ad97c-c0d3-4b09-b4cf-75b47d77adb5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.089382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.089856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.090125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.090394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.091141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:47.091446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.094332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.153095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2013/4065] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:47.155344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.171653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693227f-997c-4b31-85d3-3be901f52bb0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.184592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.184759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.184921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.185231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.189430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.191388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.207344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:47.241044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2053/4066] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:47 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:47.245988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.260295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648d9e7-088f-45ea-9dfa-697a2c3a40d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.406489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.407217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.407497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.407822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.408618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.411736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.461240 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2014/4067] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:47 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:47.465344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.476972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dd2c3-1ea7-4bf5-a58f-326a8020ded7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.482214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.482832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.483110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.483452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.484208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.486250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.499780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2054/4068] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:20:47.504372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.517491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08799-5c86-406e-b833-c4427d3d0718 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.536357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.538410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.538521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.538762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.542221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.543455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03505f2-d83c-4f73-b762-ba520d4a22b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.577634 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2015/4069] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:47.578541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.600897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fdc2-a009-495a-9ce9-44cb0971671d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.610769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.611740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.612025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.612312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] PATH_INFO: `/v3/projects/1527ac1dc1c546d1ae7875738a9adc25/users/c41c3cfa66994ed2bf5e027e11a203f1/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.633845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1527ac1dc1c546d1ae7875738a9adc25, user_id=c41c3cfa66994ed2bf5e027e11a203f1, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:47.641081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:47.665194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2055/4070] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:47 2022] PUT /identity/v3/projects/1527ac1dc1c546d1ae7875738a9adc25/users/c41c3cfa66994ed2bf5e027e11a203f1/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:47.676479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a367bb-00ee-4825-8f03-bb7773c0331d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.676762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a367bb-00ee-4825-8f03-bb7773c0331d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.677050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a367bb-00ee-4825-8f03-bb7773c0331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.744057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1a367bb-00ee-4825-8f03-bb7773c0331d None None] MFA Rules not processed for user `c41c3cfa66994ed2bf5e027e11a203f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:47.745496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1a367bb-00ee-4825-8f03-bb7773c0331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:47.812967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:47.830359 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2016/4071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:47.851782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:47.851782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:47.874754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.875058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.876909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:47.903387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] MFA Rules not processed for user `1cc60ef5fff74c2eab3f81450c33a4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:47.904896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:47.984064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0344fcc-7f0f-4be1-9698-182e15b90123 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:47.992320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:47.993403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:47.994111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:47.994659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:48.003647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2017/4072] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:48.006007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:48.007695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e3ad6-a3ce-46be-8965-bfd9519c56f3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:48.018261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2056/4073] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:49.131523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:49.213326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe898f-394a-4864-b8c3-e29b4a62cb23 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:49.219390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:49.220212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:49.220714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:49.220873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] PATH_INFO: `/v3/users/c41c3cfa66994ed2bf5e027e11a203f1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:49.222318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41c3cfa66994ed2bf5e027e11a203f1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:49.224329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:49.284282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41c3cfa66994ed2bf5e027e11a203f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:49.285024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41c3cfa66994ed2bf5e027e11a203f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:49.293409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41c3cfa66994ed2bf5e027e11a203f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:49.294330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41c3cfa66994ed2bf5e027e11a203f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:49.304484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41c3cfa66994ed2bf5e027e11a203f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:49.325039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2018/4074] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:49 2022] DELETE /identity/v3/users/c41c3cfa66994ed2bf5e027e11a203f1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:49.329440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:49.329900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:49.329991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:49.350029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:49.351235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:49.415967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2057/4075] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:20:49.425751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:49.427256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:49.451604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:49.491629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0646fd-086a-4ed5-a5fe-2b805179f7e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:49.495503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:49.496104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:49.496374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:49.496640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:49.507957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:49.509413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e453a9-5429-40ba-bfa4-455d79333273 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:49.519974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2019/4076] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:49.820725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:49.823870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:49.856596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882bbb7-43be-415e-a58f-6f687e55fc33 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:49.868392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:49.872257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:49.872539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:49.872805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] PATH_INFO: `/v3/projects/1527ac1dc1c546d1ae7875738a9adc25` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:49.880684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1527ac1dc1c546d1ae7875738a9adc25)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:49.883245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:49.960491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:50.012212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1527ac1dc1c546d1ae7875738a9adc25', 'request_id': 'req-0ee15f68-2df5-4abf-9ded-0358a119f26a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:50.020730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1527ac1dc1c546d1ae7875738a9adc25', 'request_id': 'req-0ee15f68-2df5-4abf-9ded-0358a119f26a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:50.029939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1527ac1dc1c546d1ae7875738a9adc25', 'request_id': 'req-0ee15f68-2df5-4abf-9ded-0358a119f26a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:50.056952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] The token cache is being invalidate because project 1527ac1dc1c546d1ae7875738a9adc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:20:50.057277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:50.059993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0ee15f68-2df5-4abf-9ded-0358a119f26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:50.063142 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2058/4077] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:20:49 2022] DELETE /identity/v3/projects/1527ac1dc1c546d1ae7875738a9adc25 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:50.067913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.068204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.068532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.120641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:50.121922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:50.227811 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2020/4078] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:50.237542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.238004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.238440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.265757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:50.267715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:50.281615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2059/4079] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:50.285718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.298708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac28a6-732b-4a4d-8ff7-fcfff951f1d3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.305642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.306331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.306758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.307098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.307819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:20:50.308241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.310271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.328889 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2021/4080] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:20:50.334607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.348143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9960ebb-d323-4a05-9a89-0a4b222f0cf9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.354145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.354773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.355097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.355308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.356008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.358047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.403982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2060/4081] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:20:50 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:20:50.404676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.427050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a15098-8928-4347-a16e-d86715c0acdf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.532103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.534119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.534557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.535587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.537393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.541884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.581331 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2022/4082] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:20:50 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:20:50.585675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.603308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523faa7-ac56-4ba7-b077-93fc35f5eadc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.611805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.612722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.613021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.613306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.613959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.615939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.636936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2061/4083] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:20:50.642172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.656122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579e509-3ce9-4aa4-b821-b38aa81e0874 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.667888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.668958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.669245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.669639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.670537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.674510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3ee4-1380-4f29-8275-d0334a84ab02 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.692764 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2023/4084] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:20:50.705304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:50.711008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b70b90-d1ca-47b2-a2ab-33a2dedf9c6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:50.724788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:50.725495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.725802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.726072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] PATH_INFO: `/v3/projects/4eeba274a6f342c1984385aa9a7fd804/users/ce708efbc05d40c7a2a04173d9871991/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.761611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeba274a6f342c1984385aa9a7fd804, user_id=ce708efbc05d40c7a2a04173d9871991, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:50.768328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:50.789792 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2062/4085] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:20:50 2022] PUT /identity/v3/projects/4eeba274a6f342c1984385aa9a7fd804/users/ce708efbc05d40c7a2a04173d9871991/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:20:50.798771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dab57-e090-435a-93fb-b865edc8d8d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:50.799309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dab57-e090-435a-93fb-b865edc8d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:50.799727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dab57-e090-435a-93fb-b865edc8d8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:50.842373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-359dab57-e090-435a-93fb-b865edc8d8d0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:50.844661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-359dab57-e090-435a-93fb-b865edc8d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:50.927220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:51.002613 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2024/4086] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:51.019511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:51.021478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:51.157861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c8d03-c12e-4ead-871e-a8072dba7a18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:51.162811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:51.163475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:51.163751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:51.175034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:51.191351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:51.193579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:51.207873 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2063/4087] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:20:53.141824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:53.142285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:53.142364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:53.193051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:53.194657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:53.350742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2025/4088] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:20:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:53.425507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:53.427069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:53.627844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:53.641688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb492b4e-60ca-4028-996d-56769c51a15d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:53.650198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:53.650945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:53.651296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:53.652158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:53.689587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:53.691318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d950b-c0c3-4627-8456-3f96752c5ec2 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:53.706486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2064/4089] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:20:58.149252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:58.150171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:58.186499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f497ca-01cf-4f5e-af3a-fde7a01805b3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:58.207631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:58.208288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:58.208622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:58.208902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] PATH_INFO: `/v3/users/dcbc241218fe47f28bd75adc193e1968` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:58.210142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbc241218fe47f28bd75adc193e1968)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:58.212186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:58.394341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbc241218fe47f28bd75adc193e1968'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:58.395476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbc241218fe47f28bd75adc193e1968'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:58.414169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbc241218fe47f28bd75adc193e1968'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:58.415194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbc241218fe47f28bd75adc193e1968'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:58.438458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbc241218fe47f28bd75adc193e1968'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:20:58.488215 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2026/4090] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:20:58 2022] DELETE /identity/v3/users/dcbc241218fe47f28bd75adc193e1968 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:20:58.492602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:58.493148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:58.493224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:58.566354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:20:58.575183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:58.834285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2065/4091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:20:59.100247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:20:59.102182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:20:59.206917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:20:59.247671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebac6d7-4838-4de5-999b-1f170ebd1d73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:20:59.256582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:20:59.257249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:20:59.258133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:20:59.258407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:20:59.285513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:20:59.287020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:20:59.307030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2027/4092] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:01.109386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:01.112098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:01.136260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdee88-8625-4a35-b40c-e8ccd323e5d5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:01.157767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:01.158559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:01.158941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:01.159771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:01.183142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:01.193314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:01.193509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:01.238996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2066/4093] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:01.327776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:01.329992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:01.363669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4686-593c-4780-b359-54c1ed1cf119 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:01.378413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:01.378634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:01.378862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:01.379381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] PATH_INFO: `/v3/projects/06bbd8ec3b364a87928d79095dc29e9c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:01.383558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bbd8ec3b364a87928d79095dc29e9c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:01.387156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:01.500411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bbd8ec3b364a87928d79095dc29e9c', 'request_id': 'req-64457763-4ce1-4408-b257-edbbe55de499'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:01.515476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bbd8ec3b364a87928d79095dc29e9c', 'request_id': 'req-64457763-4ce1-4408-b257-edbbe55de499'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:01.530821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bbd8ec3b364a87928d79095dc29e9c', 'request_id': 'req-64457763-4ce1-4408-b257-edbbe55de499'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:01.582258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] The token cache is being invalidate because project 06bbd8ec3b364a87928d79095dc29e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:01.582559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:01.583436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:01.586790 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2028/4094] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:01 2022] DELETE /identity/v3/projects/06bbd8ec3b364a87928d79095dc29e9c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:01.591451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:01.625121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1fec9-95c2-4c79-a9a7-3ff2a381e3ed service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:01.796937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:01.797717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:01.798083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:01.800849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] PATH_INFO: `/v3/users/622d075df3a44bb8a171d5b15da767c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:01.804188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622d075df3a44bb8a171d5b15da767c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:01.810247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:02.003340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622d075df3a44bb8a171d5b15da767c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:02.031215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622d075df3a44bb8a171d5b15da767c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:02.031849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622d075df3a44bb8a171d5b15da767c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:02.059099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622d075df3a44bb8a171d5b15da767c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:02.059932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-36010c6a-93b0-43c0-b7bb-79220b564359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622d075df3a44bb8a171d5b15da767c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:02.098823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:02.114251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2067/4095] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:01 2022] DELETE /identity/v3/users/622d075df3a44bb8a171d5b15da767c0 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:03.155122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:03.157481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:03.180621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64457763-4ce1-4408-b257-edbbe55de499 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:03.385634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:03.387763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:03.388217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:03.388644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] PATH_INFO: `/v3/projects/49113047db204c52ad2a179f22fcfa2f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:03.391134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49113047db204c52ad2a179f22fcfa2f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:03.393326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:03.527996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49113047db204c52ad2a179f22fcfa2f', 'request_id': 'req-1aa769f7-02a2-4b0c-9469-84075fabb54c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:03.544547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49113047db204c52ad2a179f22fcfa2f', 'request_id': 'req-1aa769f7-02a2-4b0c-9469-84075fabb54c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:03.563192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49113047db204c52ad2a179f22fcfa2f', 'request_id': 'req-1aa769f7-02a2-4b0c-9469-84075fabb54c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:03.572219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:03.604827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] The token cache is being invalidate because project 49113047db204c52ad2a179f22fcfa2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:03.606641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:03.609253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1aa769f7-02a2-4b0c-9469-84075fabb54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:03.618493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2029/4096] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:03 2022] DELETE /identity/v3/projects/49113047db204c52ad2a179f22fcfa2f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:03.620539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:03.621092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:03.621182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:03.649511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:03.651121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:03.878730 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2068/4097] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:03.886024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:03.886362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:03.886639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:03.956621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:03.957986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:03.973894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2030/4098] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:03.975538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:03.993680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c885ed7-0e51-4268-80b4-9a5d44f40135 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.001426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.003652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.005848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.006416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.010214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:04.011004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.016403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.038768 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2069/4099] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:21:04.042370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.054529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afccc9-850e-4605-8341-8adc9f3fedd2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.060109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.060743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.061681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.061910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.062573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.065403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.138560 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2031/4100] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:04 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:04.141131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.157931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90244-2a3a-4c0d-b240-b00103bf280e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.268815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.270191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.270855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.271390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.273488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.276232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.337969 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2070/4101] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:04 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:21:04.342976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.365274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a2b8-c38c-4991-a18d-26824e358d27 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.399577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.404035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.405639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.411574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.412521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.424375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.441620 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2032/4102] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:04.445534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.460966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b4a4-f01b-4415-8993-e9ddaf9ad095 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.468592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.469677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.470124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.470563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.473113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.475367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502aef67-a843-46a9-a6c8-69ef5eacf268 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.494451 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2071/4103] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:21:04.499012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.509970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e84c0-1271-48ae-bb9e-28382781f2d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.517634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.518671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.519220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.519705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] PATH_INFO: `/v3/projects/43e6b10a125f4203878aedeac53be67a/users/6f7e64e2eb0140f1af2f43823569ee88/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.542345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e6b10a125f4203878aedeac53be67a, user_id=6f7e64e2eb0140f1af2f43823569ee88, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.547039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:04.571857 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2033/4104] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:04 2022] PUT /identity/v3/projects/43e6b10a125f4203878aedeac53be67a/users/6f7e64e2eb0140f1af2f43823569ee88/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:04.583721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4dbbb-af6f-4aa3-ab9f-3ce9f2367ea7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.584056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4dbbb-af6f-4aa3-ab9f-3ce9f2367ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.584312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4dbbb-af6f-4aa3-ab9f-3ce9f2367ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.661732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6de4dbbb-af6f-4aa3-ab9f-3ce9f2367ea7 None None] MFA Rules not processed for user `6f7e64e2eb0140f1af2f43823569ee88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:04.662989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6de4dbbb-af6f-4aa3-ab9f-3ce9f2367ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:04.727100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:04.775124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2072/4105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:04.780222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:04.811593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac18d-1492-4bc2-a230-e387eb56d0a0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.812579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac18d-1492-4bc2-a230-e387eb56d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.812876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac18d-1492-4bc2-a230-e387eb56d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.896093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d97ac18d-1492-4bc2-a230-e387eb56d0a0 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:04.897531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d97ac18d-1492-4bc2-a230-e387eb56d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:04.977414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17655e-a46c-4a99-9da9-82f592ce6f73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:04.990513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:04.991187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:04.991467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:04.991739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:04.992380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:04.994355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:05.078433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2034/4106] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:04 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:05.084225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:05.134716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2073/4107] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:05.153494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.153494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.154777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.227733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:05.237336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb3aeb-1dca-468a-962b-1c82af8bd64a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:05.239308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:05.248417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:05.248417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.248417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.248417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.249430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:05.251988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:05.286242 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2035/4108] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:05 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:05.291465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:05.310149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:05.325558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e791ac-bf89-4625-84dc-dc02a1b5eb53 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:05.337408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:05.339279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.340217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.340593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.343278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:05.350221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:05.402344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2036/4109] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:05.402344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:05.425172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427adfc-9c51-4c91-9098-3834f480dd31 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:05.431379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:05.432132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.432477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.433614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.434496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:05.438270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:05.453692 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2037/4110] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:05.459721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:05.501281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2074/4111] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:05.501514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a6b11-f613-4817-9e3f-fe4a8bcdfa50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:05.517901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:05.519952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:05.525079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:05.527856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.528044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.528704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] PATH_INFO: `/v3/projects/b3c32c8a1362436a8b74375a9be8fb57/users/5bbabe6143504c3e9a8f9d1a89b4f10f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.578795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c32c8a1362436a8b74375a9be8fb57, user_id=5bbabe6143504c3e9a8f9d1a89b4f10f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:05.585287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1edc7-e950-49e5-918d-39c3828a9f00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:05.615675 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2038/4112] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:05 2022] PUT /identity/v3/projects/b3c32c8a1362436a8b74375a9be8fb57/users/5bbabe6143504c3e9a8f9d1a89b4f10f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:05.641776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555959-b070-4733-ba45-8477b69e9613 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.643063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555959-b070-4733-ba45-8477b69e9613 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.643625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555959-b070-4733-ba45-8477b69e9613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.718579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-36555959-b070-4733-ba45-8477b69e9613 None None] MFA Rules not processed for user `5bbabe6143504c3e9a8f9d1a89b4f10f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:05.718859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c7cea-8d58-4563-9c8d-3759370ae043 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:05.720372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-36555959-b070-4733-ba45-8477b69e9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:05.772547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:05.844849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:05.848679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:05.849075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:05.849358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:05.883604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2039/4113] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:21:05.890972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555959-b070-4733-ba45-8477b69e9613 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.015804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.019695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.030335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555959-b070-4733-ba45-8477b69e9613 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.037799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.038559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.038834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.039102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.039744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.040930 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2075/4114] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:06.041900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.114852 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2040/4115] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:05 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:21:06.119676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.136976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52e42-c3a7-4428-a97e-8dcfda56d6c7 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.274463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.275969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.276480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.277066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.278231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.280616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.355275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.365557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2076/4116] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:06 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:06.371993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1ecdd-a79a-41bd-9d13-75f669a9cff3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.388783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.390932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.391474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.392671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.393646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.398889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.428931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.439660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2041/4117] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:21:06.442950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fee42-0ee4-4f51-87c9-ca580eb11257 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.461919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.462956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.463385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.463825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] PATH_INFO: `/v3/projects/1feaa5288fda4f03be4e6ce739c0146a/users/1068e27e5bb44d48a90e0e76d20109b1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.497911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feaa5288fda4f03be4e6ce739c0146a, user_id=1068e27e5bb44d48a90e0e76d20109b1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.501540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.542641 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2077/4118] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:06 2022] PUT /identity/v3/projects/1feaa5288fda4f03be4e6ce739c0146a/users/1068e27e5bb44d48a90e0e76d20109b1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:06.546748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.561767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adc343-c87b-44a5-a7e4-1abf53bf86dc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.608711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:06.682610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.683643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.684132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.685260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.690553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.692535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb0f7b-75d9-40b6-9786-0648683fac50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.704896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2042/4119] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:06.708779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:06.727958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14275bc-0cbe-4b36-876f-e71ec99e00e7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:06.740325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:06.742311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.742668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.744354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] PATH_INFO: `/v3/projects/1feaa5288fda4f03be4e6ce739c0146a/users/1068e27e5bb44d48a90e0e76d20109b1/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.749846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feaa5288fda4f03be4e6ce739c0146a, user_id=1068e27e5bb44d48a90e0e76d20109b1, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:06.755771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:06.784375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2078/4120] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:06 2022] PUT /identity/v3/projects/1feaa5288fda4f03be4e6ce739c0146a/users/1068e27e5bb44d48a90e0e76d20109b1/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:06.795655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:06.796448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:06.796947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:06.912415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] MFA Rules not processed for user `1068e27e5bb44d48a90e0e76d20109b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:06.914436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:07.102586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2043/4121] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:07.126716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:07.128125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:07.164501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:07.296346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f82198-f4ab-47b7-81c9-c98af2f614d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:07.300294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:07.300916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:07.301223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:07.301495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:07.313566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:07.315196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:07.350955 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2079/4122] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:07.402427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:07.404548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:07.431107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ef84a-8b44-4d39-91dd-04dfc9a869ca None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:07.438276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:07.439150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:07.439582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:07.440012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:07.628590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:07.637353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:07.664158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2044/4123] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:16.374008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:16.376713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:16.582841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225a8d-56f3-4bfb-a8cc-dd111d6d2ff8 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:16.589448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:16.593900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:16.594727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:16.595011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:16.595328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] PATH_INFO: `/v3/users/f24f528b90ed4813a69cd8e5bdda5d36` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:16.600248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24f528b90ed4813a69cd8e5bdda5d36)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:16.603526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:16.722968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24f528b90ed4813a69cd8e5bdda5d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:16.737426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24f528b90ed4813a69cd8e5bdda5d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:16.738748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24f528b90ed4813a69cd8e5bdda5d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:16.738962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:16.749989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24f528b90ed4813a69cd8e5bdda5d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:16.757584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24f528b90ed4813a69cd8e5bdda5d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:16.798583 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2080/4124] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:16 2022] DELETE /identity/v3/users/f24f528b90ed4813a69cd8e5bdda5d36 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:16.817766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8337ff-d993-4681-afea-cf4e42df35b4 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:17.116802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:17.122349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:17.122753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:17.123920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:17.127813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:17.213289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:17.222619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2263b-5201-42f5-a5f6-0584e5e41fec service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:17.256420 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2045/4125] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:17.316509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:17.318900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:17.416102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:17.521447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14110bf-6a00-4a10-b981-bed2bd952091 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:17.533668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:17.536856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:17.538094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:17.538816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] PATH_INFO: `/v3/projects/fd1f47477049427ab12ec7adb829c5f5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:17.541766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1f47477049427ab12ec7adb829c5f5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:17.546360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:17.691656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1f47477049427ab12ec7adb829c5f5', 'request_id': 'req-55a66e16-dec1-4111-b9f2-d9e4de249ae3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:17.710311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1f47477049427ab12ec7adb829c5f5', 'request_id': 'req-55a66e16-dec1-4111-b9f2-d9e4de249ae3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:17.720899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1f47477049427ab12ec7adb829c5f5', 'request_id': 'req-55a66e16-dec1-4111-b9f2-d9e4de249ae3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:17.749616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] The token cache is being invalidate because project fd1f47477049427ab12ec7adb829c5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:17.751559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:17.753267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a66e16-dec1-4111-b9f2-d9e4de249ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:17.766261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2081/4126] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:17 2022] DELETE /identity/v3/projects/fd1f47477049427ab12ec7adb829c5f5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:17.769213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:17.770762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:17.771444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:17.950751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:17.954078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:18.183460 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2046/4127] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:18.200491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.200491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.201070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.251575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:18.256595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:18.300649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2082/4128] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:18.313646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:18.315368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:18.321835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:18.343123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038dc4f-60d4-4c38-9ff1-9320801dc9cc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:18.352728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:18.354691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a641b-dada-4152-8e33-81312d29272a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:18.355064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.356604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.358143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.359522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:18.360450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:18.362677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:18.375674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:18.380465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.380863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.381169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] PATH_INFO: `/v3/users/6f7e64e2eb0140f1af2f43823569ee88` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.390540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7e64e2eb0140f1af2f43823569ee88)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:18.393442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:18.413037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2083/4129] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:21:18.425610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:18.446232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12985a1-54ce-45e2-951b-71dcf71d78cb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:18.455446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:18.456339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.456796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.457322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.458499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:18.462324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:18.531054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2084/4130] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:18 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:18.535329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:18.554356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7e64e2eb0140f1af2f43823569ee88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:18.555987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7e64e2eb0140f1af2f43823569ee88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:18.594955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7e64e2eb0140f1af2f43823569ee88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:18.597523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7e64e2eb0140f1af2f43823569ee88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:18.614266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:18.619194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4de88b17-0599-4d49-b8ce-9c736b5051b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7e64e2eb0140f1af2f43823569ee88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:18.661045 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2047/4131] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:18 2022] DELETE /identity/v3/users/6f7e64e2eb0140f1af2f43823569ee88 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:18.668573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.669212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.669639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.719572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c68095-f911-4bf6-b614-d88706f2ef2f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:18.723883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:18.732281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:18.756316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:18.950123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:18.955352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:18.956192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:18.957469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:18.961460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:18.966047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:19.023501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2048/4132] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:19.033954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:19.037130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:19.047871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2085/4133] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:18 2022] POST /identity/v3/users => generated 294 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:19.051865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:19.055230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:19.091429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6421-9815-49af-ae10-60a0d3c76b79 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:19.116070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:19.124752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:19.126779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:19.128824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:19.132749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:19.141945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:19.197588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2086/4134] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:21:19.203976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:19.222754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716377b-8a8b-43f6-82cf-2630275086e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:19.228706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:19.229463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:19.229741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:19.230979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:19.231623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:19.235210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:19.255507 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2087/4135] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:21:19.271297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:19.318169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a7a7e-7f32-4414-b405-345aadaa8650 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:19.322836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:19.323674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:19.324077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:19.324491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:19.333330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796a39-7331-4d49-b3c3-fc57e8eaabef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:19.357831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:19.358530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:19.358823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:19.359105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] PATH_INFO: `/v3/projects/61fbef46b3144818824a7475e453fb2d/users/692b185c70774449b75974b109118cd0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:19.360985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:19.362682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324290f-215a-41f8-bf59-2a72e6ba5e8a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:19.392922 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2049/4136] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:19.399118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fbef46b3144818824a7475e453fb2d, user_id=692b185c70774449b75974b109118cd0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:19.406710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:19.462721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:19.463220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:19.463709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:19.470860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2088/4137] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:19 2022] PUT /identity/v3/projects/61fbef46b3144818824a7475e453fb2d/users/692b185c70774449b75974b109118cd0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:19.597081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:19.599775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:19.882862 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2050/4138] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:20.030150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:20.033339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:20.231915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e4662-19d1-4bc4-8581-e24a26a73746 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:20.258890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:20.259745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:20.260026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:20.260298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:20.289485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:20.291094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:20.329406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2089/4139] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:20.763208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:20.766087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:20.795968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e465d1-2eb8-4611-8820-86dd3b5c54fe None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:20.823037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:20.824237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:20.824696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:20.825291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] PATH_INFO: `/v3/projects/43e6b10a125f4203878aedeac53be67a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:20.828787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e6b10a125f4203878aedeac53be67a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:20.836233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:20.877155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:21.041392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e6b10a125f4203878aedeac53be67a', 'request_id': 'req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.057170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e6b10a125f4203878aedeac53be67a', 'request_id': 'req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.070061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e6b10a125f4203878aedeac53be67a', 'request_id': 'req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.089793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] The token cache is being invalidate because project 43e6b10a125f4203878aedeac53be67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:21.090442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.092081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.095159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2051/4140] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:20 2022] DELETE /identity/v3/projects/43e6b10a125f4203878aedeac53be67a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:21.100793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:21.118920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfd48e-0831-47db-8ad8-4549ea8e127f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:21.236142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:21.237204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:21.237385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:21.237791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] PATH_INFO: `/v3/users/5bbabe6143504c3e9a8f9d1a89b4f10f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:21.239146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbabe6143504c3e9a8f9d1a89b4f10f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:21.241616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:21.251543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:21.346087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbabe6143504c3e9a8f9d1a89b4f10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.361225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbabe6143504c3e9a8f9d1a89b4f10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.361960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbabe6143504c3e9a8f9d1a89b4f10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.372262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbabe6143504c3e9a8f9d1a89b4f10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.373356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbabe6143504c3e9a8f9d1a89b4f10f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:21.434011 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2090/4141] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:21 2022] DELETE /identity/v3/users/5bbabe6143504c3e9a8f9d1a89b4f10f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:22.079435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:22.084847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:22.112467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9970cf-a95c-4d3a-bd92-3f7c50f15859 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:22.199255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:22.200760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:22.201343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:22.201717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] PATH_INFO: `/v3/projects/b3c32c8a1362436a8b74375a9be8fb57` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:22.203035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c32c8a1362436a8b74375a9be8fb57)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:22.204984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:22.280235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c32c8a1362436a8b74375a9be8fb57', 'request_id': 'req-702c3274-9558-4ca1-a0b4-79ef169ca2e4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.291290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c32c8a1362436a8b74375a9be8fb57', 'request_id': 'req-702c3274-9558-4ca1-a0b4-79ef169ca2e4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.311084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c32c8a1362436a8b74375a9be8fb57', 'request_id': 'req-702c3274-9558-4ca1-a0b4-79ef169ca2e4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.357281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] The token cache is being invalidate because project b3c32c8a1362436a8b74375a9be8fb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:22.358074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.360671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.366156 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2052/4142] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:22 2022] DELETE /identity/v3/projects/b3c32c8a1362436a8b74375a9be8fb57 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:22.368349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:22.371156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:22.393238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481c7eb-56f2-4168-8ba2-67ab2fff0868 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:22.480040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:22.480870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:22.481238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:22.481537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] PATH_INFO: `/v3/users/1068e27e5bb44d48a90e0e76d20109b1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:22.482918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1068e27e5bb44d48a90e0e76d20109b1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:22.485228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:22.548274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1068e27e5bb44d48a90e0e76d20109b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.568665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1068e27e5bb44d48a90e0e76d20109b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.569825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1068e27e5bb44d48a90e0e76d20109b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.589319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1068e27e5bb44d48a90e0e76d20109b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.590682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c1fc582-2ece-4d57-ae33-a6f354b8adcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1068e27e5bb44d48a90e0e76d20109b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:22.626827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2091/4143] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:22 2022] DELETE /identity/v3/users/1068e27e5bb44d48a90e0e76d20109b1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:23.724854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:23.730675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:23.771331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3274-9558-4ca1-a0b4-79ef169ca2e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:23.843887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:23.883526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:23.884795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:23.885220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:23.885908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] PATH_INFO: `/v3/projects/1feaa5288fda4f03be4e6ce739c0146a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:23.887361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1feaa5288fda4f03be4e6ce739c0146a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:23.892784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.015280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1feaa5288fda4f03be4e6ce739c0146a', 'request_id': 'req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:24.032431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1feaa5288fda4f03be4e6ce739c0146a', 'request_id': 'req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:24.047233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1feaa5288fda4f03be4e6ce739c0146a', 'request_id': 'req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:24.084510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] The token cache is being invalidate because project 1feaa5288fda4f03be4e6ce739c0146a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:24.085306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:24.086782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-35de4587-f6f9-4e7d-bc3c-87d5c95837fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:24.089692 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2053/4144] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:23 2022] DELETE /identity/v3/projects/1feaa5288fda4f03be4e6ce739c0146a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:24.099836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.100521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.101545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.132386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:24.160492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:24.163118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:24.330173 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2092/4145] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:24.339073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.339404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.339848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.401973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:24.405956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:24.423454 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2054/4146] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:24.447714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:24.466081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d685-5883-45e0-857a-bcdbc49d74e7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:24.474489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:24.477024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.477628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.478039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.479613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:24.480163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:24.483613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.514352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2093/4147] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:21:24.520539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:24.547591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689193dd-2780-4b66-aca7-7ad792ce865b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:24.578429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:24.579083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.579368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.579638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.580293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:24.582321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.647348 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2055/4148] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:24 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:24.649900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:24.675755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5c7e6-e1b8-4717-8942-8fda3f68413e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:24.811757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:24.814027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.814584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.815095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.816044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:24.827474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.859636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2094/4149] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:24 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:24.861487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:24.876600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0381da-148d-4ce5-890d-3ea1bf7fb4b0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:24.884420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:24.885984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.885984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.886811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.887619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:24.892314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.910741 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2056/4150] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:24.912423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:24.952207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d57b7-e442-4e19-8036-d4cd2c0c5f0d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:24.965639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:24.967483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:24.968187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:24.968696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:24.969616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:24.971464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9aa7-b6db-4144-9b68-b3bb08e4020d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:24.992415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2095/4151] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:24.994797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.009975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67398072-83ec-4b9e-ae9f-0e476c45351b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:25.018524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:25.019454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.020092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.020471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] PATH_INFO: `/v3/projects/b49e88d521e241b9ba0ca9b6852cb3ad/users/bcb204b4f40545729236cc1c32c194a2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.046741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49e88d521e241b9ba0ca9b6852cb3ad, user_id=bcb204b4f40545729236cc1c32c194a2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:25.050363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:25.072396 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2057/4152] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:24 2022] PUT /identity/v3/projects/b49e88d521e241b9ba0ca9b6852cb3ad/users/bcb204b4f40545729236cc1c32c194a2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:21:25.086800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.089266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.090371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.183262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] MFA Rules not processed for user `bcb204b4f40545729236cc1c32c194a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:25.195196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:25.346905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:25.361497 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2096/4153] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:25.362341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.492672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685076-b90b-4e21-a5fd-738e3991083b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:25.500848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:25.501987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.502460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.503017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.504134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:25.509582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:25.517802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:25.568083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2058/4154] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:25 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:21:25.578518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.592840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2b7fa-c4eb-4042-ac73-79fe4e6ba463 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:25.755539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:25.756951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.757497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.758039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.759347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:25.764229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:25.799791 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2097/4155] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:25 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:21:25.803507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.829680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbb28-b315-4e1b-b2db-258df1eac376 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:25.837740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:25.838766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.840370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.841133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.842117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:25.844452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:25.859294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2059/4156] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:21:25.869263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.899221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5d93e-ea4e-41b4-80bd-e194f06e3874 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:25.908766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:25.910246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:25.910791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:25.911631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] PATH_INFO: `/v3/projects/b28ef6e617e741f69ba38834fb579ead/users/37a078afd2eb485a97fcdb85b3204bf2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:25.939200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ef6e617e741f69ba38834fb579ead, user_id=37a078afd2eb485a97fcdb85b3204bf2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:25.943934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:25.963372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2098/4157] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:25 2022] PUT /identity/v3/projects/b28ef6e617e741f69ba38834fb579ead/users/37a078afd2eb485a97fcdb85b3204bf2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:25.970555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:25.986417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb297-44d6-4fbf-aaf5-bc2bd2a64873 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:26.080747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:26.081520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:26.081822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:26.082343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:26.083347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:26.085383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055c3cf-1f88-4278-b755-0cd7d46782cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:26.115451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2060/4158] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:26.120161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:26.133247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67db84f-37a3-482d-ad6d-e46fb3b0b9da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:26.140956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:26.142331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:26.142616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:26.142889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] PATH_INFO: `/v3/projects/b28ef6e617e741f69ba38834fb579ead/users/37a078afd2eb485a97fcdb85b3204bf2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:26.144983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ef6e617e741f69ba38834fb579ead, user_id=37a078afd2eb485a97fcdb85b3204bf2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:26.150686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:26.173044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2099/4159] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:26 2022] PUT /identity/v3/projects/b28ef6e617e741f69ba38834fb579ead/users/37a078afd2eb485a97fcdb85b3204bf2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:26.180537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:26.180873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:26.181132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:26.223268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] MFA Rules not processed for user `37a078afd2eb485a97fcdb85b3204bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:26.224708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:26.380503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2061/4160] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:26.392447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:26.394307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:26.477964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ccee-117f-40d4-bf4f-377647873c70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:26.485758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:26.486451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:26.486727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:26.486990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:26.504409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:26.506940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:26.521689 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2100/4161] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:27.526165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:27.527951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:27.724173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f794c-e55c-4ff0-a7e1-d603a6dc91ee None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:27.737902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:27.738756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:27.753437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:27.753437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:27.753437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:27.787681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:27.902662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:27.969593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:27.971834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:27.994185 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2062/4162] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:28.051225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:28.058935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa390-b041-4bbb-a1b8-0b8fb8848457 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:28.079150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:28.080902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:28.081349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:28.081720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] PATH_INFO: `/v3/users/bcb204b4f40545729236cc1c32c194a2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:28.086963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb204b4f40545729236cc1c32c194a2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:28.088749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:28.103357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:28.105125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:28.174986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb204b4f40545729236cc1c32c194a2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:28.185326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb204b4f40545729236cc1c32c194a2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:28.186579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb204b4f40545729236cc1c32c194a2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:28.199294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb204b4f40545729236cc1c32c194a2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:28.200381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7696d15c-c865-4edc-ad8e-ddcb497a03ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb204b4f40545729236cc1c32c194a2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:28.218005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f183fd-ba7e-43a1-99b7-7c45a71495fb service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:28.239192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:28.240136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:28.248743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:28.250234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:28.260122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:28.274662 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2101/4163] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:27 2022] DELETE /identity/v3/users/bcb204b4f40545729236cc1c32c194a2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:21:28.279312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:28.279602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:28.279880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:28.286005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:28.289780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:28.308258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2063/4164] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:21:28.322503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:28.324879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:28.516651 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2102/4165] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:28.526225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:28.530522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:28.551042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b81ca-053b-467e-85b8-0e8078147749 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:28.649185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:28.660933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:28.660933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:28.660933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:28.672426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:28.674046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:28.692554 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2064/4166] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:29.710596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:29.719841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.017062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936d7e3-97d3-45cd-8d45-d3ab5998b849 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:30.017250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:30.019007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.027742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:30.028804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:30.029632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:30.030240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:30.033087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.064378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67aacec-0c38-497f-be8d-7a7e4ce22865 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:30.077950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:30.079559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b398d53-a17f-44e3-8555-8b80414a0f63 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:30.086157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:30.086819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:30.087099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:30.087371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] PATH_INFO: `/v3/projects/b49e88d521e241b9ba0ca9b6852cb3ad` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:30.101604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:30.101984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49e88d521e241b9ba0ca9b6852cb3ad)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:30.104158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:30.113490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2103/4167] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:30.146489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:30.147194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:30.147612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:30.207599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] MFA Rules not processed for user `692b185c70774449b75974b109118cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:30.209965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.224426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:30.235894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49e88d521e241b9ba0ca9b6852cb3ad', 'request_id': 'req-f2350d01-cc2d-4271-941a-492e1fb8ca36'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.274172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49e88d521e241b9ba0ca9b6852cb3ad', 'request_id': 'req-f2350d01-cc2d-4271-941a-492e1fb8ca36'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.285996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49e88d521e241b9ba0ca9b6852cb3ad', 'request_id': 'req-f2350d01-cc2d-4271-941a-492e1fb8ca36'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.323367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] The token cache is being invalidate because project b49e88d521e241b9ba0ca9b6852cb3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:30.324085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.327807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.331695 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2065/4168] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:30 2022] DELETE /identity/v3/projects/b49e88d521e241b9ba0ca9b6852cb3ad => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:30.336166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:30.340481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.399924 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2104/4169] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:30.570911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2350d01-cc2d-4271-941a-492e1fb8ca36 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:30.581409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:30.581676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:30.581952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:30.582234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] PATH_INFO: `/v3/users/37a078afd2eb485a97fcdb85b3204bf2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:30.583838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a078afd2eb485a97fcdb85b3204bf2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:30.586331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:30.696132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a078afd2eb485a97fcdb85b3204bf2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.696894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a078afd2eb485a97fcdb85b3204bf2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.709343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a078afd2eb485a97fcdb85b3204bf2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.713447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a078afd2eb485a97fcdb85b3204bf2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.734452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a078afd2eb485a97fcdb85b3204bf2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:30.771568 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2066/4170] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:30 2022] DELETE /identity/v3/users/37a078afd2eb485a97fcdb85b3204bf2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:30.834813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:30.836652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:30.947654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9f4f3-fdaa-40b7-b1bd-66e4dc4a4ce3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:31.051121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:31.053241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.054816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.055418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.058214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:31.180274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:31.184581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:31.188627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad1691-de5a-4185-8fa2-5f13553a8389 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:31.210139 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2105/4171] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:21:31.216362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:31.219222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:31.245604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c38307-0baa-4043-94b0-763dd3f526d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:31.252749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:31.253936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.254562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.255937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] PATH_INFO: `/v3/projects/b28ef6e617e741f69ba38834fb579ead` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.257618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28ef6e617e741f69ba38834fb579ead)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:31.260341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:31.350217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:31.368896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28ef6e617e741f69ba38834fb579ead', 'request_id': 'req-591a085c-9746-43ba-b379-ed97c01dc6c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:31.382627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28ef6e617e741f69ba38834fb579ead', 'request_id': 'req-591a085c-9746-43ba-b379-ed97c01dc6c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:31.395260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28ef6e617e741f69ba38834fb579ead', 'request_id': 'req-591a085c-9746-43ba-b379-ed97c01dc6c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:31.414114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] The token cache is being invalidate because project b28ef6e617e741f69ba38834fb579ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:31.414658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:31.415793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-591a085c-9746-43ba-b379-ed97c01dc6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:31.423441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2067/4172] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:31 2022] DELETE /identity/v3/projects/b28ef6e617e741f69ba38834fb579ead => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:31.429074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.429365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.429641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.457169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:31.458478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:31.658326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.658782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.659120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.663986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2106/4173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:31.690182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:31.691481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:31.714294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:31.724979 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2068/4174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:31.727337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf953-4b54-4acf-9421-4d037fb6828c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:31.738928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:31.739577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.739859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.740897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.741191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:31.741468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:31.743139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:31.774911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2107/4175] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:21:31.778440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:31.796686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d43228-9826-48c1-87ae-c1c6ff649305 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:31.814012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:31.814660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.814942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.815217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:31.816191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:31.819138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ed25b-8190-43b7-806b-016ab5cc7580 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:31.911199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:31.911937 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2069/4176] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:31 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:31.942897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589d2b4-8dfd-48b4-bcd2-0836248e83b8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:31.991726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:31.992078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:31.992276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.107728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:32.108814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.108814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.109338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.109577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:32.112672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:32.158457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2108/4177] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:31 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:32.164012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:32.191203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc7b2a-d9af-40ec-8c96-cf619bdeb047 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:32.202685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:32.211224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:32.211849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.212390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.212667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.212825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:32.213489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:32.214992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:32.270537 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2109/4178] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:32.428249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2070/4179] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:32.440743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:32.460228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e61b08-8877-4582-9ca0-d30143feeaf1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:32.460503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:32.464935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:32.465450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:32.466847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.467264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.467538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.468202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:32.469868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:32.482714 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2110/4180] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:32.488629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:32.512300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bf79d-ef1a-4f82-aaa0-acbc0165e551 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:32.540067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:32.541358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.541922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.542495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] PATH_INFO: `/v3/projects/fad51e0fdee048ec85bafa28cd4b7c8a/users/f8a4c7e2cf5e45b3b2f37632f003fa91/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.576182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad51e0fdee048ec85bafa28cd4b7c8a, user_id=f8a4c7e2cf5e45b3b2f37632f003fa91, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:32.579247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d3926-1fbb-4d3d-9826-3d54bb109688 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:32.628956 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2111/4181] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:32 2022] PUT /identity/v3/projects/fad51e0fdee048ec85bafa28cd4b7c8a/users/f8a4c7e2cf5e45b3b2f37632f003fa91/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:32.650260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.650754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.651240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.683688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842ed3-1875-4787-90fb-b1a1c808a99f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:32.697152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:32.775354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] MFA Rules not processed for user `f8a4c7e2cf5e45b3b2f37632f003fa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:32.777651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:32.784743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:32.787753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:32.788324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:32.788961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:32.816520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:32.971377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:32.973525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff83434-2e27-48d1-bf94-1984ede260aa service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:32.983032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2112/4182] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:32.984071 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2071/4183] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:33.000000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:33.005098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:33.120668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ccc2-bfae-4f17-a22e-6d9a0cc24c08 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:33.133881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:33.135166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:33.137321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:33.137732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:33.167267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:33.174041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:33.222050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2113/4184] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:38.277977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:38.278690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:38.278690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:38.362859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:38.373763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:38.779085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2072/4185] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:41.068606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:41.071533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:41.248447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7913e-98aa-4092-adb0-af0c9e2aaf76 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:41.269363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:41.269363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:41.269363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:41.269363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:41.270631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:41.292712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:41.297867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:41.331353 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2114/4186] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:21:41.348543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:41.351110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:41.445884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78920d9-0821-490e-bc20-ec04baddca04 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:41.478140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:41.478925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:41.479347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:41.479691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:41.488421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:41.521948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:41.523510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:41.547865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:41.549746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:41.645966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:41.648606 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2073/4187] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:41.678303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e53319-f3f3-4167-8db3-2c9c7c9b3c06 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:41.689370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:41.691239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:41.691500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:41.693806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] PATH_INFO: `/v3/users/692b185c70774449b75974b109118cd0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:41.694719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692b185c70774449b75974b109118cd0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:41.698984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:41.823110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692b185c70774449b75974b109118cd0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:41.842789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692b185c70774449b75974b109118cd0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:41.843491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692b185c70774449b75974b109118cd0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:41.866930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692b185c70774449b75974b109118cd0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:41.870629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692b185c70774449b75974b109118cd0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:41.919923 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2115/4188] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:41 2022] DELETE /identity/v3/users/692b185c70774449b75974b109118cd0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:21:42.031502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:42.032538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:42.057247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d27c4f-4217-492b-9a45-67cb72ba1784 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:42.159685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:42.194972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:42.195642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:42.195919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:42.196192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] PATH_INFO: `/v3/users/70ac3d341e8444fda9964798e94f0d16` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:42.197595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ac3d341e8444fda9964798e94f0d16)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:42.199692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:42.354333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ac3d341e8444fda9964798e94f0d16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:42.357542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ac3d341e8444fda9964798e94f0d16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:42.385016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ac3d341e8444fda9964798e94f0d16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:42.388737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ac3d341e8444fda9964798e94f0d16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:42.422075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ac3d341e8444fda9964798e94f0d16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:42.503638 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2074/4189] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:21:42 2022] DELETE /identity/v3/users/70ac3d341e8444fda9964798e94f0d16 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:42.710737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:42.712751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:42.740018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933567c-00cc-4098-a76d-8e985dea03a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:42.948137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:42.949014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:42.949505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:42.949771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] PATH_INFO: `/v3/projects/61fbef46b3144818824a7475e453fb2d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:42.951759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61fbef46b3144818824a7475e453fb2d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:42.954767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:42.990305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:42.992147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:43.022304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06666a03-d338-4e41-b7b1-bd9cd73573ca admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:43.034683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:43.036658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.043079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.046073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] PATH_INFO: `/v3/projects/95df9210b0dd484abf991849367a2c16` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.049423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95df9210b0dd484abf991849367a2c16)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:43.053143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:43.077312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61fbef46b3144818824a7475e453fb2d', 'request_id': 'req-7c047cd6-5bfb-40ad-a512-c6280a4b378f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.095711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61fbef46b3144818824a7475e453fb2d', 'request_id': 'req-7c047cd6-5bfb-40ad-a512-c6280a4b378f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.129309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61fbef46b3144818824a7475e453fb2d', 'request_id': 'req-7c047cd6-5bfb-40ad-a512-c6280a4b378f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.166625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:43.188035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] The token cache is being invalidate because project 61fbef46b3144818824a7475e453fb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:43.188410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.190294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c047cd6-5bfb-40ad-a512-c6280a4b378f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.209303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2116/4190] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:42 2022] DELETE /identity/v3/projects/61fbef46b3144818824a7475e453fb2d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:43.214719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845349a-a0d7-41eb-8c3e-caa32ce8b8b4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.215010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845349a-a0d7-41eb-8c3e-caa32ce8b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.215304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845349a-a0d7-41eb-8c3e-caa32ce8b8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.235865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95df9210b0dd484abf991849367a2c16', 'request_id': 'req-598143b4-8968-475f-b4e5-485d1d235e00'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.262483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95df9210b0dd484abf991849367a2c16', 'request_id': 'req-598143b4-8968-475f-b4e5-485d1d235e00'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.280008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3845349a-a0d7-41eb-8c3e-caa32ce8b8b4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:43.281349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3845349a-a0d7-41eb-8c3e-caa32ce8b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:43.284068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95df9210b0dd484abf991849367a2c16', 'request_id': 'req-598143b4-8968-475f-b4e5-485d1d235e00'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.307366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] The token cache is being invalidate because project 95df9210b0dd484abf991849367a2c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:21:43.307683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.309211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-598143b4-8968-475f-b4e5-485d1d235e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:21:43.313521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2075/4191] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:21:42 2022] DELETE /identity/v3/projects/95df9210b0dd484abf991849367a2c16 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:21:43.318936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300d9a-3976-4c0d-986a-197f04d991db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.319455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300d9a-3976-4c0d-986a-197f04d991db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.319896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300d9a-3976-4c0d-986a-197f04d991db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.393037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-55300d9a-3976-4c0d-986a-197f04d991db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:43.394670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55300d9a-3976-4c0d-986a-197f04d991db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:43.470607 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2117/4192] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:21:43.480744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.481306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.481759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.511909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:43.513979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:43.524066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2118/4193] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:43.529797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:43.543321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec44d7-fc5b-4e77-87cf-a3469da14f20 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:43.549437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:43.550556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.550938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.551303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.552073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:43.552473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:43.554258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:43.581062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2119/4194] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:21:43.583045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:43.618632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:43.642390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc854bc-3b02-427c-a0c2-4bb3bc2e6ece admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:43.649953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:43.652112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.652740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.654333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.655553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:43.657685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:43.699442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2076/4195] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:43.710717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.711010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.711283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.734470 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2120/4196] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:43.736658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:43.832976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:43.837658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:43.974911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee8cb1-53ea-4f32-8042-725214bbf109 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:43.983440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:43.984412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:43.984714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:43.985318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:43.986120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:43.988628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.040893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2121/4197] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:21:44.042007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.072413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338310-9669-4eb8-8d86-e6ee080c090b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.076423 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2077/4198] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:44.081539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.088978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.089636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.089920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.090195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.092143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.097507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.099756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d0976-4170-46c2-b64a-d08998825fa5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.116729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.117549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.117920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.118281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.119065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:21:44.119440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.121308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.124907 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2122/4199] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:44.130945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.146316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2078/4200] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:21:44.147986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.167220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10409a-e4ac-4e51-9305-655d25ab3649 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.167743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577bd3d-ee58-4524-bf15-03c6bbedab5e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.175940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.177584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.178186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.178609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.179778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.183605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.187733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.188562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.188790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.189082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.189929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.195259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.243890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2123/4201] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:44.245047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.247621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2079/4202] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:21:44 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:44.248975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.268723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc829d2-fdf1-47da-a5b9-0e475f726f25 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.394486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:44.432710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2841d-10fe-4363-be3a-08d36a7fd7e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.445987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.448563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.449240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.449795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.454863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.458184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.513330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2080/4203] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:21:44 2022] POST /identity/v3/users => generated 303 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:21:44.520411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.543152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.543900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.544617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e796ef-f111-4a52-ae8c-1953e7210b6a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.546745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.547790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] PATH_INFO: `/v3/projects/238c6a4d6aa046c6becaba98873f63fc/users/08b0514cd6004596969d5d5caf689179/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.561721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.562838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.563505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.563901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.567493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.571502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.617232 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2081/4204] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:44.617232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.627449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238c6a4d6aa046c6becaba98873f63fc, user_id=08b0514cd6004596969d5d5caf689179, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.631149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afae28-0250-4fda-b686-e5c1dd41e3a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.632104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4206e0-c5f4-47a6-9349-25ddf9a4238d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.644103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:44.645075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.645336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.645690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.646388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:44.650715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:44.671869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2124/4205] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:44 2022] PUT /identity/v3/projects/238c6a4d6aa046c6becaba98873f63fc/users/08b0514cd6004596969d5d5caf689179/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:44.679962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:44.680570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:44.681056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:44.723453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2082/4206] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:21:44.726720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:44.731048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:44.734861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:44.759366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a91b63-ece5-4f97-a93a-4da7d7d90ef5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:44.840553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:45.046059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2125/4207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:45.061018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:45.061823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:45.062099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:45.062373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] PATH_INFO: `/v3/projects/9599b689baf44de59137f3412a88577f/users/04835125a13745349ea6709f44f0cebf/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:45.062512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:45.063870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:45.112357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9599b689baf44de59137f3412a88577f, user_id=04835125a13745349ea6709f44f0cebf, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:45.115542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4161b-d52b-4a5c-a6ba-f63b79a6d787 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:45.154512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2083/4208] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:21:44 2022] PUT /identity/v3/projects/9599b689baf44de59137f3412a88577f/users/04835125a13745349ea6709f44f0cebf/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:21:45.160201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:45.160906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:45.161494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:45.212637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:45.219349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:45.310123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db2cdc-1bba-404c-a212-acac532d3503 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:45.453783 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2084/4209] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:21:45.495778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:45.498859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:45.523446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:45.526226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:45.526484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:45.526720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:45.579894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:45.582568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:45.654298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2126/4210] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:45.698531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee098826-7c3d-4f58-bde1-de00c440b614 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:45.729423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:45.732582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:45.739233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:45.740879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:45.799979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:45.802058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67a72f-1033-4477-acd7-26641bfe3a61 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:45.845380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2085/4211] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:47.240023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:47.241702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:47.266896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:47.385582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7ef55-9992-4c53-a3f3-6c1a5cc7a8f7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:47.398569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:47.399354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:47.399666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:47.399986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:47.405704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:47.586992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:47.588505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:47.614521 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2127/4212] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:54.885986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d7e5-4ecc-49db-8332-067d2f223e72 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:54.886586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d7e5-4ecc-49db-8332-067d2f223e72 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:54.886586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9d7e5-4ecc-49db-8332-067d2f223e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:54.945032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f7c9d7e5-4ecc-49db-8332-067d2f223e72 None None] MFA Rules not processed for user `08b0514cd6004596969d5d5caf689179`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:54.946254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f7c9d7e5-4ecc-49db-8332-067d2f223e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:55.053572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:55.093403 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2086/4213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:55.112456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:55.115026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:55.287780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5fe94-ec70-4a81-b0a5-a6e074aa23b3 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:55.303024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:55.303731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:55.304081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:55.304356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:55.329926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:55.331525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:55.385936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2128/4214] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:21:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:21:55.824769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebffba-65b4-4f05-b379-09a378fc70a9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:55.830543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebffba-65b4-4f05-b379-09a378fc70a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:55.832576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebffba-65b4-4f05-b379-09a378fc70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:55.936313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-19ebffba-65b4-4f05-b379-09a378fc70a9 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:55.943381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19ebffba-65b4-4f05-b379-09a378fc70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:56.145965 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2087/4215] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:21:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:56.176752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:21:56.179031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:56.337161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:21:56.410038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049281-d34d-4ebb-ba1d-63de2f1a20d3 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:21:56.423215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:21:56.423908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:56.424188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:56.424459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:56.466048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:21:56.468310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30b22b-6e78-4386-a7e6-7250a78a131c service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:21:56.482322 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2129/4216] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:21:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:21:59.799442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:59.802002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:59.802611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:59.826233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:21:59.826793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:21:59.826793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:21:59.867805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] MFA Rules not processed for user `08b0514cd6004596969d5d5caf689179`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:59.869508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:21:59.888340 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2088/4217] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:21:59.946105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] MFA Rules not processed for user `04835125a13745349ea6709f44f0cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:21:59.948777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:00.126618 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2130/4218] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:22:00.132590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:00.173553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f68bc8-f855-4b29-810f-83be0b83a656 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:00.191938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:00.193511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:00.197115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:00.197781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:00.198958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:00.201772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:00.250094 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2089/4219] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:22:00 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:22:00.255024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:00.274341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53adbc-c7db-42c5-bc99-2df2a2d36dcd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:00.404221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:00.405034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:00.405418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:00.405741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:00.406415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:00.408401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:00.462323 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2131/4220] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:22:00 2022] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:22:00.464467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:00.496126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2ec3-7e5b-4725-92ab-3de4b14e60d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:00.503958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:00.504841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:00.505356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:00.505702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:00.506490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:00.508130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:00.550007 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2090/4221] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:22:00.552372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:00.589018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cb511-7ded-415e-a5a8-4bf9a6b2126d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:00.617173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:00.617796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:00.618074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:00.623058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:00.626076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:00.644283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:00.729067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:00.729273 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2132/4222] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:22:00.743784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1194f-434d-4459-9698-1d1c5c1afae7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:00.759855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:00.760872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:00.761386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:00.761862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] PATH_INFO: `/v3/projects/d22ddab1f1244cc1b07e9f1cd9d3ef5d/users/f25c575f2f9444c9a02df81a363eea39/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:00.798239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22ddab1f1244cc1b07e9f1cd9d3ef5d, user_id=f25c575f2f9444c9a02df81a363eea39, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:00.801177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7606e4c-5e61-4cf8-a0bc-49037b074e9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:00.826979 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2091/4223] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:22:00 2022] PUT /identity/v3/projects/d22ddab1f1244cc1b07e9f1cd9d3ef5d/users/f25c575f2f9444c9a02df81a363eea39/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:22:05.333153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:05.469590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:05.534649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f9d3-f62a-4ff8-a604-92b2dff9df8e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:05.720486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:05.721343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:05.721770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:05.722190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:05.724586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:05.867506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:05.869667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:05.906596 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2133/4224] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:06.898077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:06.898744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:06.898744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:06.942527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:06.951024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:07.170656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2092/4225] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:22:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:22:07.183635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:07.209286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb6694-2c14-40c1-bb83-6c14a4df8c16 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:07.225706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:07.226716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:07.227244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:07.227723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:07.254843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:07.256822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:07.277282 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2134/4226] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:07.673252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:07.749115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:07.943869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0710-3884-474a-912e-81ff9f795cd8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:07.969583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:07.971286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:07.971766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:07.972220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:07.974275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:07.994302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:07.998066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c365-12bc-434b-a6fb-18c3952bba29 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:08.030978 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2093/4227] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:13.692644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:13.885627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e77ff-cb60-42d4-a3a5-3fb740beeacd service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:13.900973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:13.901676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:13.902022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:13.902332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:13.906856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:13.943130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:13.949355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94b6ac-ba40-4262-8969-ee8aad16658a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:14.002093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2135/4228] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:17.768670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:17.769286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:17.770142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:17.925506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] MFA Rules not processed for user `f25c575f2f9444c9a02df81a363eea39`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:17.932565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:18.351298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:18.351849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:18.351849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:18.353085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2094/4229] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:22:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:22:18.405596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] MFA Rules not processed for user `04835125a13745349ea6709f44f0cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:18.409081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:18.488939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:18.632979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2136/4230] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:22:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:22:18.643721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:18.674938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a4f2d-7cae-48a7-a68c-36a5faf92413 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:18.696252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:18.697155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:18.697548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:18.698295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:18.723722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:18.735937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fff1d-45d0-49f7-ad12-564648d2d2de service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:18.756362 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2095/4231] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:19.302110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:19.327596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618bc7b-e6fd-47ca-9d57-d8f18b1db4c3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:19.334032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:19.334686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:19.334968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:19.335243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:19.344079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:19.383227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:19.388003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:19.448636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2137/4232] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:28.750911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=61 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:29.420895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=23 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:22:40.953538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:40.954094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:40.954094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:40.976331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:40.977582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:40.994400 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2096/4233] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:22:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:22:41.018031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:41.032440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0922-5fd7-47c4-a48f-b881d050279e service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:41.039407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:41.040566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:41.040939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:41.041471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:41.053198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:41.054907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:41.067966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2138/4234] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:22:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:22:42.574460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:42.595591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6ce26-d43a-403c-a7cd-f22aa9279682 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:42.606646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:42.608324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:42.608868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:42.609514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:42.623690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:42.625899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:42.678037 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2097/4235] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:42 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:43.308845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:43.329488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd76ae0-7043-4a15-9b1b-b4f8bd6a3da2 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:43.364539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:43.370604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:43.371159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:43.371709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:43.374174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:43.402144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:43.404516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d2157-fbcc-4d7b-ab85-0ea212c40bb7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:43.438390 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2139/4236] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:49.295952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:22:49.316660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833e76-1593-49fa-a6d1-cdfa55c055dc service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:22:49.324013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:22:49.324866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:49.325324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:49.325746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:49.327780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:49.465370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:22:49.467127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455b4a1-2789-42d0-8f6b-caf5e5d7050f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:22:49.475421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:49.476421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:49.477467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:49.506239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2098/4237] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:22:49.534695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] MFA Rules not processed for user `a51c470236904eb0a85bfee1703d3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:49.536255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:49.675398 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2140/4238] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:22:58.076139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8845a92-7b14-4290-bb80-09685ba98a65 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:22:58.076780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8845a92-7b14-4290-bb80-09685ba98a65 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:22:58.076780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8845a92-7b14-4290-bb80-09685ba98a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:22:58.125131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d8845a92-7b14-4290-bb80-09685ba98a65 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:22:58.130081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d8845a92-7b14-4290-bb80-09685ba98a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:22:58.357086 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2099/4239] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:22:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:22:59.661482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=37 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:03.347229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:03.349718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:03.709936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6696a5-bed4-4e9c-8346-13103d0aec38 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:03.739672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:03.740314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:03.740588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:03.741076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:03.755846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:03.789652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:03.792367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:03.820862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2141/4240] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:04.060013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:04.060548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:04.061875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:04.091586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:04.093883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:04.102204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2100/4241] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:07.660046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:07.662313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:07.690338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16069e5e-2607-44cb-ae60-7a14dede9af4 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:07.710763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:07.714714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:07.715871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:07.716564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] PATH_INFO: `/v3/users/1cc60ef5fff74c2eab3f81450c33a4e7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:07.719633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc60ef5fff74c2eab3f81450c33a4e7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:07.723508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:07.803024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc60ef5fff74c2eab3f81450c33a4e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:07.820795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc60ef5fff74c2eab3f81450c33a4e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:07.821860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc60ef5fff74c2eab3f81450c33a4e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:07.833390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc60ef5fff74c2eab3f81450c33a4e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:07.834301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-846b7749-91e9-4ba7-a7ea-feebae52992d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc60ef5fff74c2eab3f81450c33a4e7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:07.876454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2142/4242] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:07 2022] DELETE /identity/v3/users/1cc60ef5fff74c2eab3f81450c33a4e7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:08.245535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:08.275936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fab7b3-38b7-47f7-a38b-1f7c34500ff7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:08.370582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:08.371247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:08.371737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:08.372168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] PATH_INFO: `/v3/projects/9aec8b651e6d4b89bd98c593b6e932a2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:08.374690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aec8b651e6d4b89bd98c593b6e932a2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:08.377423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:08.423051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:08.464736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aec8b651e6d4b89bd98c593b6e932a2', 'request_id': 'req-1c100c0f-0a21-40dd-9639-a091505b1d6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:08.474877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aec8b651e6d4b89bd98c593b6e932a2', 'request_id': 'req-1c100c0f-0a21-40dd-9639-a091505b1d6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:08.483948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aec8b651e6d4b89bd98c593b6e932a2', 'request_id': 'req-1c100c0f-0a21-40dd-9639-a091505b1d6e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:08.499494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] The token cache is being invalidate because project 9aec8b651e6d4b89bd98c593b6e932a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:08.500254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:08.500959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1c100c0f-0a21-40dd-9639-a091505b1d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:08.502931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2101/4243] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:08 2022] DELETE /identity/v3/projects/9aec8b651e6d4b89bd98c593b6e932a2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:08.508511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:08.509055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:08.509523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:08.555403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:08.557594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:08.735434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2143/4244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:08.736972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:08.737176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:08.737454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:08.781052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:08.782631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:08.803900 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2102/4245] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:08.809153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:08.815208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:08.822315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5106ca-c880-435a-8e12-abb53c5cabc0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:08.829318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:08.830280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:08.830651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:08.830978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:08.832143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:08.832609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:08.834339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:08.861067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2144/4246] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:08.862092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:08.873737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1ca2-c01c-464d-b928-44b0e26e9f53 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:08.881359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:08.882446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:08.883202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:08.883565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:08.884346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:08.887401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:08.929819 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2103/4247] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:08 2022] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:08.930294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:08.942525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4978297-8164-4300-bb88-5ed3e633c3cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:09.070565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:09.072141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:09.072529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:09.073134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:09.073767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:09.076084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:09.118822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2145/4248] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:08 2022] POST /identity/v3/users => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:09.120882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:09.135517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384821a8-ed43-4b3a-a7e4-756a36f53a95 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:09.142567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:09.144691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:09.145575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:09.146058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:09.147483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:09.150209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:09.170608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:09.171444 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2104/4249] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:09.201378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31809b0b-0779-4854-8ee1-9273e37db902 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:09.218240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:09.219345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:09.219900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:09.221287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:09.222269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:09.228771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2e372-1fe7-4a08-8870-b3bba2497604 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:09.256408 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2146/4250] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:09.260977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:09.274215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28133-4cc2-4cdc-84ce-f46152dc7963 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:09.294513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:09.296788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:09.298674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:09.299136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] PATH_INFO: `/v3/projects/49b0a34573ee48caa68a86216286b7b0/users/bf27e810d6fb4259bfc3fd53442490fc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:09.376187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b0a34573ee48caa68a86216286b7b0, user_id=bf27e810d6fb4259bfc3fd53442490fc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:09.388033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:09.456179 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2105/4251] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:09 2022] PUT /identity/v3/projects/49b0a34573ee48caa68a86216286b7b0/users/bf27e810d6fb4259bfc3fd53442490fc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:09.458881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:09.458881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:09.458881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:09.542881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] MFA Rules not processed for user `bf27e810d6fb4259bfc3fd53442490fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:09.544225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:09.766529 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2147/4252] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:09.910255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:09.920318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:10.039092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ee079-4793-43d8-aa99-59101a0c360d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:10.053501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:10.054137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:10.054417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:10.054685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:10.078416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:10.080063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:10.127335 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2106/4253] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:10.549514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:10.552169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:10.715518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:10.725505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa21104-7d09-4599-b086-8050e1c148c4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:10.732080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:10.733147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:10.733670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:10.734774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] PATH_INFO: `/v3/users/04835125a13745349ea6709f44f0cebf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:10.737568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04835125a13745349ea6709f44f0cebf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:10.739996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:10.929114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04835125a13745349ea6709f44f0cebf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:10.957671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:10.968380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04835125a13745349ea6709f44f0cebf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:10.969302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04835125a13745349ea6709f44f0cebf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:10.989196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60872056-4ffe-418a-8a87-045d63c81212 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:11.000675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04835125a13745349ea6709f44f0cebf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.003835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c33c0f30-bf9f-47b1-a50d-5569e539d51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04835125a13745349ea6709f44f0cebf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.011561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:11.013612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:11.015120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:11.015633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] PATH_INFO: `/v3/users/bf27e810d6fb4259bfc3fd53442490fc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:11.018377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf27e810d6fb4259bfc3fd53442490fc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:11.024595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:11.066477 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2148/4254] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:10 2022] DELETE /identity/v3/users/04835125a13745349ea6709f44f0cebf => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:11.091834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:11.141301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf27e810d6fb4259bfc3fd53442490fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.142166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf27e810d6fb4259bfc3fd53442490fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.157080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf27e810d6fb4259bfc3fd53442490fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.157967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf27e810d6fb4259bfc3fd53442490fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.169604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf27e810d6fb4259bfc3fd53442490fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:11.219743 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2107/4255] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:10 2022] DELETE /identity/v3/users/bf27e810d6fb4259bfc3fd53442490fc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:11.224201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:11.224540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:11.225560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:11.279549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:11.285347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:11.537743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2149/4256] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:11.612091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:11.613791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:11.765345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075bddc-a980-45e3-a6b6-798ffb90a8c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:11.776828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:11.778284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:11.778761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:11.779208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:11.804888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:11.806516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:11.863282 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2108/4257] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:12.774304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:12.776799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:12.800337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18860876-6385-44ae-8a21-3d9094d01e7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:12.851338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:12.852432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:12.854836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:12.855273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] PATH_INFO: `/v3/projects/9599b689baf44de59137f3412a88577f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:12.856706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9599b689baf44de59137f3412a88577f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:12.858956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:12.924228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9599b689baf44de59137f3412a88577f', 'request_id': 'req-fae0811b-6973-4e15-9c11-7aa0153c3d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:12.932469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9599b689baf44de59137f3412a88577f', 'request_id': 'req-fae0811b-6973-4e15-9c11-7aa0153c3d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:12.939738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9599b689baf44de59137f3412a88577f', 'request_id': 'req-fae0811b-6973-4e15-9c11-7aa0153c3d36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:12.952418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:12.959840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] The token cache is being invalidate because project 9599b689baf44de59137f3412a88577f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:12.960942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:12.962508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:12.964956 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2150/4258] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:12 2022] DELETE /identity/v3/projects/9599b689baf44de59137f3412a88577f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:12.969230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:12.981084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437da5-208a-4186-9f7f-767d81510444 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:13.040084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:13.042892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:13.118403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:13.119834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.120193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.120477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] PATH_INFO: `/v3/users/f25c575f2f9444c9a02df81a363eea39` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.123355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25c575f2f9444c9a02df81a363eea39)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:13.128784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:13.213140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:13.221925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25c575f2f9444c9a02df81a363eea39'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.224461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25c575f2f9444c9a02df81a363eea39'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.241297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0811b-6973-4e15-9c11-7aa0153c3d36 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:13.248602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25c575f2f9444c9a02df81a363eea39'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.249802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25c575f2f9444c9a02df81a363eea39'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.253750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:13.254424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.254704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.254994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] PATH_INFO: `/v3/projects/49b0a34573ee48caa68a86216286b7b0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.258653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b0a34573ee48caa68a86216286b7b0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:13.261525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:13.262512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f7cc39de-6025-4cc5-acfd-a23a588ef2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25c575f2f9444c9a02df81a363eea39'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.289448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2109/4259] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:12 2022] DELETE /identity/v3/users/f25c575f2f9444c9a02df81a363eea39 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:13.376283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b0a34573ee48caa68a86216286b7b0', 'request_id': 'req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.388094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b0a34573ee48caa68a86216286b7b0', 'request_id': 'req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.395901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b0a34573ee48caa68a86216286b7b0', 'request_id': 'req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.419205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] The token cache is being invalidate because project 49b0a34573ee48caa68a86216286b7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:13.419551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.420912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-52d4ce34-33ed-4dd9-9daa-113fb0ed3a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:13.426746 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2151/4260] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:13 2022] DELETE /identity/v3/projects/49b0a34573ee48caa68a86216286b7b0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:13.428520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.432122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.432671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.484548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:13.486473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:13.630259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.631208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.631676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.637167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2110/4261] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:13.663306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:13.665191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:13.675663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2152/4262] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:13.680532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:13.694857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d8a8-4c36-477f-a3f4-c0802ce6922e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:13.712392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:13.713659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.714198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.714573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.716353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:13.716796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:13.719891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:13.747557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:13.757099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2111/4263] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:13.764263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcf4f2-214d-463f-b1f9-8ba4dd9fa96d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:13.769520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:13.770557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:13.770894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:13.771263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:13.772679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:13.775209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:13.817829 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2153/4264] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:13 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:13.822285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:13.838446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78055-54c9-4842-a43a-5f840ccaf043 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:13.927743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:13.944687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.016288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.017190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.017286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.017521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.023761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.026029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.056183 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2112/4265] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:13 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:14.060649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.077099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc54b3-abe0-4731-b14c-2eb90b2928b4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.089842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.090831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.091775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.092548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.094120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.096326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.112162 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2113/4266] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:14.116774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.142178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068e702-bf8a-4f22-8c70-83b41e83fc87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.143643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f3925-eebd-4891-9fe6-2f6deb7974e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.147741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.148798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.149145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.149421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] PATH_INFO: `/v3/projects/d22ddab1f1244cc1b07e9f1cd9d3ef5d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.149782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.150695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.150891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22ddab1f1244cc1b07e9f1cd9d3ef5d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.151155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.151553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.152272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.152981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.154357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.155575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:14.169548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2114/4267] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:14.175190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.188872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca45a35-e71a-4621-91ac-d19d4916b49e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.195234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.196015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.196399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.196778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] PATH_INFO: `/v3/projects/e1548b1d53a040f29ba41ddb37f1497f/users/fadd33c078ae49d9956ada671d731b99/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.249520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:14.257641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1548b1d53a040f29ba41ddb37f1497f, user_id=fadd33c078ae49d9956ada671d731b99, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.260910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5ac62-a284-40c0-8de7-586578d29610 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.289818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2115/4268] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:14 2022] PUT /identity/v3/projects/e1548b1d53a040f29ba41ddb37f1497f/users/fadd33c078ae49d9956ada671d731b99/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:14.292066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7edda-9ffc-4350-b7b0-f1172ade0d1b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.292400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7edda-9ffc-4350-b7b0-f1172ade0d1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.292723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7edda-9ffc-4350-b7b0-f1172ade0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.307386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22ddab1f1244cc1b07e9f1cd9d3ef5d', 'request_id': 'req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:14.325503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22ddab1f1244cc1b07e9f1cd9d3ef5d', 'request_id': 'req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:14.354867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b4c7edda-9ffc-4350-b7b0-f1172ade0d1b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:14.359490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b4c7edda-9ffc-4350-b7b0-f1172ade0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.368594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22ddab1f1244cc1b07e9f1cd9d3ef5d', 'request_id': 'req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:14.401516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] The token cache is being invalidate because project d22ddab1f1244cc1b07e9f1cd9d3ef5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:14.401805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:14.404511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e6b28b-ff35-4f6a-ac4c-1e1473cb8e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:14.410770 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2154/4269] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:13 2022] DELETE /identity/v3/projects/d22ddab1f1244cc1b07e9f1cd9d3ef5d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:14.412284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.412569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.414255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.543310 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2116/4270] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:14.545012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac439-c569-4e40-bdb4-841b2de3e50e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.545458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac439-c569-4e40-bdb4-841b2de3e50e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.546031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac439-c569-4e40-bdb4-841b2de3e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.568627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] MFA Rules not processed for user `fadd33c078ae49d9956ada671d731b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:14.570559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aa9ac439-c569-4e40-bdb4-841b2de3e50e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:14.572230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa9ac439-c569-4e40-bdb4-841b2de3e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.574477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.701251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2155/4271] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:14.702475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.704452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.718035 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2117/4272] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:14.726636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.726926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.727226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.761928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:14.763162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.777190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2118/4273] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:14.778572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.784054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:14.836421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbe552-68f3-41d9-b646-a1d93c4a70e5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.849734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.850371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.850647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.850932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.870831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.872435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.882437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2156/4274] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:14.883328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.898344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc74fa-e1fd-4e0b-9432-f81deb9ff732 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.899614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d7b41-d5a1-445d-a030-4423ccbd1aa4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.906762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.907431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.907650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.907924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.913674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.914452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.914774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.915104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.916594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:14.918251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.919952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.930529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:14.944093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2157/4275] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:14.950455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:14.961676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.962452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a374088-1742-4d28-8963-c556c3be4dd0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:14.970330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.972874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:14.973547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:14.973879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:14.974158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:14.975054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:14.976841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a4756-9eb5-4806-a22f-37d4600a5a28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:14.990306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2119/4276] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:15.075340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2158/4277] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:14 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:15.079716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.097989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987c2f1-6672-4c57-99c6-e4e867a5c8e3 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:15.128491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:15.164784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.165343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.166546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.208761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:15.210670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:15.317743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:15.324549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.324848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.325161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.330604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:15.336704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:15.381082 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2159/4278] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:15.404163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.405440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2120/4279] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:15 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:15.424712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66e26d-4df3-4286-afdf-a6693dd4758e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:15.432720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:15.433738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.434099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.434379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.434749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.443223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:15.452283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:15.486319 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2160/4280] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:15.489804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.512353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a8605-01c2-4ecf-ba13-ccbe59cc7f1f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:15.523374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:15.526069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.527568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.528308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.530067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:15.535109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:15.562133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2161/4281] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:15.563475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.577870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e642-fa1c-42d3-9d77-a43e267855b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:15.583264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:15.584202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.584585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.584952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] PATH_INFO: `/v3/projects/6ae99b013de94766a258d7e2513bec2a/users/05ed8d89d72e41548bf79d1d9fd1c0f3/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.606044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6535de-0b31-448d-9d8b-96287efbd8d9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:15.611429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae99b013de94766a258d7e2513bec2a, user_id=05ed8d89d72e41548bf79d1d9fd1c0f3, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:15.615715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0909370-3ead-48ef-8ed5-e2ccfbe2dd3d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:15.622539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:15.623705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.624296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.624671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.638487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:15.643129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:15.657026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2162/4282] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:15 2022] PUT /identity/v3/projects/6ae99b013de94766a258d7e2513bec2a/users/05ed8d89d72e41548bf79d1d9fd1c0f3/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:15.662791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6da86-e9c8-4bb2-8534-a482b95c32b6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:15.663551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6da86-e9c8-4bb2-8534-a482b95c32b6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:15.664025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6da86-e9c8-4bb2-8534-a482b95c32b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:15.668985 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2121/4283] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:23:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:15.697638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e1e6da86-e9c8-4bb2-8534-a482b95c32b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:15.699603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1e6da86-e9c8-4bb2-8534-a482b95c32b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:15.876622 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2163/4284] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:15.969665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:15.971206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:16.204447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa594b43-7ef5-4421-89fe-b91a66f50604 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:16.285884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:16.299663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:16.300567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:16.300886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:16.301287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:16.320568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:16.323254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c1cb-a9d9-4332-9874-5ab82148a590 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:16.346392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2122/4285] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:16.938360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:16.938977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:16.938977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:17.010888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] MFA Rules not processed for user `05ed8d89d72e41548bf79d1d9fd1c0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:17.012280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:17.052317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:17.164220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2164/4286] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:17.179079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:17.179282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:17.179970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:17.245612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] MFA Rules not processed for user `05ed8d89d72e41548bf79d1d9fd1c0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:17.248171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:17.269103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2123/4287] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:17.447513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:17.580306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b28338-035d-4b38-ac87-92e6aa2eb28c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:17.594197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:17.598481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:17.598826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:17.599227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:17.622344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:17.624110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:17.646423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2165/4288] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:23:20.135895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:20.151798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b047f-b676-4a22-8894-48d5a8292d9b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:20.183744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:20.185162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:20.185603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:20.186029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] PATH_INFO: `/v3/users/05ed8d89d72e41548bf79d1d9fd1c0f3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:20.187605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ed8d89d72e41548bf79d1d9fd1c0f3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:20.191999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:20.316341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ed8d89d72e41548bf79d1d9fd1c0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:20.317103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ed8d89d72e41548bf79d1d9fd1c0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:20.339012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ed8d89d72e41548bf79d1d9fd1c0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:20.343376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ed8d89d72e41548bf79d1d9fd1c0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:20.364655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-86400a8a-4ee9-429b-8f19-8271c0e892ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ed8d89d72e41548bf79d1d9fd1c0f3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:20.404213 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2124/4289] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:20 2022] DELETE /identity/v3/users/05ed8d89d72e41548bf79d1d9fd1c0f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:20.780663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:20.801309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85d62-b9b6-4a1a-82ac-dc065fe02e87 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:21.038198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:21.039042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.039418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.041114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] PATH_INFO: `/v3/projects/6ae99b013de94766a258d7e2513bec2a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.041114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae99b013de94766a258d7e2513bec2a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:21.046943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:21.213686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae99b013de94766a258d7e2513bec2a', 'request_id': 'req-05c40d29-eef0-4fb6-a30a-bc3869752f2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:21.219160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:21.226561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae99b013de94766a258d7e2513bec2a', 'request_id': 'req-05c40d29-eef0-4fb6-a30a-bc3869752f2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:21.246596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae99b013de94766a258d7e2513bec2a', 'request_id': 'req-05c40d29-eef0-4fb6-a30a-bc3869752f2e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:21.304199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] The token cache is being invalidate because project 6ae99b013de94766a258d7e2513bec2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:21.308632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:21.311939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-05c40d29-eef0-4fb6-a30a-bc3869752f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:21.326528 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2166/4290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:20 2022] DELETE /identity/v3/projects/6ae99b013de94766a258d7e2513bec2a => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:21.333364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.333869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.334452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.427247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:21.433465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:21.610597 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2125/4291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:21.618315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537210d-dd10-4441-9092-9533042984f5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.618886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537210d-dd10-4441-9092-9533042984f5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.619357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537210d-dd10-4441-9092-9533042984f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.649352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7537210d-dd10-4441-9092-9533042984f5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:21.652340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7537210d-dd10-4441-9092-9533042984f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:21.665012 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2167/4292] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:21.666947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:21.683656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded7726-4b62-4213-829d-5bc7efbc929b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:21.689540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:21.690680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.693213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.693886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.694586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:21.694896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:21.696553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:21.716926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2126/4293] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:21.727214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537210d-dd10-4441-9092-9533042984f5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:21.739435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537210d-dd10-4441-9092-9533042984f5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:21.746277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:21.747331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.747617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.747889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.749571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:21.752023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:21.835973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2168/4294] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:21 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:21.837591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:21.861029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb4dd6-5f7e-4e41-b701-e7114ebc0594 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:21.960434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:21.987300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:21.988079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:21.988678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:21.989049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:21.989803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:21.991994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:22.048239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2127/4295] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:21 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:22.048927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:22.067299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0780c74-dfca-43c4-82d0-96ee883c25ae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:22.075544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:22.076720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:22.077311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:22.078014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:22.079023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:22.080869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:22.095874 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2169/4296] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:22.101671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:22.122982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042d7b1-d075-4a50-a37f-f7005f6d42f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:22.130550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:22.131387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:22.131946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:22.132481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:22.135575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:22.137805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bc115-85e5-4f30-aca3-936e8b7de828 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:22.178801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:22.196116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2128/4297] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:22.221222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d589b-d78a-44a8-8f96-2746fa060949 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:22.241993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:22.242901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:22.245950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:22.246240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] PATH_INFO: `/v3/projects/da70df3a9ab94ca696619efbbefa3216/users/dd07a0adac7a44d68f520f01f6e3e867/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:22.305150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=da70df3a9ab94ca696619efbbefa3216, user_id=dd07a0adac7a44d68f520f01f6e3e867, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:22.314125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:22.370682 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2170/4298] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:22 2022] PUT /identity/v3/projects/da70df3a9ab94ca696619efbbefa3216/users/dd07a0adac7a44d68f520f01f6e3e867/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:22.385629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:22.386486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:22.386915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:22.436945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] MFA Rules not processed for user `dd07a0adac7a44d68f520f01f6e3e867`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:22.438223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:22.561116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2129/4299] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:22.566592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:22.790028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6710a-ad2a-4562-9800-c26e6b4644cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:22.805985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:22.808981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:22.812412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:22.812912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:22.813804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:22.815933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:22.878275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:22.879706 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2171/4300] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:22 2022] POST /identity/v3/projects => generated 383 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:22.900625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13ae91-21a4-41da-abc3-b18fc78d0a82 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.064443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.068820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.068820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.069173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.069626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.072477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.138907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2130/4301] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:22 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:23.142753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:23.202509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026419-f8d7-41e6-bf1e-5ec9a03413a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.222434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.223085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.223374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.223695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.224561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.226263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.272457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2172/4302] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:23.276562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:23.288857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b54c64-a38c-46fc-9b82-a78b50db679e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.307995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.309266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.309266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.309616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] PATH_INFO: `/v3/projects/fd46711db9e24eff9054277013c3f665/users/e5d6e78a50134399b3d0f3eae1d76fe2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.332275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd46711db9e24eff9054277013c3f665, user_id=e5d6e78a50134399b3d0f3eae1d76fe2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.338609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.384301 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2131/4303] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:23 2022] PUT /identity/v3/projects/fd46711db9e24eff9054277013c3f665/users/e5d6e78a50134399b3d0f3eae1d76fe2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:23.385785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:23.404255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06a1f-d5c4-4897-b3df-c475fe454280 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.536803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:23.552594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.554258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.554542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.554815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.555463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.557837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37effc-4b94-47b0-a1ba-efc10f98bd14 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.570482 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2173/4304] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:23.581078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:23.596149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e018e-b105-461e-85c2-30ef97753c29 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.616057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.617192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.617804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.618768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] PATH_INFO: `/v3/projects/fd46711db9e24eff9054277013c3f665/users/e5d6e78a50134399b3d0f3eae1d76fe2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.621496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd46711db9e24eff9054277013c3f665, user_id=e5d6e78a50134399b3d0f3eae1d76fe2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.628458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.653258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2132/4305] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:23 2022] PUT /identity/v3/projects/fd46711db9e24eff9054277013c3f665/users/e5d6e78a50134399b3d0f3eae1d76fe2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:23.659052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.659433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.659714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.745214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] MFA Rules not processed for user `e5d6e78a50134399b3d0f3eae1d76fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:23.747068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:23.897829 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2174/4306] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:23.903417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:23.914500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:23.922795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbf22-3527-44b2-81ed-a8f73b246b01 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:23.954290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:23.973501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:23.974333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:23.974841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:23.976070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:23.978479 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:23.978479 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:23:23.978479 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:23:23.979775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invalid input for field 'name': '' is too short Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: On instance['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: On instance['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: '' Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise error Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application '' Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.989394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:23:23.991226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application '' Oct 18 16:23:23.992435 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:23.998416 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2133/4307] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:23 2022] POST /identity/v3/domains => generated 283 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 18 16:23:23.999665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.016375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ee42-ccbe-4ab0-a32a-11bd7eaacf4d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:24.022158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:24.022988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:24.023440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:24.024454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:24.026383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:24.028114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: On instance['name']: Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: On instance['name']: Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise error Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:24.038013 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 18 16:23:24.039751 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:24.042562 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.045321 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2175/4308] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:23 2022] POST /identity/v3/domains => generated 412 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:23:24.052822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.066821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04fd04-672b-4faa-8580-8103866ab1c9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:24.073691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:24.075685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:24.076373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:24.076963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:24.078072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:24.079850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:24.107700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.115196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2134/4309] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:24 2022] POST /identity/v3/domains => generated 277 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:24.124655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bca3-f2c3-4817-98b7-37bc3a1b47e9 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:24.249271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:24.264696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:24.278018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:24.280081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:24.308689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=67f0f7f443914b20b3eabdaa7b2930fe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:24.310655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 18 16:23:24.341951 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 18 16:23:24.343079 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:24.345036 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2176/4310] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:24 2022] DELETE /identity/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe => generated 120 bytes in 238 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:24.350033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.369425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ad317-af0a-4bee-87b5-d81addd6fa5e tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:24.377390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:24.378013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:24.378296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:24.378573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:24.379905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=67f0f7f443914b20b3eabdaa7b2930fe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:24.382337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:24.415991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.420946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.484139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.484797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.487995 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2135/4311] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:24 2022] PATCH /identity/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe => generated 278 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:24.492505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.494516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:24.508179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6696-7564-42b8-ac54-3348abfaf752 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:24.608444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:24.622461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:24.622461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:24.652096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:24.652096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:24.678841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=67f0f7f443914b20b3eabdaa7b2930fe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:24.682738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:24.729974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.751627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.882272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.893172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.906076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.926702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] The token cache is being invalidate because project 67f0f7f443914b20b3eabdaa7b2930fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:24.927005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.928091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.938276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.940002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.940713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '67f0f7f443914b20b3eabdaa7b2930fe', 'request_id': 'req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:24.961912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2177/4312] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:24 2022] DELETE /identity/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:24.967803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:24.997286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228bd9d-8336-4cff-90a9-26fa54f57384 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:25.131622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:25.134422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:25.135004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:25.135463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/992d80c726f544779bc6a801b6bcb215` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:25.156892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Could not find domain: 992d80c726f544779bc6a801b6bcb215.: keystone.exception.DomainNotFound: Could not find domain: 992d80c726f544779bc6a801b6bcb215. Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 992d80c726f544779bc6a801b6bcb215. Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:25.165816 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:25.167186 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:23:25.168389 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 992d80c726f544779bc6a801b6bcb215. Oct 18 16:23:25.169751 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.179032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:25.179576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2136/4313] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:24 2022] DELETE /identity/v3/domains/992d80c726f544779bc6a801b6bcb215 => generated 112 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:25.181451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:25.200656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d44e-a526-45c1-a633-3e0c3ba8b8b3 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:25.206269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:25.206992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:25.207390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:25.207798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:25.208667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:25.210802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:25.260401 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2178/4314] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:25 2022] POST /identity/v3/domains => generated 253 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:25.267841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:25.285750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9cd1b-5c59-455a-8249-3bafd89a4f6c tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:25.378295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:25.379053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:25.381991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:25.381991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:25.381991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:25.386999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:25.398055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1702516555' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:25.398055 n-d-858383-14 devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 16:23:25.398055 n-d-858383-14 devstack@keystone.service[81775]: [parameters: {'id': 'e873decdbf784954b51cb25867d95d0d', 'name': 'tempest-domain-dup-1702516555', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 16:23:25.398055 n-d-858383-14 devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1702516555.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1702516555. Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:23:25.419791 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1702516555' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 16:23:25.420970 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Oct 18 16:23:25.422323 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:23:25.423451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 16:23:25.424557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:23:25.425623 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1702516555' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': 'e873decdbf784954b51cb25867d95d0d', 'name': 'tempest-domain-dup-1702516555', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.426655 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1702516555. Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:25.427644 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1702516555. Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:25.432330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2137/4315] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:25 2022] POST /identity/v3/domains => generated 212 bytes in 158 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:23:25.434035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:25.444501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd1d-f6f0-43a9-8010-2aaf17e56b04 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:25.450784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:25.455326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:25.455622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:25.455903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/fa6af85e641e475fbc8109b2e0d171d5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:25.496199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fa6af85e641e475fbc8109b2e0d171d5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:25.498067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:25.567885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:25.568759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:25.629345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:25.630075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:25.642187 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2179/4316] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:25 2022] PATCH /identity/v3/domains/fa6af85e641e475fbc8109b2e0d171d5 => generated 254 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:25.644312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:25.647101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:25.695034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40526-75ac-4428-b919-b50c665cafab tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:25.843780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:25.917806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:25.919560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:25.919843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:25.920113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/fa6af85e641e475fbc8109b2e0d171d5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:25.965468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fa6af85e641e475fbc8109b2e0d171d5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:25.971250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:26.037771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.050526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.251791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.273246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.283502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.305617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] The token cache is being invalidate because project fa6af85e641e475fbc8109b2e0d171d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:26.306116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.307175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.339655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.348540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.352870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fa6af85e641e475fbc8109b2e0d171d5', 'request_id': 'req-71f8dfec-a53b-4a46-b203-1d492bd61186'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:26.373655 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2138/4317] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:25 2022] DELETE /identity/v3/domains/fa6af85e641e475fbc8109b2e0d171d5 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:26.384413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:26.404549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a922ce-816b-4a5a-8fab-4fd15d6acdbd tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:26.460306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:26.558067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5d6e78a50134399b3d0f3eae1d76fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd46711db9e24eff9054277013c3f665', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:26.558907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:26.559387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:26.559804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] PATH_INFO: `/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:26.568881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-bfc00483-1952-4680-b7cf-76b53bea5948 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Could not find domain: 67f0f7f443914b20b3eabdaa7b2930fe.: keystone.exception.DomainNotFound: Could not find domain: 67f0f7f443914b20b3eabdaa7b2930fe. Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 67f0f7f443914b20b3eabdaa7b2930fe. Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:26.576352 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:26.577502 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:23:26.578438 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 67f0f7f443914b20b3eabdaa7b2930fe. Oct 18 16:23:26.579410 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:26.582280 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2180/4318] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:26 2022] PATCH /identity/v3/domains/67f0f7f443914b20b3eabdaa7b2930fe => generated 112 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:26.585722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:26.588083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:26.872299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfec-a53b-4a46-b203-1d492bd61186 tempest-DomainsNegativeTestJSON-1055191363 tempest-DomainsNegativeTestJSON-1055191363-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:26.886801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:26.888855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:26.889242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:26.889680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] PATH_INFO: `/v3/users/dd07a0adac7a44d68f520f01f6e3e867` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:26.891086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd07a0adac7a44d68f520f01f6e3e867)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:26.893594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:26.933885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:27.016417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd07a0adac7a44d68f520f01f6e3e867'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:27.017234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd07a0adac7a44d68f520f01f6e3e867'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:27.029513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd07a0adac7a44d68f520f01f6e3e867'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:27.030803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd07a0adac7a44d68f520f01f6e3e867'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:27.048201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd07a0adac7a44d68f520f01f6e3e867'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:27.081869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2139/4319] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:26 2022] DELETE /identity/v3/users/dd07a0adac7a44d68f520f01f6e3e867 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:27.083802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:27.083802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:27.083998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:27.150266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:27.151484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:27.288067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2181/4320] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:27.288569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:27.293081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:27.457222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08008ba8-54d7-46d9-94fd-2c4ee36ecb2e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:27.489443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:27.490200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:27.490485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:27.490753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:27.510517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:27.512342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:27.534919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2140/4321] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:27.994083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:27.995976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:28.012752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214687-4ad1-434a-8d59-957f9dd6ce12 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:28.018959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:28.020598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:28.021218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:28.021600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] PATH_INFO: `/v3/projects/da70df3a9ab94ca696619efbbefa3216` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:28.035002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da70df3a9ab94ca696619efbbefa3216)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:28.039878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:28.141436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da70df3a9ab94ca696619efbbefa3216', 'request_id': 'req-ac22de68-ed94-44c5-9e81-c0f869036332'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.162982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da70df3a9ab94ca696619efbbefa3216', 'request_id': 'req-ac22de68-ed94-44c5-9e81-c0f869036332'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.176660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da70df3a9ab94ca696619efbbefa3216', 'request_id': 'req-ac22de68-ed94-44c5-9e81-c0f869036332'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.201560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] The token cache is being invalidate because project da70df3a9ab94ca696619efbbefa3216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:28.201916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.202696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.204435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2182/4322] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:27 2022] DELETE /identity/v3/projects/da70df3a9ab94ca696619efbbefa3216 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:28.208747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:28.221731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3655-894f-4a57-9c44-653faa5be9b6 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:28.444602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:28.445689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:28.446145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:28.447167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] PATH_INFO: `/v3/users/e5d6e78a50134399b3d0f3eae1d76fe2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:28.449880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d6e78a50134399b3d0f3eae1d76fe2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:28.451995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:28.533340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:28.536403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d6e78a50134399b3d0f3eae1d76fe2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.537661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d6e78a50134399b3d0f3eae1d76fe2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.551290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d6e78a50134399b3d0f3eae1d76fe2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.554173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d6e78a50134399b3d0f3eae1d76fe2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.574775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebda4b27-4f0d-4d29-b4ae-ba2cde12a25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d6e78a50134399b3d0f3eae1d76fe2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:28.623982 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2141/4323] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:28 2022] DELETE /identity/v3/users/e5d6e78a50134399b3d0f3eae1d76fe2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:29.424473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:29.426177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:29.464922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22de68-ed94-44c5-9e81-c0f869036332 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:29.603304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:29.636666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:29.650563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:29.650865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:29.651298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] PATH_INFO: `/v3/projects/fd46711db9e24eff9054277013c3f665` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:29.653693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd46711db9e24eff9054277013c3f665)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:29.655825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:29.777598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd46711db9e24eff9054277013c3f665', 'request_id': 'req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:29.799940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd46711db9e24eff9054277013c3f665', 'request_id': 'req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:29.815909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd46711db9e24eff9054277013c3f665', 'request_id': 'req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:29.841364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] The token cache is being invalidate because project fd46711db9e24eff9054277013c3f665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:29.841985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:29.843373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:29.845171 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2183/4324] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:29 2022] DELETE /identity/v3/projects/fd46711db9e24eff9054277013c3f665 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:29.850496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ca52-1089-4760-b41c-9d66f5d723ea None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:29.851033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ca52-1089-4760-b41c-9d66f5d723ea None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:29.851033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ca52-1089-4760-b41c-9d66f5d723ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:29.895621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1919ca52-1089-4760-b41c-9d66f5d723ea None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:29.897236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1919ca52-1089-4760-b41c-9d66f5d723ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.021127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.022735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.166264 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2142/4325] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:30.177151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.177271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.177739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.191185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46c02-c1c2-47cb-a8ef-c43e1a7d5c81 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.204664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:30.206002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.206663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.206963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.207105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.207221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] PATH_INFO: `/v3/users/fadd33c078ae49d9956ada671d731b99` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.217262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2143/4326] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:30.225615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.242597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadd33c078ae49d9956ada671d731b99)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.246006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.293027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c18977-f814-4a01-8325-ac68bd3817da None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.316637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.319440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.319973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.320838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.323761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:30.325428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.336269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.358166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadd33c078ae49d9956ada671d731b99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:30.372555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadd33c078ae49d9956ada671d731b99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:30.374236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadd33c078ae49d9956ada671d731b99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:30.394446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadd33c078ae49d9956ada671d731b99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:30.396311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a71fc2d1-26d4-4a4f-b7d0-90e25e92b55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadd33c078ae49d9956ada671d731b99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:30.398199 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2144/4327] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:30.403858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.412170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.447239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:30.453263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca06ef-d88f-4090-a6c7-fe13a3362ae4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.470086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.471105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.471447 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2184/4328] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:30 2022] DELETE /identity/v3/users/fadd33c078ae49d9956ada671d731b99 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:30.471747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.472249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.473152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.476583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.478603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.478895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.479148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.548058 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2145/4329] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:30 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:30.552271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.566496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:30.573303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.747051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2185/4330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:30.748797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.751153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:30.760673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcb01-3b1b-4bab-b49f-33108556fb50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.766558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.767080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.767380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.767727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.768512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.771055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.807379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2146/4331] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:30 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:30.809169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.822831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703beec4-ff69-4c94-907e-bbfacc22da5d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.829223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.829948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.830440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.830795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.831543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.833618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.837206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:30.878584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2147/4332] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:30.883878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.902091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18dc0d-5652-47ca-b720-1f5e62bfdc98 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.911434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.912731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.913363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.913788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.914616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.916953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:30.934469 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2148/4333] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:30.938706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:30.941197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c2aa5-16cf-4db4-8aff-eb08f7d473bf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.952654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.953457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.962798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.963261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.966092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cff98-013c-4374-b49b-72a49f5361e2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:30.974216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:30.975217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:30.975658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:30.976087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] PATH_INFO: `/v3/projects/5de7f25f890c4a379bfaca485409a363/users/ed026fa115214d62b8d1094d6c605b96/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:30.995715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:30.997224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0413b9-41d8-43df-97bd-f26f48e5a8c2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:31.004309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de7f25f890c4a379bfaca485409a363, user_id=ed026fa115214d62b8d1094d6c605b96, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:31.011349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:31.037233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2186/4334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:31.066474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:31.066778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:31.067048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:31.069866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2149/4335] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:30 2022] PUT /identity/v3/projects/5de7f25f890c4a379bfaca485409a363/users/ed026fa115214d62b8d1094d6c605b96/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:31.141972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] MFA Rules not processed for user `ed026fa115214d62b8d1094d6c605b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:31.143224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:31.286805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2187/4336] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:31.291722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:31.463536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6318fc9-331c-4a7b-b6be-fa4900102497 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:31.473152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:31.473928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:31.474080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:31.474351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:31.475007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:31.476915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6333b35-d4a0-42b8-a55e-3471eb7a2bd6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:31.603184 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2150/4337] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:31 2022] POST /identity/v3/projects => generated 369 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:31.606367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:31.636593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:31.636965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:31.637287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:31.648226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b7f5-757b-4891-ad52-f8c1a0010614 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:31.730911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:31.744493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:31.760104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:31.864418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:31.865239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:31.865608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:31.866003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:31.866916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:31.869882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:31.932044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2188/4338] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:31 2022] POST /identity/v3/users => generated 291 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:31.933172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:31.935683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:31.961104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbab67-417d-48c2-b3aa-590bc68d5abd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:31.981619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:31.982440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:31.982998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:31.983379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] PATH_INFO: `/v3/projects/e1548b1d53a040f29ba41ddb37f1497f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:31.984746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1548b1d53a040f29ba41ddb37f1497f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:31.987111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.002533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2151/4339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:32.015972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.059926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20d12a-6382-49cd-967a-0e7eabd49417 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.079348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.081653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.082475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.084106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.085207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.087739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.116359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1548b1d53a040f29ba41ddb37f1497f', 'request_id': 'req-e381c294-f579-4537-a97f-0c7a27688e12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:32.125324 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2152/4340] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:32.129706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.135546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1548b1d53a040f29ba41ddb37f1497f', 'request_id': 'req-e381c294-f579-4537-a97f-0c7a27688e12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:32.144543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1548b1d53a040f29ba41ddb37f1497f', 'request_id': 'req-e381c294-f579-4537-a97f-0c7a27688e12'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:32.158904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655423b8-7213-42ae-b484-7fb60d02ebf8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.171030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] The token cache is being invalidate because project e1548b1d53a040f29ba41ddb37f1497f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:32.171499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:32.178096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e381c294-f579-4537-a97f-0c7a27688e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:32.187024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2189/4341] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:31 2022] DELETE /identity/v3/projects/e1548b1d53a040f29ba41ddb37f1497f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:32.188783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ac5-c3a3-4184-ba31-5ff0b9c5a386 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.189276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ac5-c3a3-4184-ba31-5ff0b9c5a386 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.189581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ac5-c3a3-4184-ba31-5ff0b9c5a386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.239630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-75a43ac5-c3a3-4184-ba31-5ff0b9c5a386 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:32.241082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75a43ac5-c3a3-4184-ba31-5ff0b9c5a386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:32.323528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:32.355312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.356180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.357187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.357520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] PATH_INFO: `/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6/users/75902c47d50d4a07810dfa964a4fd979/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.368914 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2190/4342] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:32.377302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343244-1429-428b-af4e-140d406af8ca None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.377610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343244-1429-428b-af4e-140d406af8ca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.377906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34343244-1429-428b-af4e-140d406af8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.380507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6d5b0117664b43b5dbae2f76300fa6, user_id=75902c47d50d4a07810dfa964a4fd979, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.387485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.417368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2153/4343] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:32 2022] PUT /identity/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6/users/75902c47d50d4a07810dfa964a4fd979/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:32.418250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34343244-1429-428b-af4e-140d406af8ca None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:32.418833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.420403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34343244-1429-428b-af4e-140d406af8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:32.420735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:32.536789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:32.611685 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2191/4344] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:32.616146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343244-1429-428b-af4e-140d406af8ca None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.619523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70ad39-894e-45dd-8a68-6ff7ef0636f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.638090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.639934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.640537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.640806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.642993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.644904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34343244-1429-428b-af4e-140d406af8ca None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.646758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.658285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.658918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.659191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.659458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.660112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:32.660409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.662037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.673616 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2154/4345] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:32.675237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.698032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2192/4346] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:32.702150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.706132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaba9fd-6b0a-4f4e-af50-26afe9730b29 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.720345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.721462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.724312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.724463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579ad9-2669-4239-99ea-e52556d913d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.725161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] PATH_INFO: `/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6/users/75902c47d50d4a07810dfa964a4fd979/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.730751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6d5b0117664b43b5dbae2f76300fa6, user_id=75902c47d50d4a07810dfa964a4fd979, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.736679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511df2a-097e-4320-a96a-b5913a4c9ea7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.749476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.750312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.750645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.750986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.751807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.754460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.780439 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2155/4347] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:32 2022] PUT /identity/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6/users/75902c47d50d4a07810dfa964a4fd979/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:32.801150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.801942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.803623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.811670 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2193/4348] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:32 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:32.815980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.932243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7549-da4b-45bd-9a77-e8b1bdd47de5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:32.937325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:32.937940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:32.938216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:32.938485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:32.939120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:32.941100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:32.946753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] MFA Rules not processed for user `75902c47d50d4a07810dfa964a4fd979`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:32.959192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:32.968597 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2194/4349] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:32 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:32.972817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:32.995962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a58d0-e90f-4bc9-aa42-ed37bca072b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.010716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.013657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.014251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.014777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.015771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.023693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.058653 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2195/4350] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:33.060112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.087097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa9cd-dc4f-4c24-b420-54c120614e84 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.101140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.103803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.104588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.106345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.108858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.114061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.143967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2196/4351] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:33.145074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.158940 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2156/4352] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:33.164210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7e96-0e26-4e47-a1b0-cd7d447efff6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.165788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.170616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.171257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.172249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.172249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] PATH_INFO: `/v3/projects/776a1f70fb6346b3b52a0daec1cd442b/users/024de2bd7f864d3f86606c0f3115722e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.176831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193483c-167b-4d17-a6e6-025db65fedac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.182691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.183544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.183897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.184334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.185143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.187396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.190825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776a1f70fb6346b3b52a0daec1cd442b, user_id=024de2bd7f864d3f86606c0f3115722e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.193782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc591d32-c339-4c3b-8319-f1111be0dec1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.218815 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2197/4353] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:33 2022] PUT /identity/v3/projects/776a1f70fb6346b3b52a0daec1cd442b/users/024de2bd7f864d3f86606c0f3115722e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:33.238678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.239691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.240222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.273466 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2157/4354] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:33 2022] POST /identity/v3/projects => generated 360 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:33.274726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.289475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] MFA Rules not processed for user `024de2bd7f864d3f86606c0f3115722e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:33.293330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:33.309673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:33.356326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:33.400370 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2198/4355] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:33.405281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.439359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34986e-6bd1-48ed-b8f4-b7bd6a5111a0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.459486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.460587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.463480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.464171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.465386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.478563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.486370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c216a-4a23-428c-ba57-a0cab460ea82 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.492400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.493789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.494543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.494805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.495714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.497900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.543461 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2158/4356] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:33 2022] POST /identity/v3/users => generated 416 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:33.543995 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2199/4357] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:33 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:33.550626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.553762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.569957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47f98-20fe-4dd1-b3c9-dd59767e58fe tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.680618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacdbf-2717-4404-a5d9-59ae0a698585 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.697200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.698719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.699488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.700648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.701944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.704295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.751412 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2200/4358] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:33 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:33.755052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.766501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.767397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.767546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.767844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/users/1d693df378da4f44ace6f14699f4b7e1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.784499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13e6-7dc6-4692-b74f-4d007dd46485 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.799172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.799837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.800118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.800391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.801083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.803175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_user(user_id=1d693df378da4f44ace6f14699f4b7e1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.807355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.809387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.817322 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2159/4359] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:23:33 2022] GET /identity/v3/users/1d693df378da4f44ace6f14699f4b7e1 => generated 416 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:33.818340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.840896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2201/4360] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:33.843544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:33.853808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dd16-1c7e-4cf9-941d-4a1c2e2f22b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.865568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.866461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.866806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.867097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/users/1d693df378da4f44ace6f14699f4b7e1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.871193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1d693df378da4f44ace6f14699f4b7e1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.874558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61acdd1-310e-4447-abea-8fa0c47994a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:33.876837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:33.900150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:33.900866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:33.901215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:33.901494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] PATH_INFO: `/v3/projects/e7a64a020c9e40eab4e80df8587c75d2/users/72242c99fdfd465cab878df6b90e7f72/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:33.986623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a64a020c9e40eab4e80df8587c75d2, user_id=72242c99fdfd465cab878df6b90e7f72, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:33.997226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.061056 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2202/4361] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:33 2022] PUT /identity/v3/projects/e7a64a020c9e40eab4e80df8587c75d2/users/72242c99fdfd465cab878df6b90e7f72/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:34.061056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.082975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d693df378da4f44ace6f14699f4b7e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.083774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d693df378da4f44ace6f14699f4b7e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.105988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d693df378da4f44ace6f14699f4b7e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.106882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d693df378da4f44ace6f14699f4b7e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.124213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d693df378da4f44ace6f14699f4b7e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.144865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:34.175812 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2160/4362] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:33 2022] DELETE /identity/v3/users/1d693df378da4f44ace6f14699f4b7e1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:34.175812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.181192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:34.207306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:34.236655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4a0e-b8d4-46a2-aa5c-a2988c9986c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.388581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:34.389272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.389546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.389820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.390492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:34.393392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.406719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9fa5-059b-4d9f-b9fe-ade833b1b0fb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.410362 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2203/4363] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:34.412934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:34.414297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.414588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.414826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/5a29982adfe24eafb04576679a3bbc38` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.415400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.416719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a29982adfe24eafb04576679a3bbc38)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:34.418300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:34.422509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.436427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c1062-7a9f-439e-8cf0-c5fdd2bfbd28 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.445979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:34.448408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.448857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.449340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] PATH_INFO: `/v3/projects/e7a64a020c9e40eab4e80df8587c75d2/users/72242c99fdfd465cab878df6b90e7f72/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.451603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a64a020c9e40eab4e80df8587c75d2, user_id=72242c99fdfd465cab878df6b90e7f72, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:34.458058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ac028-86a3-41b3-ac87-1e54a2076482 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.479105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2204/4364] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:34 2022] PUT /identity/v3/projects/e7a64a020c9e40eab4e80df8587c75d2/users/72242c99fdfd465cab878df6b90e7f72/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:34.495104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.496270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.497673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.503411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a29982adfe24eafb04576679a3bbc38', 'request_id': 'req-8efc8260-028e-42bf-9b3a-9ba45eff3adf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.515220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a29982adfe24eafb04576679a3bbc38', 'request_id': 'req-8efc8260-028e-42bf-9b3a-9ba45eff3adf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.532677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a29982adfe24eafb04576679a3bbc38', 'request_id': 'req-8efc8260-028e-42bf-9b3a-9ba45eff3adf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.555126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 5a29982adfe24eafb04576679a3bbc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:34.560176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.561210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:34.570410 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2161/4365] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:34 2022] DELETE /identity/v3/projects/5a29982adfe24eafb04576679a3bbc38 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:34.570620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] MFA Rules not processed for user `72242c99fdfd465cab878df6b90e7f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:34.570620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:34.572604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.575708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:34.734844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8260-028e-42bf-9b3a-9ba45eff3adf tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.736983 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2205/4366] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:34.738035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.742551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:34.743826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.744290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.744742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.745587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:34.747489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.760280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7fabb-a805-4c38-8333-67d1ed22d499 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.766852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:34.767807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:34.768135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:34.768457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:34.769134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:34.771154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:34.778421 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2162/4367] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:34 2022] POST /identity/v3/projects => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:34.784167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.825620 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2206/4368] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:34 2022] POST /identity/v3/projects => generated 333 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:34.831320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:34.841914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:34.863605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:34.901408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ad15-e627-4e5e-b028-a66b0d704fcb tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:34.988971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff2f1d-87c3-4c5f-b684-a4fa8445ef19 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.001666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.002328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.002854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.003109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.003763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.005677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.052829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.054620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.057085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.058200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.060120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:35.061095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.067374 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2207/4369] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:34 2022] POST /identity/v3/projects => generated 333 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:35.067586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.068712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.110034 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2163/4370] 10.222.0.78 () {58 vars in 1160 bytes} [Tue Oct 18 16:23:34 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:35.125275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.142547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffa22a-eb2d-40bf-a0a6-e905ab9a4e51 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.230346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb455217-001d-4cfd-ac71-771b0838c950 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.237942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.239252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.240121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.240691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.250129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.254264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.254988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.255352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.255547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.256264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.258088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.263675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.290478 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2164/4371] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:23:35 2022] GET /identity/v3/domains => generated 828 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:35.290478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.290478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:35.333503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2208/4372] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:35 2022] POST /identity/v3/projects => generated 358 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:35.334933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.441984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bbc85-6710-4f7a-a086-da266516161f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.468320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693cd5c-3498-435c-916e-9544cefc4e2c tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.473233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.473887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.474161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.474447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/88d821a0a22a4013bcd15fb36caa3be2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.478570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_project(project_id=88d821a0a22a4013bcd15fb36caa3be2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.479189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:35.479817 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:35.479817 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:23:35.479817 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:23:35.482803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.501652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.502523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.526434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:35.544421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.545729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.551939 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2209/4373] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:23:35 2022] PATCH /identity/v3/projects/88d821a0a22a4013bcd15fb36caa3be2 => generated 361 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:35.551939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.551939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:35.620153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.621303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.622236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.623756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] PATH_INFO: `/v3/users/f8a4c7e2cf5e45b3b2f37632f003fa91` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.628777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a4c7e2cf5e45b3b2f37632f003fa91)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.633869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.654934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbc07-f199-4a30-a955-bceed14f95b0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:35.661733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:35.662627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:35.662979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:35.663461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:35.664396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:35.678069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:35.713293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2210/4374] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:23:35 2022] GET /identity/v3/projects => generated 7590 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:35.713293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.720693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:35.781653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a4c7e2cf5e45b3b2f37632f003fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.783479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a4c7e2cf5e45b3b2f37632f003fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.807778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a4c7e2cf5e45b3b2f37632f003fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.812516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a4c7e2cf5e45b3b2f37632f003fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.830984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a4c7e2cf5e45b3b2f37632f003fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:35.866644 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2165/4375] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:35 2022] DELETE /identity/v3/users/f8a4c7e2cf5e45b3b2f37632f003fa91 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:35.868155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:35.872625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:35.959497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5c8e7-8580-4e9c-9fed-83921fd57fe0 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.009764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774abdc-1340-4651-842b-c6e119fbed8e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.026918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.028066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.028525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.029544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.031453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:36.032040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.036022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635944-b1e2-46ed-b3b4-fe265bbf5fe6 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.060316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2166/4376] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Oct 18 16:23:35 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:36.062226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.062761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.063042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.069072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.069922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.070437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.070698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/88d821a0a22a4013bcd15fb36caa3be2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.100482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:36.102863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:36.102994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=88d821a0a22a4013bcd15fb36caa3be2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.106595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.133566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:36.136418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.140792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.143195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:36.230645 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2167/4377] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:36.231837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.236237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.246599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.250467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8f14e-7688-48ea-a4c1-9ddca8e30a89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.257835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.292706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 88d821a0a22a4013bcd15fb36caa3be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:36.293218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.293704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.306520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.307850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.308723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '88d821a0a22a4013bcd15fb36caa3be2', 'request_id': 'req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:36.320628 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2211/4378] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:35 2022] DELETE /identity/v3/projects/88d821a0a22a4013bcd15fb36caa3be2 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:36.321903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.323625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:36.353616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.354323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.354873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.366972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.368582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Adding query filter params (parent_id=5803e4054fc64685867ed4040dd587de) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:36.368899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.371521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.411801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2168/4379] 10.222.0.78 () {58 vars in 1216 bytes} [Tue Oct 18 16:23:36 2022] GET /identity/v3/projects?parent_id=5803e4054fc64685867ed4040dd587de => generated 498 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:36.413130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.415021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:36.436448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e836e5-e9ee-48eb-adb1-ad5f43434e5a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.440928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.441941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.442445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.442814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.444761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:36.574039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260be5cb-8942-4f45-9419-6151f51a9514 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.603359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.604340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.604904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.605298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.608486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.611597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.637355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.640953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.669430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2212/4380] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:36.670736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.674529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:36.715934 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2169/4381] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:36 2022] POST /identity/v3/projects => generated 358 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:36.721794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.726279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dca-e837-48c0-9ea8-85f8975b0297 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.777878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:36.819880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:36.868452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.869235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.869523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.869798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects/ca9dbc5db5dc4bc78cd137c67e798981` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.873924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca9dbc5db5dc4bc78cd137c67e798981)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.875955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.888660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff33cb-3294-4b91-b62f-b187fedf747d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.917680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.917680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.917680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.918255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/3d00468feef74bc6ae35a770ddba2494` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.919746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d00468feef74bc6ae35a770ddba2494)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.923644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:36.926288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2170/4382] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:36 2022] GET /identity/v3/projects/3d00468feef74bc6ae35a770ddba2494 => generated 358 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:36.931996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:36.959958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0530e-4bc5-42f4-93be-6755cdb25b6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:36.969787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:36.973090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:36.973367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:36.973685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/3d00468feef74bc6ae35a770ddba2494` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:36.978162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d00468feef74bc6ae35a770ddba2494)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:36.981151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.008231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9dbc5db5dc4bc78cd137c67e798981', 'request_id': 'req-729d9313-896a-4e9c-b4fe-85db220e7723'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.033885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9dbc5db5dc4bc78cd137c67e798981', 'request_id': 'req-729d9313-896a-4e9c-b4fe-85db220e7723'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.050122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9dbc5db5dc4bc78cd137c67e798981', 'request_id': 'req-729d9313-896a-4e9c-b4fe-85db220e7723'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.075385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d00468feef74bc6ae35a770ddba2494', 'request_id': 'req-cb6308df-25a2-4589-860d-67784779e8ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.086036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d00468feef74bc6ae35a770ddba2494', 'request_id': 'req-cb6308df-25a2-4589-860d-67784779e8ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.092727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] The token cache is being invalidate because project ca9dbc5db5dc4bc78cd137c67e798981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:37.093182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.094527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.102348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2213/4383] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:36 2022] DELETE /identity/v3/projects/ca9dbc5db5dc4bc78cd137c67e798981 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:37.102870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d00468feef74bc6ae35a770ddba2494', 'request_id': 'req-cb6308df-25a2-4589-860d-67784779e8ec'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.103949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:37.105846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:37.116494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 3d00468feef74bc6ae35a770ddba2494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:37.116807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.117603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.124683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2171/4384] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:36 2022] DELETE /identity/v3/projects/3d00468feef74bc6ae35a770ddba2494 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:37.127748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:37.130578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:37.268920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6308df-25a2-4589-860d-67784779e8ec tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:37.269678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d9313-896a-4e9c-b4fe-85db220e7723 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:37.279097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:37.279742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:37.280020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:37.280306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:37.280980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:37.284777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.343551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2172/4385] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:37 2022] POST /identity/v3/projects => generated 360 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:37.344809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:37.456837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:37.463423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:37.464296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:37.464434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects/5803e4054fc64685867ed4040dd587de` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:37.469045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5803e4054fc64685867ed4040dd587de)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:37.473204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.475624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:37.479664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:37.496293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c4be6-1d04-466e-8829-b6cd72f1e850 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:37.504104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:37.504903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:37.505225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:37.505523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/dca69f25deea40a0bb4f717394f79c3d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:37.507016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=dca69f25deea40a0bb4f717394f79c3d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:37.510930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.513919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2173/4386] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:37 2022] GET /identity/v3/projects/dca69f25deea40a0bb4f717394f79c3d => generated 360 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:37.514718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:37.517835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:37.596182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5803e4054fc64685867ed4040dd587de', 'request_id': 'req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.612286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5803e4054fc64685867ed4040dd587de', 'request_id': 'req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.626729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5803e4054fc64685867ed4040dd587de', 'request_id': 'req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.654276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] The token cache is being invalidate because project 5803e4054fc64685867ed4040dd587de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:37.654698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.656429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.664193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2214/4387] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:37 2022] DELETE /identity/v3/projects/5803e4054fc64685867ed4040dd587de => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:37.665795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:37.667934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:37.676295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204c166-f499-4a8f-9c35-1b1198b8f8ae tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:37.780332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:37.781061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:37.781354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:37.781692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] PATH_INFO: `/v3/projects/fad51e0fdee048ec85bafa28cd4b7c8a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:37.783828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad51e0fdee048ec85bafa28cd4b7c8a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:37.786567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.849995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8eced5-ab90-4038-98ec-3e1fd917c9f9 tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:37.861810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:37.862758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:37.863054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:37.863404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/dca69f25deea40a0bb4f717394f79c3d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:37.866185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dca69f25deea40a0bb4f717394f79c3d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:37.875235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:37.921384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad51e0fdee048ec85bafa28cd4b7c8a', 'request_id': 'req-eb230210-42ca-4e85-9f8f-c6728abdcae0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.959884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad51e0fdee048ec85bafa28cd4b7c8a', 'request_id': 'req-eb230210-42ca-4e85-9f8f-c6728abdcae0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:37.980320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad51e0fdee048ec85bafa28cd4b7c8a', 'request_id': 'req-eb230210-42ca-4e85-9f8f-c6728abdcae0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.004151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca69f25deea40a0bb4f717394f79c3d', 'request_id': 'req-ae97f591-70b1-4583-aba9-3e7c1c119664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.014297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] The token cache is being invalidate because project fad51e0fdee048ec85bafa28cd4b7c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:38.015311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.018317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca69f25deea40a0bb4f717394f79c3d', 'request_id': 'req-ae97f591-70b1-4583-aba9-3e7c1c119664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.022038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.032808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2174/4388] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:37 2022] DELETE /identity/v3/projects/fad51e0fdee048ec85bafa28cd4b7c8a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:38.035100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.036677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca69f25deea40a0bb4f717394f79c3d', 'request_id': 'req-ae97f591-70b1-4583-aba9-3e7c1c119664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.038531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.069452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project dca69f25deea40a0bb4f717394f79c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:38.069452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.069452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ae97f591-70b1-4583-aba9-3e7c1c119664 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.069986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2215/4389] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:37 2022] DELETE /identity/v3/projects/dca69f25deea40a0bb4f717394f79c3d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:38.071166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.071547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.071760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.136726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:38.138268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:38.142033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.186240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:38.199063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb230210-42ca-4e85-9f8f-c6728abdcae0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.272856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2216/4390] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:38.273623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.275347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.305140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72242c99fdfd465cab878df6b90e7f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a64a020c9e40eab4e80df8587c75d2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.311530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.313137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.313761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] PATH_INFO: `/v3/projects/6d72cf1b3cbf40c0a1c1d89698037480` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.316412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d72cf1b3cbf40c0a1c1d89698037480)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.321911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.432657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef7cac-a42b-47e3-a53d-b12114161bb5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.454104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d72cf1b3cbf40c0a1c1d89698037480', 'request_id': 'req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.470475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d72cf1b3cbf40c0a1c1d89698037480', 'request_id': 'req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.486306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d72cf1b3cbf40c0a1c1d89698037480', 'request_id': 'req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.519385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] The token cache is being invalidate because project 6d72cf1b3cbf40c0a1c1d89698037480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:38.519614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.522835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9fa2d9dc-0ae0-4bb3-90d4-cc9c6dec7f1a tempest-ListProjectsTestJSON-1511520823 tempest-ListProjectsTestJSON-1511520823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.529158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2175/4391] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:38 2022] DELETE /identity/v3/projects/6d72cf1b3cbf40c0a1c1d89698037480 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:38.531331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.531595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.532385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.560114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.562267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.562914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.566496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.572767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.581628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.584709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:38.586252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.663919 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2217/4392] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:38 2022] POST /identity/v3/projects => generated 347 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:38.665541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.687111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.726884 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2176/4393] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:38.728605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.733851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.749384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ceda6-14f9-4418-9872-b0d91c0c430e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.760024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:38.777414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:38.798664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badfd52-c327-4afc-a54a-ab4efd56d99b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.804851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.805984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.806638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.806975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] PATH_INFO: `/v3/users/024de2bd7f864d3f86606c0f3115722e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.809487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024de2bd7f864d3f86606c0f3115722e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.811714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.829240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.829891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.831335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.831476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/bde30a35950d452a850c2809cf28c1a1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.832711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=bde30a35950d452a850c2809cf28c1a1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.835024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.838710 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2177/4394] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:38 2022] GET /identity/v3/projects/bde30a35950d452a850c2809cf28c1a1 => generated 347 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:38.840185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.855662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d446ed-6515-4e98-8c11-2f3391cb35ce tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.860798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.861463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.861741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.862013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.862789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:38.863101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.864678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.882323 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2178/4395] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:38.882323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.885326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024de2bd7f864d3f86606c0f3115722e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.896862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024de2bd7f864d3f86606c0f3115722e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.898665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcc7c7-9e6a-4b4b-a5ce-3b56339f8c7f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:38.899665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024de2bd7f864d3f86606c0f3115722e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.907582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024de2bd7f864d3f86606c0f3115722e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.907806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:38.908510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024de2bd7f864d3f86606c0f3115722e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.908626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:38.908891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:38.909208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/bde30a35950d452a850c2809cf28c1a1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:38.910444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bde30a35950d452a850c2809cf28c1a1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:38.912483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:38.927819 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2218/4396] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:38 2022] DELETE /identity/v3/users/024de2bd7f864d3f86606c0f3115722e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:38.929663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:38.931713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:38.972574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde30a35950d452a850c2809cf28c1a1', 'request_id': 'req-aaefac14-fc63-49d8-9df0-0040f23ac107'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.981810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde30a35950d452a850c2809cf28c1a1', 'request_id': 'req-aaefac14-fc63-49d8-9df0-0040f23ac107'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:38.989103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde30a35950d452a850c2809cf28c1a1', 'request_id': 'req-aaefac14-fc63-49d8-9df0-0040f23ac107'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.000570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project bde30a35950d452a850c2809cf28c1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:39.000858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.001552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.001858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754e234-51db-4697-9846-53cd9170e367 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.004573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2179/4397] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:38 2022] DELETE /identity/v3/projects/bde30a35950d452a850c2809cf28c1a1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:39.005487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.008145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.071529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefac14-fc63-49d8-9df0-0040f23ac107 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.075311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.075912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.076187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.076456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.078243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.081412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.082283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.082661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.083028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.083765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.086120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.088582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.090030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d031a27-118d-419c-8f60-c2038f52b5e3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.098741 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2180/4398] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:39.100139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.100461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.100744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.118467 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2219/4399] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:38 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:39.118467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.118769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.126447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:39.129614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:39.130822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.160977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:39.193462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e198c8-a9fe-4910-bac8-5e89dc8b0dc2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.199419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.200274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.200636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.201029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.202102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.204037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.206772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2181/4400] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:39.207923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.211521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.224781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998c06-5334-47f7-bd07-a11d83281f51 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.230493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.231580 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2220/4401] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:39 2022] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:39.231906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.232283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.232585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.233016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.233825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.236239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.236904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.265361 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2182/4402] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:39 2022] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:39.266340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.277865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754d396-1bde-4168-8a8b-c543ece10bb9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.321242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e6fd7-cfce-49d9-9982-83d45fed12c7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.325956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.327074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.327353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.327624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.344859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.346009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.346288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.346560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.347245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.349621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.411738 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2183/4403] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:39 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:39.411738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.420824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.422433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.434662 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2221/4404] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:39.435599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.448137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d256-3540-49bf-8048-56699f357328 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.498289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d077fc-8a62-42f8-b337-2f669389ce5f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.506892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.507584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.507922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.508832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.509694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.512281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.524918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:39.534143 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2184/4405] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:39.535347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.545385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.546054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.546547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.546892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/07eb9a3c49e940fbb18922545677e2e6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.548872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=07eb9a3c49e940fbb18922545677e2e6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.549301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5605a9-eb91-49d3-b831-a959d6bda8da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.553434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.554949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.555601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.556222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.556222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.556400 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2222/4406] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/projects/07eb9a3c49e940fbb18922545677e2e6 => generated 405 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:39.560284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.561259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.561982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.573602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2bf57-ec63-4583-97da-dde864aa6ed7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.576474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2185/4407] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:39.577410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.581537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.582215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.582490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.583039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/07eb9a3c49e940fbb18922545677e2e6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.584948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=07eb9a3c49e940fbb18922545677e2e6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.587711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.590341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e371f-17ed-41d1-8bec-331701c59b15 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.598832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.599500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.600258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.600549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] PATH_INFO: `/v3/projects/6199b6b817e54eee8f9cc85292152fc4/users/af2f8147d8aa4fbfafc8a8fd322f06d5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.615799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:39.621435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6199b6b817e54eee8f9cc85292152fc4, user_id=af2f8147d8aa4fbfafc8a8fd322f06d5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.625462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b830a4d-33a9-41ac-ad76-00a059e8762c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.655663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2186/4408] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:39 2022] PUT /identity/v3/projects/6199b6b817e54eee8f9cc85292152fc4/users/af2f8147d8aa4fbfafc8a8fd322f06d5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:39.658315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.658651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.658923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.661131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07eb9a3c49e940fbb18922545677e2e6', 'request_id': 'req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.695213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07eb9a3c49e940fbb18922545677e2e6', 'request_id': 'req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.697692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] MFA Rules not processed for user `af2f8147d8aa4fbfafc8a8fd322f06d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:39.698926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.710352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07eb9a3c49e940fbb18922545677e2e6', 'request_id': 'req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.738172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 07eb9a3c49e940fbb18922545677e2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:39.738626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.739860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.742508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2223/4409] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:39 2022] DELETE /identity/v3/projects/07eb9a3c49e940fbb18922545677e2e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:39.747479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.750182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.780970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2187/4410] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:39.793566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.795346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:39.837927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef6a-7f8a-4bb1-b646-6dc0db13c428 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.843514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:39.844291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:39.844643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:39.845317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:39.847634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b3ccb4c38b7e427cb6730f19e3dc2c5d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:39.849458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:39.880394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.881540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.920930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33796a3b-8b8c-4c92-98d1-294b3397e08c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:39.925469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.927290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:39.933127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2224/4411] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:39 2022] PATCH /identity/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d => generated 277 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:39.938906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:39.941821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.027958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:40.049580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.050372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.050650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.050918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.053120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.061232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbada65c-ae66-4602-9e03-61bd45ca6f9b tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.067116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.067917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.068263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.068735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] PATH_INFO: `/v3/projects/776a1f70fb6346b3b52a0daec1cd442b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.071785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776a1f70fb6346b3b52a0daec1cd442b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.073810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.129843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776a1f70fb6346b3b52a0daec1cd442b', 'request_id': 'req-3c13eef2-d83d-4297-9832-6aba5d0f31b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.137640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776a1f70fb6346b3b52a0daec1cd442b', 'request_id': 'req-3c13eef2-d83d-4297-9832-6aba5d0f31b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.140612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:40.145475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776a1f70fb6346b3b52a0daec1cd442b', 'request_id': 'req-3c13eef2-d83d-4297-9832-6aba5d0f31b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.156826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.159007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.164469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] The token cache is being invalidate because project 776a1f70fb6346b3b52a0daec1cd442b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:40.164908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.166259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.170680 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2225/4412] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:39 2022] DELETE /identity/v3/projects/776a1f70fb6346b3b52a0daec1cd442b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:40.170680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.170680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.172325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2188/4413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:23:40.173219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.198495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d625c5c-fef1-4e7e-abcc-19a454b7b22e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.254851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13eef2-d83d-4297-9832-6aba5d0f31b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.264726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.265400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.265703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.265973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.277812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.278450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.278730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.279003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] PATH_INFO: `/v3/users/72242c99fdfd465cab878df6b90e7f72` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.280251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b3ccb4c38b7e427cb6730f19e3dc2c5d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.280593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72242c99fdfd465cab878df6b90e7f72)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.282519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.283179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.313966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.319068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.358274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72242c99fdfd465cab878df6b90e7f72'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.359237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72242c99fdfd465cab878df6b90e7f72'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.370421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72242c99fdfd465cab878df6b90e7f72'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.371548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72242c99fdfd465cab878df6b90e7f72'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.382875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72242c99fdfd465cab878df6b90e7f72'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.385769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:40.409627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.411998 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2189/4414] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:40 2022] DELETE /identity/v3/users/72242c99fdfd465cab878df6b90e7f72 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:40.418103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.425223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.441610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project b3ccb4c38b7e427cb6730f19e3dc2c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:40.441954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.442676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.454618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.455273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.456007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b3ccb4c38b7e427cb6730f19e3dc2c5d', 'request_id': 'req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:40.467438 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2226/4415] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:40 2022] DELETE /identity/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:40.474837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.476365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.621128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d12506-d5a3-4801-8958-f7eed0ec5cd5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.630037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.631031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.631031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.631316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.631900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.634105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.658942 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2190/4416] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:23:40 2022] POST /identity/v3/domains => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:40.663004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.669632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.757602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70047-56a3-48e4-92e0-7b5c0e3c5679 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.830640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.832983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:40.835650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:40.836345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:40.837258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:40.837604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:40.838368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:40.840669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:40.842484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:40.936420 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2227/4417] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:40 2022] POST /identity/v3/projects => generated 410 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:40.937645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:40.955476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae222c56-c5e2-414f-99f5-9340e7d2b1ad tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:40.982189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:41.032654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.033827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.034164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.034743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] PATH_INFO: `/v3/projects/e7a64a020c9e40eab4e80df8587c75d2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.035946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fd3bd-b3f1-48f6-8228-153fa9996ff6 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.037693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a64a020c9e40eab4e80df8587c75d2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.040943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.044356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.045294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.045575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.046102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.046758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.048770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.107060 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2228/4418] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:40 2022] POST /identity/v3/projects => generated 404 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:41.112471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.141165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a64a020c9e40eab4e80df8587c75d2', 'request_id': 'req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.161196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a64a020c9e40eab4e80df8587c75d2', 'request_id': 'req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.174141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a64a020c9e40eab4e80df8587c75d2', 'request_id': 'req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.189188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] The token cache is being invalidate because project e7a64a020c9e40eab4e80df8587c75d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:41.189649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.191851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94d8e77f-06a4-4193-b27b-fc9e8d1510f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.198335 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2191/4419] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:40 2022] DELETE /identity/v3/projects/e7a64a020c9e40eab4e80df8587c75d2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:41.240024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93de6a-2145-4a72-9cf6-e4e5c6b11217 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.240406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93de6a-2145-4a72-9cf6-e4e5c6b11217 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.252155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93de6a-2145-4a72-9cf6-e4e5c6b11217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.285948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040845-d593-4e3a-bdfc-a4635ff5a543 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.313170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7b93de6a-2145-4a72-9cf6-e4e5c6b11217 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:41.320471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b93de6a-2145-4a72-9cf6-e4e5c6b11217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:41.407615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:41.444759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.445474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.446365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.446646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/fa04fb3b73e846f5b63a50b4ad949357` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.448190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa04fb3b73e846f5b63a50b4ad949357)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.450354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.478305 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2192/4420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:41.487123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.487533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.487831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.518852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:41.520194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:41.540894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa04fb3b73e846f5b63a50b4ad949357', 'request_id': 'req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.550000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa04fb3b73e846f5b63a50b4ad949357', 'request_id': 'req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.561221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:41.568900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa04fb3b73e846f5b63a50b4ad949357', 'request_id': 'req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.616593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project fa04fb3b73e846f5b63a50b4ad949357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:41.617062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.618514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.623453 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2229/4421] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:41 2022] DELETE /identity/v3/projects/fa04fb3b73e846f5b63a50b4ad949357 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:41.625020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.627190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:41.645671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2193/4422] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:41.648776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.662804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0a5e-57dc-4eaa-bee7-661a3843226c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.673735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.675102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.675380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.675814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.676619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:41.677175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.679027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.750801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2194/4423] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:41.752429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.754240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad682a-e0c1-48d9-9c77-bdb9925d23d9 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.770003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d2d33-f50e-42d9-b9ae-931366bb07db admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.775544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.776210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.776363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:41.776481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.776743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/17fc640a3e674fadbfeb69f334dec0f6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.777718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:41.777981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17fc640a3e674fadbfeb69f334dec0f6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.778333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:41.778851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:41.779907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.780046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:41.783551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:41.828723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2195/4424] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:41 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:41.830248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.860388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fc640a3e674fadbfeb69f334dec0f6', 'request_id': 'req-ad076032-5845-4f34-b69a-3a589b170de5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.870863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fc640a3e674fadbfeb69f334dec0f6', 'request_id': 'req-ad076032-5845-4f34-b69a-3a589b170de5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.879843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fc640a3e674fadbfeb69f334dec0f6', 'request_id': 'req-ad076032-5845-4f34-b69a-3a589b170de5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.899106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 17fc640a3e674fadbfeb69f334dec0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:41.899440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.900252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:41.902261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2230/4425] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:41 2022] DELETE /identity/v3/projects/17fc640a3e674fadbfeb69f334dec0f6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:41.907296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:41.908873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:41.921993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f5bfb-6bdd-449d-8aac-125c3f256c53 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:41.999206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:42.001436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076032-5845-4f34-b69a-3a589b170de5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.007784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.009017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.009310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.009718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/1d506ce16a904e3288aaff8d700cbee7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.011289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1d506ce16a904e3288aaff8d700cbee7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.011917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.012610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.012951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.013101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.013668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.014127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.016150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.042744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.043853 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2196/4426] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:41 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:42.044001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.046830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:42.047700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.050650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.073834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ac4e-b068-4ae9-b654-8909169a9fea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.083824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.084887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.088140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2231/4427] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:41 2022] PATCH /identity/v3/domains/1d506ce16a904e3288aaff8d700cbee7 => generated 276 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:42.092786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.094558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.151543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.152370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.152650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.152925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.153890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.155816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.174322 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2197/4428] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:42.176038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.178122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.193515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f7781-4bb4-4878-8d8d-8c4ed2a6d728 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.194464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec612e-a857-44d4-8c04-eebbd8cee87e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.200181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.200911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.201410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.201573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.201892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/1d506ce16a904e3288aaff8d700cbee7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.202086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.202998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.203285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.204000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.206615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.219478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1d506ce16a904e3288aaff8d700cbee7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.221189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.225763 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2198/4429] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:42.231930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.248494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88368d-7d99-43c1-a0a8-5d8e7bb2ba77 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.257020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.259040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.260653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.261706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.261958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.262391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] PATH_INFO: `/v3/projects/6f95454248764500a482ef1fabb3506a/users/27d37620fb2c4417a6fc70cc61e0fc5e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.286011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f95454248764500a482ef1fabb3506a, user_id=27d37620fb2c4417a6fc70cc61e0fc5e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.289098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6e207-2cda-4948-86b9-9cf14a455143 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.309775 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2199/4430] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:42 2022] PUT /identity/v3/projects/6f95454248764500a482ef1fabb3506a/users/27d37620fb2c4417a6fc70cc61e0fc5e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:42.328445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.328727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.329023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.330547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.339424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.358475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.376952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 1d506ce16a904e3288aaff8d700cbee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:42.377375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.378494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.384665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] MFA Rules not processed for user `27d37620fb2c4417a6fc70cc61e0fc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:42.386656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.393165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.394968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.395841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1d506ce16a904e3288aaff8d700cbee7', 'request_id': 'req-536b8998-e355-4ffc-ac23-f20359e8f5c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.413540 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2232/4431] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:42 2022] DELETE /identity/v3/domains/1d506ce16a904e3288aaff8d700cbee7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:42.422299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.424153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.480330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:42.496188 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2200/4432] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:42.497695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.511430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce2cf3-f217-49c0-a6ba-f63e9d47f91e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.516985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27d37620fb2c4417a6fc70cc61e0fc5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f95454248764500a482ef1fabb3506a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.520512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.520847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.521188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.530351 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2201/4433] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3 => generated 255 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:42.531620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.557487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830ae5e-ef7d-461e-bbf5-66b37cdb827e tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.566571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27d37620fb2c4417a6fc70cc61e0fc5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f95454248764500a482ef1fabb3506a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.567286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.567572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.567968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.574767 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2202/4434] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3 => generated 255 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:42.575806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.583492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b8998-e355-4ffc-ac23-f20359e8f5c8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.589847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.590561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.591091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.591634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.592718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.594229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58935ed9-6b9d-4820-b67b-fcc29e681f2b tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.597278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.602672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea6056-8fc3-497b-8d08-281dcc366184 tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27d37620fb2c4417a6fc70cc61e0fc5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f95454248764500a482ef1fabb3506a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.603581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6056-8fc3-497b-8d08-281dcc366184 tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.604487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6056-8fc3-497b-8d08-281dcc366184 tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.605103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6056-8fc3-497b-8d08-281dcc366184 tempest-TestApiDiscovery-1983082507 tempest-TestApiDiscovery-1983082507-project] PATH_INFO: `/v3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.613629 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2203/4435] 10.222.0.78 () {58 vars in 1104 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3 => generated 255 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:42.617406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c6ff4-e9f2-4784-a83f-d9ef9f849035 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.618568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c6ff4-e9f2-4784-a83f-d9ef9f849035 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.620486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c6ff4-e9f2-4784-a83f-d9ef9f849035 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.623145 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2204/4436] 10.222.0.78 () {56 vars in 895 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:23:42.629020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.629357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.629609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.631405 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2205/4437] 10.222.0.78 () {56 vars in 895 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:23:42.639426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.642770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:42.667183 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2233/4438] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:42 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:42.671514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.674485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:42.744145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3bf0f-803e-40ee-90c4-ebf362a70419 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.774988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c925a-b8aa-4328-8bea-9d3221193c08 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.791792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.792445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.792728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.793052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/20040687f9864603a0c0dc447a9156a2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.794964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=20040687f9864603a0c0dc447a9156a2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.797331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.799038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2234/4439] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3/projects/20040687f9864603a0c0dc447a9156a2 => generated 377 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:42.804552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.823656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09c9cb-24cf-4ce0-9fe9-66d77ae7fdc5 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.830303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.831083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.831376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.831685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.832464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.834500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.849102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.849748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.850021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.850286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] PATH_INFO: `/v3/users/27d37620fb2c4417a6fc70cc61e0fc5e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.852055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d37620fb2c4417a6fc70cc61e0fc5e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.855379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.866435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2235/4440] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:23:42 2022] GET /identity/v3/projects => generated 6582 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:42.883912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:42.895466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f5c1-1c50-456b-8f53-cb99ede71334 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:42.903304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:42.904169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:42.904612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:42.905097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/20040687f9864603a0c0dc447a9156a2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:42.907151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20040687f9864603a0c0dc447a9156a2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:42.909479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:42.967444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d37620fb2c4417a6fc70cc61e0fc5e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.969499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d37620fb2c4417a6fc70cc61e0fc5e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.979107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d37620fb2c4417a6fc70cc61e0fc5e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.979975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d37620fb2c4417a6fc70cc61e0fc5e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:42.991128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e8bb1480-f498-48b7-adfd-a2026a0138bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d37620fb2c4417a6fc70cc61e0fc5e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.003121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20040687f9864603a0c0dc447a9156a2', 'request_id': 'req-661e1e32-422b-4ce6-b528-dff15546f59d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.013023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20040687f9864603a0c0dc447a9156a2', 'request_id': 'req-661e1e32-422b-4ce6-b528-dff15546f59d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.015259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2206/4441] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:42 2022] DELETE /identity/v3/users/27d37620fb2c4417a6fc70cc61e0fc5e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:43.022909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20040687f9864603a0c0dc447a9156a2', 'request_id': 'req-661e1e32-422b-4ce6-b528-dff15546f59d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.023083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.023284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.023522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.047043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 20040687f9864603a0c0dc447a9156a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:43.047420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.048509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.051053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:43.052438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:43.055188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2236/4442] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:42 2022] DELETE /identity/v3/projects/20040687f9864603a0c0dc447a9156a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:43.056048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.057867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:43.088875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:43.106470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:43.154110 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2207/4443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:43.164176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.167745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:43.178296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1e32-422b-4ce6-b528-dff15546f59d tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.260275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.262312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.262723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.263218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.264716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.267060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.271427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb98d96-676b-41dd-b894-41001528b766 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.278912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.280421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.280707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.281186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.297403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.299174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.317039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2208/4444] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:23:43.327214 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2237/4445] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:43 2022] POST /identity/v3/projects => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:43.328428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.343240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598c777-cdf8-4cbb-825c-5045d530bdf2 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.429682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.431391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.431839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.432265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.434165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_project(project_id=f5b73ee6cd0841cfa7ea9cd01e442994)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.436647 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:43.436647 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:23:43.436647 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:23:43.439083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.500805 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2209/4446] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:23:43 2022] PATCH /identity/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994 => generated 360 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:43.504775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.532016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb9780-8c26-4793-b1b5-0894c5e6be6a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.544231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.544892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.545200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.545476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.567701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=f5b73ee6cd0841cfa7ea9cd01e442994)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.569974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.574907 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2238/4447] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:43 2022] GET /identity/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994 => generated 347 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:43.576557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.591487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e1af6-d718-4c98-a08a-0f535a9782f1 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.600274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.601054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.601597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.602724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.616925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5b73ee6cd0841cfa7ea9cd01e442994)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.616925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.700083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b73ee6cd0841cfa7ea9cd01e442994', 'request_id': 'req-cc69ed11-29a2-408a-9af7-23a8e80d226e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.710993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b73ee6cd0841cfa7ea9cd01e442994', 'request_id': 'req-cc69ed11-29a2-408a-9af7-23a8e80d226e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.720716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b73ee6cd0841cfa7ea9cd01e442994', 'request_id': 'req-cc69ed11-29a2-408a-9af7-23a8e80d226e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.723161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:43.741525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project f5b73ee6cd0841cfa7ea9cd01e442994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:43.742039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.744141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:43.749084 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2210/4448] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:43 2022] DELETE /identity/v3/projects/f5b73ee6cd0841cfa7ea9cd01e442994 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:43.754137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.756521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:43.775850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf0dc0-dcc8-41f5-8ba6-935d7c8ba0a8 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:43.857282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:43.859268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:43.911792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:43.912573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:43.914084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:43.914378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:43.916024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:43.918235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:43.979037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2239/4449] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:43 2022] POST /identity/v3/projects => generated 360 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:43.984756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.009329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69ed11-29a2-408a-9af7-23a8e80d226e tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.033154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:44.090550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.091205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.091486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.091887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] PATH_INFO: `/v3/projects/6f95454248764500a482ef1fabb3506a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.093165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f95454248764500a482ef1fabb3506a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.095505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.138203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a838a9b-ad75-4589-b709-32647fcaae3f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.157790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.160267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.160715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.163398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.168706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_project(project_id=5487b581bc194c1e8c0ecc57cdfc09ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.171101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.185437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f95454248764500a482ef1fabb3506a', 'request_id': 'req-3c39f58a-2100-41b8-a568-3345f2614b90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.196742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f95454248764500a482ef1fabb3506a', 'request_id': 'req-3c39f58a-2100-41b8-a568-3345f2614b90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.206154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f95454248764500a482ef1fabb3506a', 'request_id': 'req-3c39f58a-2100-41b8-a568-3345f2614b90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.223044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] The token cache is being invalidate because project 6f95454248764500a482ef1fabb3506a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:44.223338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.233643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c39f58a-2100-41b8-a568-3345f2614b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.235581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2211/4450] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:43 2022] DELETE /identity/v3/projects/6f95454248764500a482ef1fabb3506a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:44.248731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84f18-d884-4be6-b422-099c1ee0a700 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.248731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84f18-d884-4be6-b422-099c1ee0a700 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.248731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee84f18-d884-4be6-b422-099c1ee0a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.291433 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2240/4451] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:23:43 2022] PATCH /identity/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef => generated 372 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:44.292830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2ee84f18-d884-4be6-b422-099c1ee0a700 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:44.295647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.296206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ee84f18-d884-4be6-b422-099c1ee0a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:44.299548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:44.316307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291d5f0-8963-4e87-b2e3-3b79553c49cd tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.343805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:44.400470 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2212/4452] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:44.409564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.410118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.410401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.421794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.422469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.422788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.423034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.433973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:44.435187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:44.436079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=5487b581bc194c1e8c0ecc57cdfc09ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.441419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.449506 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2241/4453] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:44 2022] GET /identity/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef => generated 359 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:44.449807 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2213/4454] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:44.450460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.451124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.462576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67195271-69ae-405f-9c38-d5dfc1fa787d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.462815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e30f7-68aa-417c-8487-e7efa6b25db7 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.467710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.468450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.468803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.469224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.469344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.470016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.470319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.470496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:44.470610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.471107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.472432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5487b581bc194c1e8c0ecc57cdfc09ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.472865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.475564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.486863 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2214/4455] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:44.491871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.503997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78eab7-5564-456e-a526-8fab08cb709a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.510237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.511066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.511570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.512088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.512821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.514864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.550032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2215/4456] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:44.551679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5487b581bc194c1e8c0ecc57cdfc09ef', 'request_id': 'req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.554537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.572186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5487b581bc194c1e8c0ecc57cdfc09ef', 'request_id': 'req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.589421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5487b581bc194c1e8c0ecc57cdfc09ef', 'request_id': 'req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.605491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:44.622188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 5487b581bc194c1e8c0ecc57cdfc09ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:44.622188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.623155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:44.625548 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2242/4457] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:44 2022] DELETE /identity/v3/projects/5487b581bc194c1e8c0ecc57cdfc09ef => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:44.630679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.640622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:44.705992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6712ff-87e6-4666-9e74-43e5499b5504 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.734890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.739025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.740619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.740975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.742941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.746939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.780773 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2216/4458] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:44.783860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6bd6-4692-46da-96e2-c1fe5f78872f tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.785287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.786795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:44.800944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370921-1d21-4452-be3a-ee51352a2a13 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.806473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.807047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.807381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.807644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.808487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.810747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.832030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2217/4459] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:44.833499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.853126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82145d7f-8e3f-433c-9b22-3c1bdf7ca1ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.859314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.859927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.860628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.860899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.862222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.864183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.871396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.872029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.872305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.872576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.873360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.875274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.881610 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2218/4460] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:44.885727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.897513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727233-d281-413b-8820-92553a5f9dbd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.903025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:44.903664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.903937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.904201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] PATH_INFO: `/v3/projects/3757940c4866417488396e533ad94d21/users/29356338c93d4e0e80fbfd4a01dc2b98/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.908535 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2243/4461] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/projects => generated 354 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:44.913483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:44.920785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3757940c4866417488396e533ad94d21, user_id=29356338c93d4e0e80fbfd4a01dc2b98, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:44.923451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcbf56-edc1-4f26-b183-8f1eaa400a0c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:44.942138 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2219/4462] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:44 2022] PUT /identity/v3/projects/3757940c4866417488396e533ad94d21/users/29356338c93d4e0e80fbfd4a01dc2b98/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:44.953168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:44.953466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:44.953734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:44.982787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] MFA Rules not processed for user `29356338c93d4e0e80fbfd4a01dc2b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:44.983630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590ccef-e5a9-46aa-94e4-c4171bedf1ea tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:44.984022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.003074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:45.021771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:45.049569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.050223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.050488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.050844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/521692ce81d64ca3b23647b50df65522` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.052010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:update_project(project_id=521692ce81d64ca3b23647b50df65522)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.054131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.059170 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2220/4463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:45.063954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.073289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820e148-55c5-4372-9f42-b3728dbc4bb8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.077486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29356338c93d4e0e80fbfd4a01dc2b98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3757940c4866417488396e533ad94d21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.078066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.078344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.078617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.079186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.080330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.082294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2221/4464] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:23:45 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:45.088628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.095503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2244/4465] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:23:44 2022] PATCH /identity/v3/projects/521692ce81d64ca3b23647b50df65522 => generated 369 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:45.096522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.106810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4f769-0908-46b2-b615-32296543e15c tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.112441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.113208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.113489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.113761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/521692ce81d64ca3b23647b50df65522` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.124864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:get_project(project_id=521692ce81d64ca3b23647b50df65522)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.126938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.128646 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2245/4466] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:45 2022] GET /identity/v3/projects/521692ce81d64ca3b23647b50df65522 => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:45.132605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.143268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94712737-4af6-47e0-8c5e-bd0e1248eb88 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.147860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.148486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.148784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.149649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/projects/521692ce81d64ca3b23647b50df65522` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.150777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=521692ce81d64ca3b23647b50df65522)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.152648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.156283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4af10-70e8-4384-9a31-58def784c1f9 tempest-IdentityCatalogTest-743891595 tempest-IdentityCatalogTest-743891595-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.162346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.163162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.163436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.165550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] PATH_INFO: `/v3/users/29356338c93d4e0e80fbfd4a01dc2b98` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.166842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=29356338c93d4e0e80fbfd4a01dc2b98)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.168833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.210232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521692ce81d64ca3b23647b50df65522', 'request_id': 'req-46e7ee92-9e40-4ec3-95c8-b61549d57164'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.218212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521692ce81d64ca3b23647b50df65522', 'request_id': 'req-46e7ee92-9e40-4ec3-95c8-b61549d57164'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.224849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29356338c93d4e0e80fbfd4a01dc2b98'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.225562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29356338c93d4e0e80fbfd4a01dc2b98'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.228741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521692ce81d64ca3b23647b50df65522', 'request_id': 'req-46e7ee92-9e40-4ec3-95c8-b61549d57164'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.235968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29356338c93d4e0e80fbfd4a01dc2b98'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.236825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29356338c93d4e0e80fbfd4a01dc2b98'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.245623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] The token cache is being invalidate because project 521692ce81d64ca3b23647b50df65522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:45.245906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-87d24816-b937-46d8-a912-a5d5847c46bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29356338c93d4e0e80fbfd4a01dc2b98'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.246002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.246663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.249414 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2246/4467] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:45 2022] DELETE /identity/v3/projects/521692ce81d64ca3b23647b50df65522 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:45.254669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.264559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.274513 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2222/4468] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:45 2022] DELETE /identity/v3/users/29356338c93d4e0e80fbfd4a01dc2b98 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:45.277109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.277456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.277939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.302365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:45.304098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.349227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:45.379364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7ee92-9e40-4ec3-95c8-b61549d57164 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.400218 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2223/4469] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:45.413075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.414781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:45.415237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.457886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.458751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.459103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.459447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/1d506ce16a904e3288aaff8d700cbee7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.467791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Could not find domain: 1d506ce16a904e3288aaff8d700cbee7.: keystone.exception.DomainNotFound: Could not find domain: 1d506ce16a904e3288aaff8d700cbee7. Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1d506ce16a904e3288aaff8d700cbee7. Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:45.473247 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:45.474487 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1d506ce16a904e3288aaff8d700cbee7. Oct 18 16:23:45.475694 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.477092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2247/4470] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:45 2022] PATCH /identity/v3/domains/1d506ce16a904e3288aaff8d700cbee7 => generated 112 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 16:23:45.478457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.491078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ab9f-8e3a-480f-b21f-e0ffa5de8e4a tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.491737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd93ad-e33c-4174-97f8-2644f58c8342 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.495887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.496351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75902c47d50d4a07810dfa964a4fd979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6d5b0117664b43b5dbae2f76300fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.496471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.496749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.496956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.497082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.497261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.497533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] PATH_INFO: `/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.504680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:23:45.506943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.509263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ac16-320f-4751-a9ad-5a4e44a4b086 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Could not find domain: b3ccb4c38b7e427cb6730f19e3dc2c5d.: keystone.exception.DomainNotFound: Could not find domain: b3ccb4c38b7e427cb6730f19e3dc2c5d. Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b3ccb4c38b7e427cb6730f19e3dc2c5d. Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:45.510297 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:45.511489 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b3ccb4c38b7e427cb6730f19e3dc2c5d. Oct 18 16:23:45.512603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:45.514841 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2248/4471] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:23:45 2022] PATCH /identity/v3/domains/b3ccb4c38b7e427cb6730f19e3dc2c5d => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 16:23:45.515676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.517411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.520143 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2224/4472] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:23:45.532912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559bad-6163-43a2-b3f9-9dc74669dcd0 tempest-ProjectsTestJSON-1017083966 tempest-ProjectsTestJSON-1017083966-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.537665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.538290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.538566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.538839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] PATH_INFO: `/v3/users/ed026fa115214d62b8d1094d6c605b96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.540109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed026fa115214d62b8d1094d6c605b96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.542200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.594300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed026fa115214d62b8d1094d6c605b96'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.602454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed026fa115214d62b8d1094d6c605b96'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.603235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed026fa115214d62b8d1094d6c605b96'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.611413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed026fa115214d62b8d1094d6c605b96'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.612042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed026fa115214d62b8d1094d6c605b96'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.631437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2249/4473] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:45 2022] DELETE /identity/v3/users/ed026fa115214d62b8d1094d6c605b96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:45.637686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.637972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.638245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.657884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:45.659094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.725872 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2225/4474] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:45.737763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.739549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.817274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59cc63-d5d2-42fc-a1f5-24bb925c874c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.821516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.822250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.822599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.823018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.839396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.840340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:45.841795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:45.842013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39ae5-e83f-40f5-94b9-ae603ffa053a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.859070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599236-8dcb-4d32-9c85-d9d462395ff0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:45.861800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2250/4475] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:45.865118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:45.865908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:45.866240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:45.866580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] PATH_INFO: `/v3/projects/3757940c4866417488396e533ad94d21` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:45.868669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3757940c4866417488396e533ad94d21)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:45.870836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:45.952268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3757940c4866417488396e533ad94d21', 'request_id': 'req-4bbdba52-5c5d-41c6-bef0-80b61457dc16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.962488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3757940c4866417488396e533ad94d21', 'request_id': 'req-4bbdba52-5c5d-41c6-bef0-80b61457dc16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.973154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3757940c4866417488396e533ad94d21', 'request_id': 'req-4bbdba52-5c5d-41c6-bef0-80b61457dc16'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.995329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] The token cache is being invalidate because project 3757940c4866417488396e533ad94d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:45.995717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:45.996298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbdba52-5c5d-41c6-bef0-80b61457dc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.012344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2226/4476] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:45 2022] DELETE /identity/v3/projects/3757940c4866417488396e533ad94d21 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:46.012716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.012716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.012716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.039529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:46.040893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.106550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:46.163901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2251/4477] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:46.172933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.173247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.173516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.184570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:46.200598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:46.201911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.213045 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2227/4478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:46.215559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.225482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591802-2114-4885-85ac-e5724aef0ca4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.230579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.231231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.231564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.231763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.232417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:46.232714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.234426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.248027 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2252/4479] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:46.252505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.267006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0b891-ab87-4216-b2f8-1c1e9bd3617f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.277408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.278349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.278645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.278943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.279607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.281811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.298753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.300681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.318573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b3b-5aa2-4f3e-8598-d0c0acd24a7f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.325463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.326113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.326390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.326664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] PATH_INFO: `/v3/projects/5de7f25f890c4a379bfaca485409a363` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.328289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de7f25f890c4a379bfaca485409a363)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.331304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.337044 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2228/4480] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:46.339439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.387618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de7f25f890c4a379bfaca485409a363', 'request_id': 'req-a799b59a-5639-4585-9d63-90dd6535caef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.395556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de7f25f890c4a379bfaca485409a363', 'request_id': 'req-a799b59a-5639-4585-9d63-90dd6535caef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.403522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de7f25f890c4a379bfaca485409a363', 'request_id': 'req-a799b59a-5639-4585-9d63-90dd6535caef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.420936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81c71-2c70-43dc-82a9-f0f6b1189ce8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.423337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] The token cache is being invalidate because project 5de7f25f890c4a379bfaca485409a363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:46.423737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.424630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.428014 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2253/4481] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:46 2022] DELETE /identity/v3/projects/5de7f25f890c4a379bfaca485409a363 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:46.432985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.435693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.507063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.507841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.508956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.509321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.510167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.512523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.547194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2229/4482] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:46.552372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.557342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.569748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799b59a-5639-4585-9d63-90dd6535caef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.575694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.576477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.576856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.577426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] PATH_INFO: `/v3/users/75902c47d50d4a07810dfa964a4fd979` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.578676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75902c47d50d4a07810dfa964a4fd979)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.580775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.582231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883d0b-6cca-4824-adf7-7fcdd9b2ae1a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.609652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.610640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.610929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.611195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.611960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.616484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.643313 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2230/4483] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:46.647618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.662002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e1ca7-049c-4fe2-aee6-90bd0496b9bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.663615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75902c47d50d4a07810dfa964a4fd979'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.669201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:46.671808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.672385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.672747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.673244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.673817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.675479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.684073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75902c47d50d4a07810dfa964a4fd979'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.684655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75902c47d50d4a07810dfa964a4fd979'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.689578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2231/4484] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:46.693523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.698571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75902c47d50d4a07810dfa964a4fd979'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.699453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8b6f2773-d739-423a-b58e-e67952ff354d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75902c47d50d4a07810dfa964a4fd979'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:46.704894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e8452-9fdd-4892-a591-9ad9fd506480 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.711344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.711772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.712122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.712472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] PATH_INFO: `/v3/projects/e01f0d7cb5604b6592d5f37cecd24ba6/users/3b9989d810824b4799a1db698e12bff1/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.729876 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2254/4485] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:46 2022] DELETE /identity/v3/users/75902c47d50d4a07810dfa964a4fd979 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:46.735453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01f0d7cb5604b6592d5f37cecd24ba6, user_id=3b9989d810824b4799a1db698e12bff1, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:46.739035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:46.774932 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2232/4486] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:46 2022] PUT /identity/v3/projects/e01f0d7cb5604b6592d5f37cecd24ba6/users/3b9989d810824b4799a1db698e12bff1/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:46.786476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.786892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.787239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:46.827754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:46.829181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:46.912179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2255/4487] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:46.917777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:46.935301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d44741-79ea-450a-9c06-93e04b06f072 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:46.947201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b02fc-2873-44e5-b298-4b6c7c8bf1fd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:46.948013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b02fc-2873-44e5-b298-4b6c7c8bf1fd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:46.955799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b02fc-2873-44e5-b298-4b6c7c8bf1fd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:46.957298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b02fc-2873-44e5-b298-4b6c7c8bf1fd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.019751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:47.032483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ea1b02fc-2873-44e5-b298-4b6c7c8bf1fd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.053289 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2233/4488] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:46 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:47.127787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.129310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:47.257318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006062b-a653-4ca9-af84-3fabb61cb6f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.267704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.267704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.267704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.267704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] PATH_INFO: `/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.268159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6d5b0117664b43b5dbae2f76300fa6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.268159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.318781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6d5b0117664b43b5dbae2f76300fa6', 'request_id': 'req-89209393-5b55-4e3f-9cac-3bdb3b587c04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.326481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6d5b0117664b43b5dbae2f76300fa6', 'request_id': 'req-89209393-5b55-4e3f-9cac-3bdb3b587c04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.331082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:47.333774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6d5b0117664b43b5dbae2f76300fa6', 'request_id': 'req-89209393-5b55-4e3f-9cac-3bdb3b587c04'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.349035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] The token cache is being invalidate because project 9c6d5b0117664b43b5dbae2f76300fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:47.349339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.350014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-89209393-5b55-4e3f-9cac-3bdb3b587c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:47.351551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2256/4489] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:47 2022] DELETE /identity/v3/projects/9c6d5b0117664b43b5dbae2f76300fa6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:47.357108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.357776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.358080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.380648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:47.382110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:47.454249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2234/4490] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:47.462543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.462860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.463128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.488460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:47.490089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:47.499694 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2257/4491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:47.503892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.513857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3485dbf-c962-4255-a682-a68f05cae680 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.518507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.519175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.519453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.519737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.520534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:47.520929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.522637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.535310 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2235/4492] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:47.539926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.550199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4acddf-556a-4a9d-bec3-11bf703b0ed4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.556320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.556962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.557267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.557535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.558178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.560059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.591574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2258/4493] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:47 2022] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:47.592755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.603705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f02b-a2c3-4ad9-9294-ed7eb0c618dd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.668316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.668981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.669234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.669622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.670530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.672412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.697907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2236/4494] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:47 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:47.701840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.716713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748fe8-09c4-46ac-baae-008d41aed9da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.723395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.724034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.724424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.725618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.725618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.727959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.743047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2259/4495] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:23:47.744597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.755375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb4a0e-9497-4931-b598-85ad34b703a8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.761178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933411f9-4409-4652-af20-1221951be85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.761876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933411f9-4409-4652-af20-1221951be85f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.762224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933411f9-4409-4652-af20-1221951be85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.764302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933411f9-4409-4652-af20-1221951be85f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.775626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933411f9-4409-4652-af20-1221951be85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.777662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933411f9-4409-4652-af20-1221951be85f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.793742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2237/4496] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:47.797639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:47.810011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e010b81-e39a-4a20-97b3-2cc1d6504305 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:47.814884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:47.815512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.815785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.816383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] PATH_INFO: `/v3/projects/feb413cb19364a7aacfe0d2aa5d4e150/users/f9cb4679b6424f46a81067d2c8e6518e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.836958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb413cb19364a7aacfe0d2aa5d4e150, user_id=f9cb4679b6424f46a81067d2c8e6518e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:47.840091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:47.862682 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2260/4497] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:47 2022] PUT /identity/v3/projects/feb413cb19364a7aacfe0d2aa5d4e150/users/f9cb4679b6424f46a81067d2c8e6518e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:47.874168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d246e8-952e-49a2-9247-04b7d282fe3c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:47.874505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d246e8-952e-49a2-9247-04b7d282fe3c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:47.874783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d246e8-952e-49a2-9247-04b7d282fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:47.910600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-43d246e8-952e-49a2-9247-04b7d282fe3c None None] MFA Rules not processed for user `f9cb4679b6424f46a81067d2c8e6518e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:47.912098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43d246e8-952e-49a2-9247-04b7d282fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:47.977581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:48.027578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2238/4498] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:48.032614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.058040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6038-44f3-4e9d-b3cb-9b40111ceeef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.058366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6038-44f3-4e9d-b3cb-9b40111ceeef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.058682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6038-44f3-4e9d-b3cb-9b40111ceeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.079511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-126e6038-44f3-4e9d-b3cb-9b40111ceeef None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:48.080706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-126e6038-44f3-4e9d-b3cb-9b40111ceeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:48.085370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2239/4499] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:48.090146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.090608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.090998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.112040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee1ac-f25c-4d98-83ca-cbdc05d11ee6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.115600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:48.116815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:48.117335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.118749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.119435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.119847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.120561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.122761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.157079 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2261/4500] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/projects => generated 397 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:48.158234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.188577 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2240/4501] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:48.192644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.203766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001842b6-5fce-4028-b689-c7b4981390cb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.234018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ab1c-5d2b-49ae-b816-eb6baf3688bb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.240583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.241378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.241928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.242190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.243714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.246164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.267894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.268082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=91,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:48.269018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.269428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.269961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.279862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2262/4502] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/users => generated 305 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:48.285734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.303864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593ed7-c670-4cc3-af04-6a8992180a4f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.308314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.309121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.309401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.309668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.310311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.311913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:48.327132 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 16:23:48.328117 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:48.329332 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2241/4503] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 188 bytes in 136 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 18 16:23:48.332799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.334910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2263/4504] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:48.336183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.350085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b08b7-06c9-4df8-9dac-7af56a59df4b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.357114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.357702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbae41-b99e-4ea6-abdf-ae17748b68ea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.357832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.358113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.358388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] PATH_INFO: `/v3/projects/4461114eb13d4b84847beb83c7d32d54/users/5f28feabb63548aaa0c25aa7b15c2dc4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.369947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.370592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.370870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.371139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.380544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461114eb13d4b84847beb83c7d32d54, user_id=5f28feabb63548aaa0c25aa7b15c2dc4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.383703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.410379 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2264/4505] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:48 2022] PUT /identity/v3/projects/4461114eb13d4b84847beb83c7d32d54/users/5f28feabb63548aaa0c25aa7b15c2dc4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:48.413063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:48.449420 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 18 16:23:48.450310 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:48.454195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2242/4506] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 188 bytes in 122 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:23:48.459065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.472405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942f686-05b8-44e3-8956-2704cc86bd01 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.516346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a16a2f-5a58-482c-93c6-12a5c89ffd5e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.522625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.525180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.525469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.525740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.526400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.529069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.542568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2265/4507] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:48.546722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.557689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98bae-d486-45a7-ba45-f2c10320e091 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.563016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.564312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.565094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.565549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] PATH_INFO: `/v3/projects/4461114eb13d4b84847beb83c7d32d54/users/5f28feabb63548aaa0c25aa7b15c2dc4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.568023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461114eb13d4b84847beb83c7d32d54, user_id=5f28feabb63548aaa0c25aa7b15c2dc4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.572244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755da00e-51f5-4a84-b147-102a131eb01c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.588516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2266/4508] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:48 2022] PUT /identity/v3/projects/4461114eb13d4b84847beb83c7d32d54/users/5f28feabb63548aaa0c25aa7b15c2dc4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:48.590564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:48.599856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.600160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.600413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.613834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.616222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.616762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.617830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.643608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] MFA Rules not processed for user `5f28feabb63548aaa0c25aa7b15c2dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:48.645265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:48.689148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:48.708512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2243/4509] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:48.736330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2267/4510] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:48.741523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.829378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0078b8-165c-411e-b662-dc83737b3dfd tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.919853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cb4679b6424f46a81067d2c8e6518e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb413cb19364a7aacfe0d2aa5d4e150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.920571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.920916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.921274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.921967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 18 16:23:48.944337 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 18 16:23:48.946216 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:48.948204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2244/4511] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/projects => generated 136 bytes in 207 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:48.955441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:48.970174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be514ed-4faa-40f7-b625-fd24481e840c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:48.976743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:48.977494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:48.977775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:48.978052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:48.978728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:48.980951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invalid input for field 'name': '' is too short Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: On instance['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: On instance['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: '' Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise error Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application '' Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.992357 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:23:48.994060 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application '' Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:48.995085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2268/4512] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/projects => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:23:48.999600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.016458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee7683-a3ca-4374-860a-cda40e9d2858 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.023032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.023629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.024555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.024824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.025647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.028500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: On instance['name']: Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: On instance['name']: Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise error Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:49.041750 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:49.043634 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application On instance['name']: Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.044712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2245/4513] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:48 2022] POST /identity/v3/projects => generated 412 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:23:49.048672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.067562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca26af-1fa3-4d41-924f-b5a579deab9f tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.076045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.076949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.078553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.078892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects/842f9652d6f24c52a8793c795605a1f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.088164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:delete_project(project_id=842f9652d6f24c52a8793c795605a1f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.090186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Could not find project: 842f9652d6f24c52a8793c795605a1f0.: keystone.exception.ProjectNotFound: Could not find project: 842f9652d6f24c52a8793c795605a1f0. Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 18 16:23:49.113059 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 842f9652d6f24c52a8793c795605a1f0. Oct 18 16:23:49.114254 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:23:49.119550 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2269/4514] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:49 2022] DELETE /identity/v3/projects/842f9652d6f24c52a8793c795605a1f0 => generated 113 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:49.124399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.142852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840c9b6-4d0f-4bae-b282-34d8e4195bf7 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.150750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9cb4679b6424f46a81067d2c8e6518e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'feb413cb19364a7aacfe0d2aa5d4e150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.151758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.152130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.152463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.153223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 18 16:23:49.160165 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._list_projects() Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 18 16:23:49.161424 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.163257 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2246/4515] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:23:49 2022] GET /identity/v3/projects => generated 135 bytes in 39 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:23:49.170256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.190010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc30179-fc33-4a93-9309-bd1e523b348d tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.205877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.206555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.206854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.207305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.208884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.215738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.254924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:49.285657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2270/4516] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:49 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:49.290201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.303452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125f143-fb8e-4c2f-99b3-29a3186dcf60 tempest-ProjectsNegativeStaticTestJSON-766345513 tempest-ProjectsNegativeStaticTestJSON-766345513-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.403948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.404734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.405090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.405367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.406029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.408078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.430566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.sql.core [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-317358350' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:49.430566 n-d-858383-14 devstack@keystone.service[81775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 16:23:49.430566 n-d-858383-14 devstack@keystone.service[81775]: [parameters: {'id': '75930f57c3ed40cba8c3c400c6e49c92', 'name': 'tempest-project-dup-317358350', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 16:23:49.430566 n-d-858383-14 devstack@keystone.service[81775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b9c0de6d-6eac-4cc3-83e2-e017744e3f58 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-317358350, project id 75930f57c3ed40cba8c3c400c6e49c92.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-317358350, project id 75930f57c3ed40cba8c3c400c6e49c92. Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:23:49.439139 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-317358350' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 16:23:49.440160 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application yield resource Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise self.value Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 16:23:49.441553 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application session.commit() Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.session.flush() Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application compat.raise_( Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 16:23:49.442660 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 16:23:49.444240 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application conn.query(q) Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result.read() Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 16:23:49.445848 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-317358350' for key 'project.ixu_project_name_domain_id'") Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [parameters: {'id': '75930f57c3ed40cba8c3c400c6e49c92', 'name': 'tempest-project-dup-317358350', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.447372 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-317358350 at domain ID default. Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:23:49.448824 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-317358350, project id 75930f57c3ed40cba8c3c400c6e49c92. Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:23:49.452558 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2247/4517] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:23:49 2022] POST /identity/v3/projects => generated 284 bytes in 155 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 16:23:49.453367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.476429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7269-fe87-4e01-af6a-007bf9eda0c9 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.490961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f28feabb63548aaa0c25aa7b15c2dc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461114eb13d4b84847beb83c7d32d54', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.491620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.491906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.492183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] PATH_INFO: `/v3/projects/8df946bf3f6c4e64a17c82b6c52e0149` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.499236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8df946bf3f6c4e64a17c82b6c52e0149)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.501394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.551504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b084c-a4a3-488b-9189-e12081329761 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.552323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b084c-a4a3-488b-9189-e12081329761 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.553926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b084c-a4a3-488b-9189-e12081329761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.610718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-648b084c-a4a3-488b-9189-e12081329761 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:49.625238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-648b084c-a4a3-488b-9189-e12081329761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:49.625363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df946bf3f6c4e64a17c82b6c52e0149', 'request_id': 'req-0b9884b9-7ba1-48be-a6be-b520e9a85045'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.630679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df946bf3f6c4e64a17c82b6c52e0149', 'request_id': 'req-0b9884b9-7ba1-48be-a6be-b520e9a85045'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.636244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df946bf3f6c4e64a17c82b6c52e0149', 'request_id': 'req-0b9884b9-7ba1-48be-a6be-b520e9a85045'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.658931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:49.664414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] The token cache is being invalidate because project 8df946bf3f6c4e64a17c82b6c52e0149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:49.665234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.666317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.671243 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2271/4518] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:49 2022] DELETE /identity/v3/projects/8df946bf3f6c4e64a17c82b6c52e0149 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:49.678745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.682067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:49.812038 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2248/4519] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:49.814837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.815025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.815301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.817064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884b9-7ba1-48be-a6be-b520e9a85045 tempest-ProjectsNegativeStaticTestJSON-1712205767 tempest-ProjectsNegativeStaticTestJSON-1712205767-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.830396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.831058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.831356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.831622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] PATH_INFO: `/v3/users/f9cb4679b6424f46a81067d2c8e6518e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.834406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cb4679b6424f46a81067d2c8e6518e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.838094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:49.849238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:49.861097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:49.866229 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2249/4520] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:49.867090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:49.869560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:49.916767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cb4679b6424f46a81067d2c8e6518e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.926696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cb4679b6424f46a81067d2c8e6518e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.927365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cb4679b6424f46a81067d2c8e6518e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.938372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cb4679b6424f46a81067d2c8e6518e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.939682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e89101f-1444-47e0-93de-9a230bb5171e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cb4679b6424f46a81067d2c8e6518e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:49.951891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:49.962977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12afaf2-1169-441b-9e50-21f33929c4e4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:49.966889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2272/4521] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:49 2022] DELETE /identity/v3/users/f9cb4679b6424f46a81067d2c8e6518e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:49.971470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.971747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.972021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.976080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:49.978644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:49.978644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:49.978644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:49.981260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:49.997157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:49.998376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:49.998880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:50.000479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d71008-3dba-46b6-b4ae-29fa4cc5bbd4 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:50.013636 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2250/4522] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:23:50.014962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:50.015419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:50.015844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:50.056259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:50.057809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:50.123800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2273/4523] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:50.124822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:50.134618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134feeb-be55-4be3-ac67-23ca08c32f51 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:50.139793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:50.140506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:50.140796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:50.141107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:50.153475 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2251/4524] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:50.163158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:50.165302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:50.216743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.230547 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2274/4525] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:50 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:50.232626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:50.250116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bae16f-2fcf-4ed4-8fab-5c743fb5d8dc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:50.255720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:50.256504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:50.256650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:50.259244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:50.269808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:50.271206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:50.283723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2252/4526] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:23:50.723225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:50.729678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:50.775767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15ef1-9083-4d40-866a-a02cab524793 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:50.780433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:50.781367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:50.781490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:50.781716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] PATH_INFO: `/v3/projects/feb413cb19364a7aacfe0d2aa5d4e150` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:50.783466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb413cb19364a7aacfe0d2aa5d4e150)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:50.785647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:50.848889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb413cb19364a7aacfe0d2aa5d4e150', 'request_id': 'req-33014847-32e7-45e3-bb12-36b6dc817f65'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.858628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb413cb19364a7aacfe0d2aa5d4e150', 'request_id': 'req-33014847-32e7-45e3-bb12-36b6dc817f65'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.867825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb413cb19364a7aacfe0d2aa5d4e150', 'request_id': 'req-33014847-32e7-45e3-bb12-36b6dc817f65'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.893858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] The token cache is being invalidate because project feb413cb19364a7aacfe0d2aa5d4e150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:50.894194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.895808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-33014847-32e7-45e3-bb12-36b6dc817f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:50.898696 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2275/4527] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:50 2022] DELETE /identity/v3/projects/feb413cb19364a7aacfe0d2aa5d4e150 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:50.903979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:50.916366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87d1be-3429-4a7a-b9dc-013da0e48ae4 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:51.022389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:51.023195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.024279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.024684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] PATH_INFO: `/v3/users/5f28feabb63548aaa0c25aa7b15c2dc4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:51.026228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f28feabb63548aaa0c25aa7b15c2dc4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:51.028689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:51.143358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f28feabb63548aaa0c25aa7b15c2dc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.149258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f28feabb63548aaa0c25aa7b15c2dc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.172525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f28feabb63548aaa0c25aa7b15c2dc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.174255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f28feabb63548aaa0c25aa7b15c2dc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.187750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11a3da80-518f-4724-91af-486b4cd50a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f28feabb63548aaa0c25aa7b15c2dc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.226035 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2253/4528] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:50 2022] DELETE /identity/v3/users/5f28feabb63548aaa0c25aa7b15c2dc4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:51.236734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.237256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.237752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:51.262276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:51.263716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:51.271574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2276/4529] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:51.273784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.274746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.275412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:51.319972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:51.323795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:51.491751 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2254/4530] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:51.496568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:51.513427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3847b6a-1a75-44bc-9abb-5f27729215cb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:51.519222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deee65-2a92-48e7-9447-a0e250019e4d tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:51.520121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deee65-2a92-48e7-9447-a0e250019e4d tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.520494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deee65-2a92-48e7-9447-a0e250019e4d tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.520955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deee65-2a92-48e7-9447-a0e250019e4d tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:51.577917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86deee65-2a92-48e7-9447-a0e250019e4d tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.609123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2277/4531] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:51 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:51.643796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:51.645576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:51.661163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:51.793424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1af159-c4ba-49ce-a63a-ab0dd4427f87 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:51.807016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:51.807816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.808101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.808372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] PATH_INFO: `/v3/projects/4461114eb13d4b84847beb83c7d32d54` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:51.813266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4461114eb13d4b84847beb83c7d32d54)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:51.814869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:51.922899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4461114eb13d4b84847beb83c7d32d54', 'request_id': 'req-4bbf6b36-a60e-4881-8790-d6973ecd7f32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.938428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4461114eb13d4b84847beb83c7d32d54', 'request_id': 'req-4bbf6b36-a60e-4881-8790-d6973ecd7f32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.952775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4461114eb13d4b84847beb83c7d32d54', 'request_id': 'req-4bbf6b36-a60e-4881-8790-d6973ecd7f32'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.979051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] The token cache is being invalidate because project 4461114eb13d4b84847beb83c7d32d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:51.979492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.980298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4bbf6b36-a60e-4881-8790-d6973ecd7f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:51.982457 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2255/4532] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:51 2022] DELETE /identity/v3/projects/4461114eb13d4b84847beb83c7d32d54 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:51.988429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:51.989439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:51.989908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.002166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=12,keystone:SELECT=81,keystone:UPDATE=2,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:52.018466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:52.020701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:52.101847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2278/4533] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:52.110929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.111215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.111486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.137145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:52.138352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:52.150596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2256/4534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:52.152033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.163643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299f68b-f1b0-4785-b202-7868f1f07737 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.174825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.175754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.176171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.176614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.177491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:52.177977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.180359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.203142 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2279/4535] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:52.203751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.214367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5bea-a49b-4b65-a9e4-404a75bb3a11 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.222485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.224343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.224818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.225364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.226076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.229045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.276043 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2257/4536] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:52.279972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.290617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfe619-435a-4196-865e-2e76584b8f96 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.357939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.358569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.358852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.359123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.359778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.362110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.389759 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2280/4537] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:52.394252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.407417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82b0d-99c1-4be9-a916-71a87f12fa61 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.419690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.420326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.420607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.420877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.421679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.423274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.441805 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2258/4538] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:52.443420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.455118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696651-a8ce-4bd6-a6fa-6c72fefddf5c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.459936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.460606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.461054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.461638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.462293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.463886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b287fb-c0d5-4fd9-bab8-5575235c6704 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.475136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2281/4539] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:52.480043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.490993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913158-3b87-4c13-994c-7581f6419904 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.497084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.497981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.498762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.498762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] PATH_INFO: `/v3/projects/a569a3d86c9942c3aaa0ee73def5367b/users/4316ea69ca614a28a5e658f4dbd4ded0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.517353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a569a3d86c9942c3aaa0ee73def5367b, user_id=4316ea69ca614a28a5e658f4dbd4ded0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.520346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f6509-66eb-44b0-9a10-00ec76961c86 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.541584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2259/4540] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:52 2022] PUT /identity/v3/projects/a569a3d86c9942c3aaa0ee73def5367b/users/4316ea69ca614a28a5e658f4dbd4ded0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:52.552324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.552724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.553112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.584071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] MFA Rules not processed for user `4316ea69ca614a28a5e658f4dbd4ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:52.585496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:52.615856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357efa-6787-4280-a7b7-67d420834378 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.616849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357efa-6787-4280-a7b7-67d420834378 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.617363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c357efa-6787-4280-a7b7-67d420834378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.645514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c357efa-6787-4280-a7b7-67d420834378 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:52.646728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c357efa-6787-4280-a7b7-67d420834378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:52.654426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2260/4541] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:52.655828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.656146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.656419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.668909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:52.676395 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2282/4542] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:52.680692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.682118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:52.683345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:52.721331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:52.768467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609aa16-eeeb-4da7-a4db-0b8229dd245a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.776987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.778237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.779041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.779772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.781924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:52.785255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:52.811772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2261/4543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:52.816196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.840798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da44c6-3fb9-42e3-862a-2671cdb82713 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:52.866288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2283/4544] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:52.872145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:52.873375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:52.873932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:52.874396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:52.874658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:52.959094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:52.977184 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2262/4545] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:53.077975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a2ed-109b-449c-83e6-7cea75ef06b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.096483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.099388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.099388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.099849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.100982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.103933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.153248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2284/4546] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:52 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:53.157284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.183140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09491e1-71d6-4474-8278-57315b61ecb8 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.191806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.192439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.192715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.192982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.193812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.197037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.220518 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2263/4547] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:53.221414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.247195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da858288-ed4e-4647-ab4c-a3f62886b345 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.257289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.260978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.260978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.260978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] PATH_INFO: `/v3/projects/dc8baf51b48b4937a7f307eec76403a0/users/372e81f338f84d1cbe3128ed8bb86617/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.291188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8baf51b48b4937a7f307eec76403a0, user_id=372e81f338f84d1cbe3128ed8bb86617, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.295633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.322152 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2285/4548] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:53 2022] PUT /identity/v3/projects/dc8baf51b48b4937a7f307eec76403a0/users/372e81f338f84d1cbe3128ed8bb86617/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:53.330351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.358952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257015d-2d7e-4982-960a-d40da95dc989 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.445135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.445908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.446218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.446555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.447494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.449338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc7990-4834-4506-85fe-8586ea9fa9f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.464607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2264/4549] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:53.466608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.480368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832056-09ef-45fb-b2af-8fde22843158 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.486008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.486670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.486946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.487231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] PATH_INFO: `/v3/projects/dc8baf51b48b4937a7f307eec76403a0/users/372e81f338f84d1cbe3128ed8bb86617/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.489294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8baf51b48b4937a7f307eec76403a0, user_id=372e81f338f84d1cbe3128ed8bb86617, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.492061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.506748 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2286/4550] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:53 2022] PUT /identity/v3/projects/dc8baf51b48b4937a7f307eec76403a0/users/372e81f338f84d1cbe3128ed8bb86617/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:53.520259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.520752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.521333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.561422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] MFA Rules not processed for user `372e81f338f84d1cbe3128ed8bb86617`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:53.562726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:53.667421 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2265/4551] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:53.672430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.688640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2feccd-3fe3-428f-83c6-c4a2aff3b0ff admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.703511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.704536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.705075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.705573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.706668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.708779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.770033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2287/4552] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:53 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:53.774249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.785156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c50132-12c2-400e-8289-57978b814a3c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.790218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:53.859927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.860798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.861098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.861371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.862010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.863890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.892314 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2266/4553] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:53 2022] POST /identity/v3/users => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:53.896727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.912034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108c9a-af50-4212-9600-cb375ced53aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.918260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.918911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.919185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.919453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/7fdf6519aaac4ec4adabbb4441d2ed42` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.939634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_user(user_id=7fdf6519aaac4ec4adabbb4441d2ed42)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.941756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c6f3-869e-401d-9806-c4f3e757ccc7 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.945338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:53.948969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:53.955527 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2288/4554] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:23:53 2022] GET /identity/v3/users/7fdf6519aaac4ec4adabbb4441d2ed42 => generated 371 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:53.961111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4f23a-f4e5-4da6-9a6c-aa5fbc40dab1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:53.966084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:53.966721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.966996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.967266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/7fdf6519aaac4ec4adabbb4441d2ed42` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:53.969769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7fdf6519aaac4ec4adabbb4441d2ed42)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:53.971939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:53.982789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:53.983055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:53.983326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.015222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:54.017782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:54.025111 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2289/4555] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:53 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 16:23:54.064662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdf6519aaac4ec4adabbb4441d2ed42'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.065581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdf6519aaac4ec4adabbb4441d2ed42'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.074110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdf6519aaac4ec4adabbb4441d2ed42'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.074971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdf6519aaac4ec4adabbb4441d2ed42'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.085046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdf6519aaac4ec4adabbb4441d2ed42'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.106325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2267/4556] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:53 2022] DELETE /identity/v3/users/7fdf6519aaac4ec4adabbb4441d2ed42 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:54.110563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.182850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82d22-ecdf-46c6-aa0b-9fd221ab06f1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.188009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.188645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.188921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.189223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/ec4d4810a2e449ee96cf9e04c60c8355` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.190377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec4d4810a2e449ee96cf9e04c60c8355)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.192703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.254435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4d4810a2e449ee96cf9e04c60c8355', 'request_id': 'req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.268300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4d4810a2e449ee96cf9e04c60c8355', 'request_id': 'req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.280676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4d4810a2e449ee96cf9e04c60c8355', 'request_id': 'req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.298961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] The token cache is being invalidate because project ec4d4810a2e449ee96cf9e04c60c8355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:54.299342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.300173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:54.306679 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2290/4557] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:54 2022] DELETE /identity/v3/projects/ec4d4810a2e449ee96cf9e04c60c8355 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:54.315140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.320708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:54.335130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087220a9-f7cf-4dbd-bd2a-3bf747265256 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.446187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.446709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.447073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.447424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.448651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.450313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.472413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:54.519503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2268/4558] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:54 2022] POST /identity/v3/projects => generated 360 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:54.526146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.527805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:54.549969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c36d0-6bb6-4c45-91f7-7fdaab30cd94 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.644976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.648125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.649225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.649725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.651206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.654488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.698560 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2291/4559] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:54 2022] POST /identity/v3/users => generated 417 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:54.705619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.719694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a4fbd-34d1-4508-b94a-bfb9249089da tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.725068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.725763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.726048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.726322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.727985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.730145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.750727 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2269/4560] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:23:54 2022] POST /identity/v3/roles => generated 239 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:54.755417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.767424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbff497-a890-486c-b204-cde07f16e253 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.772484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.773474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.774372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.774871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/cb961e1a9e0e4c0397e076c214a30b07` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.788219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:54.792854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_user(user_id=cb961e1a9e0e4c0397e076c214a30b07)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.795743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.802910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.803467 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2292/4561] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:23:54 2022] GET /identity/v3/users/cb961e1a9e0e4c0397e076c214a30b07 => generated 417 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:54.816772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ebc7-f284-445c-8faa-6ab57894842c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.824693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.825466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.825813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.826150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/roles/5fdbc0ba480f49a8a7289fe0d829e8e2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.827798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_role(role_id=5fdbc0ba480f49a8a7289fe0d829e8e2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.828818 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:54.828818 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:23:54.828818 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:23:54.829990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.831622 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2270/4562] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:23:54 2022] GET /identity/v3/roles/5fdbc0ba480f49a8a7289fe0d829e8e2 => generated 239 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:54.835725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.849685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0d650-f30a-4ef6-a03c-783a459ab91b tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.855880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:54.856645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:54.856920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:54.857397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:54.858176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:54.860484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:54.902244 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2293/4563] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:54 2022] POST /identity/v3/projects => generated 358 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:54.906373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:54.917536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd33f-95df-4166-bf12-4dc53812898a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:54.999743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.000434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.000684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.000986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/56393c40e9f3459492967e1dd9fe50f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.002330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_project(project_id=56393c40e9f3459492967e1dd9fe50f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.004470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bd370-a995-41b7-9017-0bd564b9f171 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.010577 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2271/4564] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:54 2022] GET /identity/v3/projects/56393c40e9f3459492967e1dd9fe50f0 => generated 358 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:55.012737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.026773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb98712-3d4b-46c5-9565-3c83b25873bd tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.029574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad6d4-862d-4894-826f-f02a9e9c458f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.029847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad6d4-862d-4894-826f-f02a9e9c458f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.030115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acad6d4-862d-4894-826f-f02a9e9c458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.046666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.047355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.047633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.047904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/56393c40e9f3459492967e1dd9fe50f0/users/cb961e1a9e0e4c0397e076c214a30b07/roles/5fdbc0ba480f49a8a7289fe0d829e8e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.054689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=56393c40e9f3459492967e1dd9fe50f0, user_id=cb961e1a9e0e4c0397e076c214a30b07, role_id=5fdbc0ba480f49a8a7289fe0d829e8e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.065533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.082614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8acad6d4-862d-4894-826f-f02a9e9c458f None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:55.086498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8acad6d4-862d-4894-826f-f02a9e9c458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:55.097522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2294/4565] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:55 2022] PUT /identity/v3/projects/56393c40e9f3459492967e1dd9fe50f0/users/cb961e1a9e0e4c0397e076c214a30b07/roles/5fdbc0ba480f49a8a7289fe0d829e8e2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:55.099842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.221992 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2272/4566] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:55.235014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8acd98-fbe5-4398-87de-c620dc6ffedf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.235711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8acd98-fbe5-4398-87de-c620dc6ffedf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.236179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8acd98-fbe5-4398-87de-c620dc6ffedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.265473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0051d9-1cb7-486b-afbe-b2626267474f tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.278159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.278159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.279367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.279367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.280292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.283980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.291839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eb8acd98-fbe5-4398-87de-c620dc6ffedf None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:55.294262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb8acd98-fbe5-4398-87de-c620dc6ffedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:55.301097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2273/4567] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:55.308078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b6e2-b81d-424e-b817-52faa8b39bef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.308986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b6e2-b81d-424e-b817-52faa8b39bef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.309810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496b6e2-b81d-424e-b817-52faa8b39bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.357050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2295/4568] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/projects => generated 358 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:55.361635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.442759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afdb8b-35b9-4ad3-844c-b9312c78c066 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.449217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.450322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.450799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.451055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.452389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f16fc5c4def4b7c8450cca90c9f103e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.454810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.457178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2296/4569] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:23:55 2022] GET /identity/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e => generated 358 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:55.458694 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-b496b6e2-b81d-424e-b817-52faa8b39bef None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:23:55.460390 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2274/4570] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 154 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 16:23:55.462347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.465931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c0e8-f4b9-4990-820f-35605e2c735d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.466369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c0e8-f4b9-4990-820f-35605e2c735d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.466731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c0e8-f4b9-4990-820f-35605e2c735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.474055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36801fba-70bb-428e-b297-2ce5ec63d8aa tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.480877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.482015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.482333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.482921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e/users/cb961e1a9e0e4c0397e076c214a30b07/roles/5fdbc0ba480f49a8a7289fe0d829e8e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.485509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f16fc5c4def4b7c8450cca90c9f103e, user_id=cb961e1a9e0e4c0397e076c214a30b07, role_id=5fdbc0ba480f49a8a7289fe0d829e8e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.488287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.509407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2297/4571] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:55 2022] PUT /identity/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e/users/cb961e1a9e0e4c0397e076c214a30b07/roles/5fdbc0ba480f49a8a7289fe0d829e8e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:55.514334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.530952 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-8542c0e8-f4b9-4990-820f-35605e2c735d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:23:55.534032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2275/4572] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 69 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 18 16:23:55.547702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.547702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.547702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.686373 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:23:55.689526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2276/4573] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 147 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 16:23:55.691259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:55.727035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f22bb4-af8f-44b8-916d-d2ebf09a0a53 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.734438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.734438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.734438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.734798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/cb961e1a9e0e4c0397e076c214a30b07/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.736812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=cb961e1a9e0e4c0397e076c214a30b07)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.739745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.810329 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2298/4574] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:23:55 2022] GET /identity/v3/users/cb961e1a9e0e4c0397e076c214a30b07/projects => generated 840 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:55.818071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:55.831342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e383215-fc3d-4e2e-98c5-9b0c70af8c82 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:55.836648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:55.837326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:55.837602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:55.837869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:55.839022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f16fc5c4def4b7c8450cca90c9f103e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:55.840980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:55.896153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:UPDATE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:55.967928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f16fc5c4def4b7c8450cca90c9f103e', 'request_id': 'req-6735f977-1771-45b7-9bac-79a339378cdb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:55.980181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f16fc5c4def4b7c8450cca90c9f103e', 'request_id': 'req-6735f977-1771-45b7-9bac-79a339378cdb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:55.995095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f16fc5c4def4b7c8450cca90c9f103e', 'request_id': 'req-6735f977-1771-45b7-9bac-79a339378cdb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.020562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] The token cache is being invalidate because project 0f16fc5c4def4b7c8450cca90c9f103e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:56.021609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.022453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.025051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2277/4575] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:55 2022] DELETE /identity/v3/projects/0f16fc5c4def4b7c8450cca90c9f103e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:56.029309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.031154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.046322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e634-aa8d-4b42-93ca-8d33cc3faf26 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:56.109573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:56.110470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.110747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.111042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/56393c40e9f3459492967e1dd9fe50f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.112182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56393c40e9f3459492967e1dd9fe50f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:56.114110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:56.172003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56393c40e9f3459492967e1dd9fe50f0', 'request_id': 'req-b82487e3-492f-4bcf-831d-65349b4afdc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.185022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56393c40e9f3459492967e1dd9fe50f0', 'request_id': 'req-b82487e3-492f-4bcf-831d-65349b4afdc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.196335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56393c40e9f3459492967e1dd9fe50f0', 'request_id': 'req-b82487e3-492f-4bcf-831d-65349b4afdc0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.212832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] The token cache is being invalidate because project 56393c40e9f3459492967e1dd9fe50f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:56.213213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.213923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.215554 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2299/4576] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:56 2022] DELETE /identity/v3/projects/56393c40e9f3459492967e1dd9fe50f0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:56.219872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.230553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735f977-1771-45b7-9bac-79a339378cdb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:56.313911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:56.313911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.313911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.314449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/roles/5fdbc0ba480f49a8a7289fe0d829e8e2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.316680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5fdbc0ba480f49a8a7289fe0d829e8e2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:56.317767 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:56.317767 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:23:56.317767 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:23:56.318640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:56.390066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invalidating the token cache because role 5fdbc0ba480f49a8a7289fe0d829e8e2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:56.390066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.390066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.390066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2278/4577] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:56 2022] DELETE /identity/v3/roles/5fdbc0ba480f49a8a7289fe0d829e8e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:56.393802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.395355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.401609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.403485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.411043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82487e3-492f-4bcf-831d-65349b4afdc0 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:56.458261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:56.530226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362227-09ff-4f2b-9dff-b1a557ebf78a tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:56.532131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:56.532131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.532412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.532671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/cb961e1a9e0e4c0397e076c214a30b07` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.534495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cb961e1a9e0e4c0397e076c214a30b07)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:56.537687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:56.542957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:56.543952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.544603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.545108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] PATH_INFO: `/v3/users/61cf7ea9fbe3487294ed6d52cfa2fec0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.548111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cf7ea9fbe3487294ed6d52cfa2fec0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:56.550873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:56.600983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:56.631795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb961e1a9e0e4c0397e076c214a30b07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.642794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb961e1a9e0e4c0397e076c214a30b07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.643549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb961e1a9e0e4c0397e076c214a30b07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.654117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb961e1a9e0e4c0397e076c214a30b07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.654859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb961e1a9e0e4c0397e076c214a30b07'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.656489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cf7ea9fbe3487294ed6d52cfa2fec0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.657818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cf7ea9fbe3487294ed6d52cfa2fec0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.668427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cf7ea9fbe3487294ed6d52cfa2fec0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.669973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cf7ea9fbe3487294ed6d52cfa2fec0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.679066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2300/4578] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:56 2022] DELETE /identity/v3/users/cb961e1a9e0e4c0397e076c214a30b07 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:56.682279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-105776e2-ac79-4221-809c-b71f4c446bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cf7ea9fbe3487294ed6d52cfa2fec0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.684391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.686299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.712171 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2279/4579] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:56 2022] DELETE /identity/v3/users/61cf7ea9fbe3487294ed6d52cfa2fec0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:56.716497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.716874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.717329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.739962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:56.741240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.779199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3be5-842d-4429-b124-5a1b2e20c8f1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:56.848973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:56.850153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:56.850664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:56.851146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/0f2779d84c834066a7a8ce700aeacdea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:56.853423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f2779d84c834066a7a8ce700aeacdea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:56.855597 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2280/4580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:56.856416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:56.872553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.874124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:56.883417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:56.928673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2779d84c834066a7a8ce700aeacdea', 'request_id': 'req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.937313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2779d84c834066a7a8ce700aeacdea', 'request_id': 'req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.945774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2779d84c834066a7a8ce700aeacdea', 'request_id': 'req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.978190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] The token cache is being invalidate because project 0f2779d84c834066a7a8ce700aeacdea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:56.978489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.979490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:56.985982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2301/4581] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:56 2022] DELETE /identity/v3/projects/0f2779d84c834066a7a8ce700aeacdea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:56.987187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:56.990063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.044464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbff9-2566-4242-9c1d-0fd7056adf84 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.114083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b0bc-8705-4f9d-b0e8-c9a4f759e2b1 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.121370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.122112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.123187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.123486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/4316ea69ca614a28a5e658f4dbd4ded0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.125729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:update_user(user_id=4316ea69ca614a28a5e658f4dbd4ded0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.127781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.150803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.153198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.153516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.153807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.161623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.169474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:57.178129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.192794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invalidating the token cache because user 4316ea69ca614a28a5e658f4dbd4ded0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:57.193123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.194129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bdab103c-0c03-4c1f-bb43-713790848b08 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.201331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2302/4582] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:23:56 2022] PATCH /identity/v3/users/4316ea69ca614a28a5e658f4dbd4ded0 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:57.205790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.206564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.207170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.259696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] MFA Rules not processed for user `4316ea69ca614a28a5e658f4dbd4ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:57.261363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.265440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2303/4583] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:57 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:57.269501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.271202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.276588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.278430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.292526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2281/4584] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:23:57.293646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a300a4-2f14-4ebd-ba9f-c3e3438db314 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.299390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.301865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.302327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.302754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/4316ea69ca614a28a5e658f4dbd4ded0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.304234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:update_user(user_id=4316ea69ca614a28a5e658f4dbd4ded0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.306476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.356365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.370307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invalidating the token cache because user 4316ea69ca614a28a5e658f4dbd4ded0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:57.371365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.372425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbbdde8-c7c7-488a-927f-2d2222e45e86 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.377645 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2304/4585] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:23:57 2022] PATCH /identity/v3/users/4316ea69ca614a28a5e658f4dbd4ded0 => generated 297 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:57.382913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.399051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642925f7-5a8a-4024-95cb-30dac3029838 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.408876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.409604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.410119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.410304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/4316ea69ca614a28a5e658f4dbd4ded0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.433085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:update_user(user_id=4316ea69ca614a28a5e658f4dbd4ded0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.434391 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:23:57.434391 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:23:57.434391 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:23:57.435487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.487080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.524399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invalidating the token cache because user 4316ea69ca614a28a5e658f4dbd4ded0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:57.524828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.527230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.533689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2282/4586] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:23:57 2022] PATCH /identity/v3/users/4316ea69ca614a28a5e658f4dbd4ded0 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:57.535901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.536646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.536646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.580424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] MFA Rules not processed for user `4316ea69ca614a28a5e658f4dbd4ded0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:57.581774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.589077 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2305/4587] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:57 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:23:57.590904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.592359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.623934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa725-ec0a-4596-920f-ed73d8ad69cb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.629567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.630270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.630552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.630837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/4316ea69ca614a28a5e658f4dbd4ded0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.632556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:update_user(user_id=4316ea69ca614a28a5e658f4dbd4ded0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.635437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.715111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.744005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invalidating the token cache because user 4316ea69ca614a28a5e658f4dbd4ded0 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:57.747311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.750146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.762598 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2283/4588] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:23:57 2022] PATCH /identity/v3/users/4316ea69ca614a28a5e658f4dbd4ded0 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:23:57.764470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.775640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=9,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:57.782013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.784430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.793617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b824cd8-7520-4e11-b3e6-a2a3b953f896 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.816871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.817674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.818784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.819187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.824127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.827122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.828632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705463c-a2aa-4a4e-8e14-5872eb607efe tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.846189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:57.846989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:57.847402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:57.847751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] PATH_INFO: `/v3/projects/2137dcdad6004d0c8038949a765d259e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:57.850352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2137dcdad6004d0c8038949a765d259e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:57.852684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:57.889879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2306/4589] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:23:57 2022] POST /identity/v3/users => generated 264 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:57.892176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:57.898874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:57.928445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083c0c-7655-4639-b338-deb1e5730e62 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:57.960334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2137dcdad6004d0c8038949a765d259e', 'request_id': 'req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.973052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2137dcdad6004d0c8038949a765d259e', 'request_id': 'req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.980555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2137dcdad6004d0c8038949a765d259e', 'request_id': 'req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.994851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] The token cache is being invalidate because project 2137dcdad6004d0c8038949a765d259e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:57.995223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:57.995816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.000818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2284/4590] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:57 2022] DELETE /identity/v3/projects/2137dcdad6004d0c8038949a765d259e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:58.001852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:58.004034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:58.018823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:58.035542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:58.036684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:58.037188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:58.037577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/c7d487525e7b4e0498cacadc8363e380/password` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:58.113741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c19bf2-d115-4f96-8a9e-90b70f9ae6ee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:58.119635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:58.120337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:58.120767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:58.121102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] PATH_INFO: `/v3/users/a84f763a413440cca929a08e26074cd7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:58.122542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84f763a413440cca929a08e26074cd7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:58.124641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:58.146032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.159213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2307/4591] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:23:57 2022] POST /identity/v3/users/c7d487525e7b4e0498cacadc8363e380/password => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:58.194825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84f763a413440cca929a08e26074cd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.196519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84f763a413440cca929a08e26074cd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.208739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84f763a413440cca929a08e26074cd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.209512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84f763a413440cca929a08e26074cd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.222509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4cc6b37b-74d0-487f-b9f7-3e7cfbb14b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84f763a413440cca929a08e26074cd7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:58.246024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2285/4592] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:58 2022] DELETE /identity/v3/users/a84f763a413440cca929a08e26074cd7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:58.743729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:58.747913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:58.791191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95defac3-a6f8-4dd8-9294-5dd525e245f8 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:58.910449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:58.911098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:58.911527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:58.911689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] PATH_INFO: `/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:58.913019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3a4dbcfc6e46d3b2d6358bd168074c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:58.915437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:58.983660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:58.991116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3a4dbcfc6e46d3b2d6358bd168074c', 'request_id': 'req-817c5d68-05c7-4d45-913f-49fc688af763'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.012160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3a4dbcfc6e46d3b2d6358bd168074c', 'request_id': 'req-817c5d68-05c7-4d45-913f-49fc688af763'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.019854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3a4dbcfc6e46d3b2d6358bd168074c', 'request_id': 'req-817c5d68-05c7-4d45-913f-49fc688af763'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.047269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] The token cache is being invalidate because project ee3a4dbcfc6e46d3b2d6358bd168074c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:23:59.047269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.047269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-817c5d68-05c7-4d45-913f-49fc688af763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.047269 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2308/4593] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:23:58 2022] DELETE /identity/v3/projects/ee3a4dbcfc6e46d3b2d6358bd168074c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:23:59.054096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a759f8-aaab-4c96-81a7-8886873f07a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.055169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a759f8-aaab-4c96-81a7-8886873f07a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.055831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a759f8-aaab-4c96-81a7-8886873f07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.091065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41a759f8-aaab-4c96-81a7-8886873f07a8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:59.092572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41a759f8-aaab-4c96-81a7-8886873f07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.163444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.163703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.164404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.189161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] MFA Rules not processed for user `c7d487525e7b4e0498cacadc8363e380`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:59.190995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.194590 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2309/4594] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 16:23:59.200230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.203161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.203605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2286/4595] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:23:59.212018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.212403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.212845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.242677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:23:59.244691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.256000 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2287/4596] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:23:59.260933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.271997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6d425-0854-4dd0-a177-5cbec7055dbe None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.280109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.280883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.281305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.281709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.282540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:23:59.283035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.285150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.300368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2288/4597] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:23:59.304827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.321085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d95d4-0955-46ca-9b83-e2a0c40199c7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.327648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.328592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.329012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.329388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.330202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.334813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.339247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23abd-7fb7-4cfa-823a-a6094639421f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.342833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:59.346390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.347986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.348356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.348741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.358085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.361086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.373947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2310/4598] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 18 16:23:59 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 16:23:59.375705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.392269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847965-49b6-44d6-bce3-b56e7eea5866 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.398157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.399486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.399861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.400231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/c7d487525e7b4e0498cacadc8363e380` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.401808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c7d487525e7b4e0498cacadc8363e380)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.404627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.419910 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2289/4599] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:23:59.425167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.480764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.491767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.492733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.502825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.504091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d487525e7b4e0498cacadc8363e380'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:23:59.535999 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2311/4600] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:23:59 2022] DELETE /identity/v3/users/c7d487525e7b4e0498cacadc8363e380 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:23:59.538952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.540730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.545309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab03b-cd09-4d4c-8f1f-ca5edfc45431 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.591794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:23:59.660684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d4af-0212-45ef-b3b4-cdb17488373c tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.665084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.667080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.668740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.669263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.670711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.675541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.676498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.678058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.681391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.681957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.682668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.684800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.729166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2290/4601] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:59.734623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.738417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:23:59.755537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155587-8fab-41a3-9bbd-3c12e426a95c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.758038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2312/4602] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/users => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:59.759933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.762439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.763227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.763629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.763999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.764755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.766715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.779203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2291/4603] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:59.786047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.787363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e4f0-2766-4340-a82c-ced8746d15d5 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.797449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.798150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.798439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.798719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.799417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.801966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.803037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02324c35-d15f-46da-97a4-21a236145823 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:23:59.827844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:23:59.828946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:23:59.829464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:23:59.829925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:23:59.830784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:23:59.832796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:23:59.853613 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2292/4604] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:23:59.857111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.859874 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2313/4605] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:23:59 2022] POST /identity/v3/projects => generated 360 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:23:59.865489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:23:59.885524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb9e53-9539-4374-9b02-5d7eda15f4e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.153435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bec8-5746-4c2b-8749-6dc526722e22 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.169669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.170799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.171288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.171761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] PATH_INFO: `/v3/projects/d8b4d8a393a549d8b9d65fab5f050025/users/0946acd9a88a44a18a04c50bf9312322/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.178994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.180085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.180934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:00.183609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.183929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/c86b739030b9417f912c724573cd2670` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.230800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:update_user(user_id=c86b739030b9417f912c724573cd2670)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.237051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b4d8a393a549d8b9d65fab5f050025, user_id=0946acd9a88a44a18a04c50bf9312322, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.240311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c474d3b-26ca-4aa0-8a6a-424d512ca079 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.243437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac738a3-6c42-45ec-a8f9-8a22c8a1082e tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.306945 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2293/4606] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:23:59 2022] PUT /identity/v3/projects/d8b4d8a393a549d8b9d65fab5f050025/users/0946acd9a88a44a18a04c50bf9312322/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:00.306945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.306945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.306945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.322803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:00.325589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:00.340723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2314/4607] 10.222.0.78 () {60 vars in 1244 bytes} [Tue Oct 18 16:23:59 2022] PATCH /identity/v3/users/c86b739030b9417f912c724573cd2670 => generated 521 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:00.342515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.343172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.343449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.402781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] MFA Rules not processed for user `0946acd9a88a44a18a04c50bf9312322`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:00.407326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:00.455327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2294/4608] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:00.455327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.545176 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2315/4609] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:00.546989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.549702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:00.558234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:00.582730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff55cb-511b-4c37-b0fd-8daf1bddee3b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.592970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.593400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.593996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.594595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/c86b739030b9417f912c724573cd2670` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.625649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:get_user(user_id=c86b739030b9417f912c724573cd2670)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.629867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.633254 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2295/4610] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:24:00 2022] GET /identity/v3/users/c86b739030b9417f912c724573cd2670 => generated 388 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:00.634990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.701252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d48f8-6f22-42da-ada4-ac867f374700 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.708509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.709219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.709612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.709880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.725081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.726788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.738577 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2316/4611] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:24:00.739420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.739960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff5176-2007-463f-ac43-49b62100f210 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.752199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.752964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.753273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.753530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.754160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.756479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.761557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154814-eab5-46d8-8694-29326c59d7ec service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:00.774069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:00.775153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:00.775652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:00.776169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/projects/ab3b4dc39c504847a5f1e3c10a97ab47` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:00.778704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab3b4dc39c504847a5f1e3c10a97ab47)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:00.782813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:00.833105 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2296/4612] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:00 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:00.838260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.847217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:00.873681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3b4dc39c504847a5f1e3c10a97ab47', 'request_id': 'req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:00.890195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3b4dc39c504847a5f1e3c10a97ab47', 'request_id': 'req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:00.899894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3b4dc39c504847a5f1e3c10a97ab47', 'request_id': 'req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:00.921215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] The token cache is being invalidate because project ab3b4dc39c504847a5f1e3c10a97ab47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:00.922486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:00.922486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:00.924341 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2317/4613] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:00 2022] DELETE /identity/v3/projects/ab3b4dc39c504847a5f1e3c10a97ab47 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:00.930557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:00.931517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:00.982012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5af59-701f-4377-a932-5b345533af32 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.062982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac539-7d92-4a7e-969f-e4ce95719cfb tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.077555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '372e81f338f84d1cbe3128ed8bb86617', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8baf51b48b4937a7f307eec76403a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.078230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.078543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.078769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] PATH_INFO: `/v3/users/c86b739030b9417f912c724573cd2670` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.081247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c86b739030b9417f912c724573cd2670)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.084764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:01.145015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:01.180081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.184057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.184057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.184057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.184596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.190243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:01.206548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86b739030b9417f912c724573cd2670'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.220398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86b739030b9417f912c724573cd2670'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.221238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86b739030b9417f912c724573cd2670'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.237435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86b739030b9417f912c724573cd2670'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.238241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86b739030b9417f912c724573cd2670'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.256113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2297/4614] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:00 2022] POST /identity/v3/users => generated 295 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:01.273038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2318/4615] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:00 2022] DELETE /identity/v3/users/c86b739030b9417f912c724573cd2670 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:01.279511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:01.298867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:01.301579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:01.304861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:01.331362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930585-f214-48ed-af80-3a6b85436c26 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.435445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb0d4-8d11-4607-8205-2351a3754ba2 tempest-UsersV3TestJSON-510993441 tempest-UsersV3TestJSON-510993441-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.443420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.444076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.444350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.444618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] PATH_INFO: `/v3/users/4316ea69ca614a28a5e658f4dbd4ded0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.475380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4316ea69ca614a28a5e658f4dbd4ded0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.480705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:01.494791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.495684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.496031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.496365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.497337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.504197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:01.579530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2298/4616] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:01.587339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:01.640558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e2ee-4dce-4ed4-89c3-82450f64d99e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.653793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.657420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.658231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.658611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.659061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] PATH_INFO: `/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f/users/989ba1dcb3804fc7bcd5b6d719d0940c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.671412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.672210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.688528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.690116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ddf105c7-8e4a-4bd6-ad75-83244a22a504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4316ea69ca614a28a5e658f4dbd4ded0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:01.697727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f932cc4a2fe5498ea701eeda7be1b28f, user_id=989ba1dcb3804fc7bcd5b6d719d0940c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.701185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:01.733804 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2299/4617] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:01 2022] PUT /identity/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f/users/989ba1dcb3804fc7bcd5b6d719d0940c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:01.737331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2319/4618] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:01 2022] DELETE /identity/v3/users/4316ea69ca614a28a5e658f4dbd4ded0 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:01.740546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:01.745015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.745319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.745719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.746730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:01.754002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:01.776633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:01.778775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:01.782042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:01.869243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7448-66b0-4489-9a7b-700c2ffa7d66 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:01.895782 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2320/4619] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:01.906576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:01.908305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:01.968097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:01.968809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:01.969223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:01.969593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:01.970439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:01.973617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:02.012759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2300/4620] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:24:02.014772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:02.030971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa41bf7-aafe-40db-9f9c-2b64d3ee7b39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:02.038083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:02.039052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.039353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.039799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] PATH_INFO: `/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f/users/989ba1dcb3804fc7bcd5b6d719d0940c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.042328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e309e7-cdfe-47a3-ad4d-be8af80520eb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:02.045115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f932cc4a2fe5498ea701eeda7be1b28f, user_id=989ba1dcb3804fc7bcd5b6d719d0940c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:02.046336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:02.047020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.047361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.047693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.047792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e833-d094-46a7-9870-fe4363d3b53f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:02.058935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:02.060519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65df1c-6245-4f2f-aea1-de45835a68c8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:02.063048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2301/4621] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:02 2022] PUT /identity/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f/users/989ba1dcb3804fc7bcd5b6d719d0940c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:02.073286 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2321/4622] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:02.078196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.078661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.079082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.122047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] MFA Rules not processed for user `989ba1dcb3804fc7bcd5b6d719d0940c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:02.124031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.251689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2302/4623] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:02.277038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.277334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.277607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.364331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] MFA Rules not processed for user `0946acd9a88a44a18a04c50bf9312322`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:02.365980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.491248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2322/4624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:02.503028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:02.508728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.685587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:02.692143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.734948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:02.816398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645d37-a871-4d0e-8a01-5d52bf9d54c3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:02.844736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:02.845732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.845855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.846043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.848030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.855274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:02.868791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:02.870410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:02.908286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2303/4625] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:02.909371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:02.918964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f822d2-717d-40ba-ac36-0670ec8d88ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:02.920349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:02.936950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:02.937819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:02.938215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:02.938908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] PATH_INFO: `/v3/projects/a569a3d86c9942c3aaa0ee73def5367b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:02.943584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a569a3d86c9942c3aaa0ee73def5367b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:02.955019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:03.126617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a569a3d86c9942c3aaa0ee73def5367b', 'request_id': 'req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.135725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a569a3d86c9942c3aaa0ee73def5367b', 'request_id': 'req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.136065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1a40b-9317-47f2-93d4-22b4093e83a2 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:03.143695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a569a3d86c9942c3aaa0ee73def5367b', 'request_id': 'req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.170991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] The token cache is being invalidate because project a569a3d86c9942c3aaa0ee73def5367b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:03.171291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.172013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.174255 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2323/4626] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:02 2022] DELETE /identity/v3/projects/a569a3d86c9942c3aaa0ee73def5367b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:03.183336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:03.190111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:03.283172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:03.284077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:03.284793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:03.285605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:03.288940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:03.309074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:03.311031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:03.345346 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2304/4627] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:03.454126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53560e-5a93-4fb1-98a6-cf475ab2bd6e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:03.477224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:03.479643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:03.480764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:03.483196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] PATH_INFO: `/v3/users/372e81f338f84d1cbe3128ed8bb86617` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:03.489091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=372e81f338f84d1cbe3128ed8bb86617)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:03.497618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:03.635378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372e81f338f84d1cbe3128ed8bb86617'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.653130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372e81f338f84d1cbe3128ed8bb86617'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.654542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372e81f338f84d1cbe3128ed8bb86617'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.690478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372e81f338f84d1cbe3128ed8bb86617'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.694619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372e81f338f84d1cbe3128ed8bb86617'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:03.758355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:03.783894 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2324/4628] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:03 2022] DELETE /identity/v3/users/372e81f338f84d1cbe3128ed8bb86617 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:04.161143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:04.162676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:04.197377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539db02e-1a8f-4fae-a15a-b557b17faf0f service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:04.298678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:04.337598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:04.338487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:04.339030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:04.339442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:04.345817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:04.377197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:04.381418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fb25-bf16-452e-801b-9fe7106d0094 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:04.411106 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2305/4629] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:04.534346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:04.536573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:04.781903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48a384-d309-4314-a7c2-139e44d1bfcb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:04.787496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:04.788557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:04.788916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:04.789208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] PATH_INFO: `/v3/projects/dc8baf51b48b4937a7f307eec76403a0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:04.804281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8baf51b48b4937a7f307eec76403a0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:04.808002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:04.963014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8baf51b48b4937a7f307eec76403a0', 'request_id': 'req-45b7df85-5014-4720-a2e6-ded4b646dd57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:04.970380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8baf51b48b4937a7f307eec76403a0', 'request_id': 'req-45b7df85-5014-4720-a2e6-ded4b646dd57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:04.982022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8baf51b48b4937a7f307eec76403a0', 'request_id': 'req-45b7df85-5014-4720-a2e6-ded4b646dd57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:05.019161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] The token cache is being invalidate because project dc8baf51b48b4937a7f307eec76403a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:05.019547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:05.020735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-45b7df85-5014-4720-a2e6-ded4b646dd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:05.024202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2325/4630] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:04 2022] DELETE /identity/v3/projects/dc8baf51b48b4937a7f307eec76403a0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:05.029279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.029547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.029833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.082771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:05.083972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:05.194635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2306/4631] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:05.204135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524822-79be-484b-bbff-467b746c5566 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.204135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524822-79be-484b-bbff-467b746c5566 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.204135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524822-79be-484b-bbff-467b746c5566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.227263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3524822-79be-484b-bbff-467b746c5566 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:05.228341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3524822-79be-484b-bbff-467b746c5566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:05.245224 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2326/4632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:05.252932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.266351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7f238-5125-41cb-aa6e-b3621a089e69 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.271801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.272682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.273329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.273955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.274777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:05.275080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.276843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.290937 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2307/4633] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:05.295189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524822-79be-484b-bbff-467b746c5566 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.311134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524822-79be-484b-bbff-467b746c5566 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.316848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.317446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.317974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.317974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.319646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.320573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.367926 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2327/4634] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:05 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:05.371789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.394883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace90e4-c0bb-4bfa-adbc-28f7482ad5a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.503132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.503754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.504157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.504439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.505227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.507957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.567542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.577703 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2308/4635] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:05 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:05.587403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654052-75db-4008-88bd-b299bf0da4e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.608065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.609508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.609791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.615452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.618505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.624734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.672841 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2328/4636] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:24:05.674241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.712132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c9c60-63f5-4199-b7ad-e60ddb085cfd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.740100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.741931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.742753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.744268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.747838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.750713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf53ed-81b3-4ecf-a5f5-35cb2863b9ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.790101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:05.791799 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2309/4637] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:05.804330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae759-ba4b-4e63-b6e3-15a5e3e1dc24 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:05.810569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:05.811241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.811522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.811954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] PATH_INFO: `/v3/projects/d22d6497e4214a9d8f7fdb8699da9b9d/users/3610250b0a6e45edabf4e7658ed246dc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.853103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22d6497e4214a9d8f7fdb8699da9b9d, user_id=3610250b0a6e45edabf4e7658ed246dc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:05.858035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:05.902038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2329/4638] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:05 2022] PUT /identity/v3/projects/d22d6497e4214a9d8f7fdb8699da9b9d/users/3610250b0a6e45edabf4e7658ed246dc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:05.914780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:05.914780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:05.917683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:05.961178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] MFA Rules not processed for user `3610250b0a6e45edabf4e7658ed246dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:05.962502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:06.030365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:06.127523 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2310/4639] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:06.146056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.162312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844eddc-2fc9-4242-9048-728b6c349492 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:06.175269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:06.175930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.176212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.176486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.177235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:06.178333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef084-9fbd-4a3e-a56f-ca674e7f055a tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:06.216635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:06.327805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2330/4640] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 18 16:24:06 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 789 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:06.329281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.344285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a12bf-a242-457a-92d2-a546a110c65f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:06.360493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:06.361283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.361677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.361990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/eeb5727e82be4e59b390a014c6a653b6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.374517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:get_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=eeb5727e82be4e59b390a014c6a653b6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:06.376290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:06.378122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2311/4641] 10.222.0.78 () {58 vars in 1392 bytes} [Tue Oct 18 16:24:06 2022] GET /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/eeb5727e82be4e59b390a014c6a653b6 => generated 689 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:24:06.382995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206155ee-165f-48d8-ac07-96d7f3f5d485 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.383410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206155ee-165f-48d8-ac07-96d7f3f5d485 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.384782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206155ee-165f-48d8-ac07-96d7f3f5d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.406808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-206155ee-165f-48d8-ac07-96d7f3f5d485 None None] MFA Rules not processed for user `3610250b0a6e45edabf4e7658ed246dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:06.412016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-206155ee-165f-48d8-ac07-96d7f3f5d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:06.676603 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2331/4642] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 16:24:06.684006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.700421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.700763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.701797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.706007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2b4c-98af-40f6-93fb-f61a6aba6279 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:06.714759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:06.716717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.717322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.717824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/eeb5727e82be4e59b390a014c6a653b6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.719338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=eeb5727e82be4e59b390a014c6a653b6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:06.721134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:06.755573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2312/4643] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:06 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/eeb5727e82be4e59b390a014c6a653b6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:06.763966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.791380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d9cb-ed4b-4f11-b572-52b5b195de21 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:06.803243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:06.803904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:06.804401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:06.804665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:06.807966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:06.810160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:06.847257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:06.848455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:06.856030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2332/4644] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:24:06.859858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.861894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:06.977746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2313/4645] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:24:06 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 921 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:06.979011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:06.996264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee3a20-58ae-4b7a-bd30-a2ec50446d0e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.001622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.002279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.002818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.003099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/057512f44e4542f6a867e4601311199e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.005748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdbcf5-6b9d-4157-84f0-b9355c886d14 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.015584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.016262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.016545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.016819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.028146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:07.046962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=057512f44e4542f6a867e4601311199e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.049952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.095334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2314/4646] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:06 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/057512f44e4542f6a867e4601311199e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:07.100519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.123000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3002-9a60-489a-a493-8180081de337 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.134836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.137753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.138131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.138525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.139001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:07.139850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.142316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.160509 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2333/4647] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:24:06 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:07.223672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:07.325787 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2315/4648] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:24:07 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 812 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:07.331241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.345531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1385082-0d6a-40d3-b161-d89beadddaea tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.370181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.370925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.371621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.372000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/71b64f1bd3c54d1fb7c2db9e9eeaebc1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.394018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=71b64f1bd3c54d1fb7c2db9e9eeaebc1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.395137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.423568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2334/4649] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:07 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/71b64f1bd3c54d1fb7c2db9e9eeaebc1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:07.425109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.439869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e9b3c-048b-4955-91ca-91615489a9d4 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.444674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.446738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.447213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.447681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.448944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.450594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.543033 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2316/4650] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 18 16:24:07 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 789 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:07.547959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.559351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dcb18-b45b-4b26-89d1-b502c43e183f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.565044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.565700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.566284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.566565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.567273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.568555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.723422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2335/4651] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 18 16:24:07 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 788 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:07.727452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.738918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df13ca1-e6c4-47fb-b613-989c47de08d1 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.744497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.745320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.745698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.746068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.746812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:list_application_credentials(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.748596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.794053 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2317/4652] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:24:07 2022] GET /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 1501 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:07.794816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.814513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56216-3e9e-4176-a68c-6d179ef6cdf7 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.831662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.832330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.832609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.832880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/15632a51a95b48efa63c20bcda5fc83e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.856378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=15632a51a95b48efa63c20bcda5fc83e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.861677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:07.911381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2336/4653] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:07 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/15632a51a95b48efa63c20bcda5fc83e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:07.916764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:07.932406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73c49c-41a4-4988-a033-9fbd10cee65f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:07.943295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:07.945806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:07.946449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:07.946911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/4866723fc3814d2f88d34a950a91ad39` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:07.964787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=4866723fc3814d2f88d34a950a91ad39)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:07.978513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dad80c-22b4-4227-b4ed-bdde3100cecc tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.031290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2318/4654] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:07 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/4866723fc3814d2f88d34a950a91ad39 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:08.032936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.045801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1692-6db1-4962-bb7d-bfec7876806e tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.051089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.051798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.052079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.052349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.053046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.054717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.166454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2337/4655] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 789 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:08.167621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a034-c298-4780-bda9-b8e22d2fa8db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.167911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a034-c298-4780-bda9-b8e22d2fa8db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.168183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15a034-c298-4780-bda9-b8e22d2fa8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.178328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.193678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:08.207500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908c95-d7ed-4e50-b6b9-4cc167bae8a0 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.209741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7e15a034-c298-4780-bda9-b8e22d2fa8db None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:08.217083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7e15a034-c298-4780-bda9-b8e22d2fa8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:08.226983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.227684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.230138 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2319/4656] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:24:08.233748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.234151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.235719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:create_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.237920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59553-37ab-4ba4-8b85-ae9f4ab0a2e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.238195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59553-37ab-4ba4-8b85-ae9f4ab0a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.238460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59553-37ab-4ba4-8b85-ae9f4ab0a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.243464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-94d59553-37ab-4ba4-8b85-ae9f4ab0a2e7 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 18 16:24:08.338010 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:24:08.339262 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:24:08.340327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2320/4657] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:24:08.343798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267a01-9e63-41a9-b022-5ec2389af5b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.344903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267a01-9e63-41a9-b022-5ec2389af5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.345828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267a01-9e63-41a9-b022-5ec2389af5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.411902 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2338/4658] 10.222.0.78 () {60 vars in 1314 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials => generated 788 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:08.415346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.439718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4f18-4076-4ba0-9d7b-f340c8c2195f tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.453943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.455425 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-31267a01-9e63-41a9-b022-5ec2389af5b5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:24:08.455889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.457827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.459177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.464349 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2321/4659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 117 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 18 16:24:08.464536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Adding query filter params (name=tempest-application_credential-674786864) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:08.464536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:list_application_credentials(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.464536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.468856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.468856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.469183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.495745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2339/4660] 10.222.0.78 () {58 vars in 1384 bytes} [Tue Oct 18 16:24:08 2022] GET /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials?name=tempest-application_credential-674786864 => generated 885 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:08.498420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.509849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a71f9-9dde-4d2c-ac87-b5a6574e3307 tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.522469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.523852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.524166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.524495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/912a2baf3e5b43d8a0da1756060db89d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.543151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=912a2baf3e5b43d8a0da1756060db89d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.547022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:08.548598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:08.550417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.564648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2322/4661] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:08.565699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.589231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7f5d-3df5-4772-b018-a6630aeac598 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.594130 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2340/4662] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:08 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/912a2baf3e5b43d8a0da1756060db89d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:08.597704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.603914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064fa4-fdd2-4d0f-876a-d33608e0c6c4 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.606159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064fa4-fdd2-4d0f-876a-d33608e0c6c4 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.606461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064fa4-fdd2-4d0f-876a-d33608e0c6c4 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.608017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064fa4-fdd2-4d0f-876a-d33608e0c6c4 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.622144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e3e9-001a-47ca-8b02-5da4accc840c tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.634329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3610250b0a6e45edabf4e7658ed246dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.635115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.635462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.635813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/83ea62936879413a808e8568d821c57c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.665836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3610250b0a6e45edabf4e7658ed246dc, application_credential_id=83ea62936879413a808e8568d821c57c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.671276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.753862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2341/4663] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:24:08 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc/application_credentials/83ea62936879413a808e8568d821c57c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:08.755448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:08.761620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e5064fa4-fdd2-4d0f-876a-d33608e0c6c4 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:08.784695 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2323/4664] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:24:08 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:08.884893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37b5b-57d6-4ad2-bde8-54664a3982cf tempest-ApplicationCredentialsV3Test-650928967 tempest-ApplicationCredentialsV3Test-650928967-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:08.895265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:08.905596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:08.906166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:08.906547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] PATH_INFO: `/v3/users/3610250b0a6e45edabf4e7658ed246dc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:08.908100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3610250b0a6e45edabf4e7658ed246dc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:08.910369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:08.989272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:09.033265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3610250b0a6e45edabf4e7658ed246dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:09.051715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3610250b0a6e45edabf4e7658ed246dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:09.052875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3610250b0a6e45edabf4e7658ed246dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:09.066547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3610250b0a6e45edabf4e7658ed246dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:09.068817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3610250b0a6e45edabf4e7658ed246dc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:09.136118 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2342/4665] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:08 2022] DELETE /identity/v3/users/3610250b0a6e45edabf4e7658ed246dc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:09.139225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9cd92-2b9b-4d67-b51a-cd57ab5c9160 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:09.139225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9cd92-2b9b-4d67-b51a-cd57ab5c9160 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:09.139225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9cd92-2b9b-4d67-b51a-cd57ab5c9160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:09.187851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-31e9cd92-2b9b-4d67-b51a-cd57ab5c9160 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:09.189665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-31e9cd92-2b9b-4d67-b51a-cd57ab5c9160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:09.193576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=4,keystone:UPDATE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:09.330244 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2324/4666] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:09.361095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:09.364679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:09.477642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e79ca-07cf-458c-82b7-789ba416d0bd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:09.491185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:09.492110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:09.492703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:09.493223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:09.512514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:09.514670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ffb0-6f73-490b-9b35-fae252a320d5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:09.531874 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2343/4667] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:09.791499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:09.792066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:09.792066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:09.814807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:09.816010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:09.819874 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2325/4668] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:09 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:24:09.824913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:09.825498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:09.825498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:09.848495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:09.849749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:09.900393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:09.902080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:09.939442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759de98-adc9-442f-af28-bf44b194eeaf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:09.952031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:09.952803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:09.953107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:09.953384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] PATH_INFO: `/v3/projects/d22d6497e4214a9d8f7fdb8699da9b9d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:09.957171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22d6497e4214a9d8f7fdb8699da9b9d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:09.960526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:09.988041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2344/4669] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:09.993285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.013937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0235-1207-4523-b2ef-ccd1dbbbfbe7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.046238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'request_id': 'req-8eb4cf4a-454e-4564-be04-8b0a92332a2a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.068066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'request_id': 'req-8eb4cf4a-454e-4564-be04-8b0a92332a2a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.078870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22d6497e4214a9d8f7fdb8699da9b9d', 'request_id': 'req-8eb4cf4a-454e-4564-be04-8b0a92332a2a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.093863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] The token cache is being invalidate because project d22d6497e4214a9d8f7fdb8699da9b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:10.094296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.095230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8eb4cf4a-454e-4564-be04-8b0a92332a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.098025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2326/4670] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:09 2022] DELETE /identity/v3/projects/d22d6497e4214a9d8f7fdb8699da9b9d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:10.104621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:10.106115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.106786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.107798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.121514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8271d1-2953-47ff-8836-405160fc680e tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.122813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8271d1-2953-47ff-8836-405160fc680e tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.123700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8271d1-2953-47ff-8836-405160fc680e tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.124132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8271d1-2953-47ff-8836-405160fc680e tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.164343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:10.166389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:10.237684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ab8271d1-2953-47ff-8836-405160fc680e tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:10.260606 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2345/4671] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:24:09 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:10.291559 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2327/4672] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:10.299331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.299635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.299907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.340554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:10.341824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:10.351744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2346/4673] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:10.356078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.368586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c5ba-b516-4552-8da7-fc184e0943e2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.376344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.377748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.378033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.378307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.380124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:10.380439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.386404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.417203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2328/4674] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:10.421423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.432729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d408e6-a297-4486-acb6-47bc5d865b4c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.438226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.438895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.439175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.439446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.440085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.442337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.488324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.489569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2347/4675] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:10.500489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bedd4-2d75-42e8-b16d-f93c1bc9abc1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.514420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:10.596849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.597618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.597962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.598295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.599001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.603927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.639316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2329/4676] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:10.643083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.656008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34b0a2-d87e-4182-856c-9fe4381db0c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.660762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.661493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.661836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.662908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.662908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.665223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.682910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2348/4677] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:10.684456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.695715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca1596-be64-4cf1-976e-8debcfbccb1f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.701054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.701691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.701965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.702672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.702890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.705273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7dda8-c852-4300-ba9e-4713222e0ece admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.723219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2330/4678] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:10.724523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:10.753152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03d93d-7ca8-483c-bdb8-76e3472b633b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:10.760104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:10.760885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.761265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.761623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] PATH_INFO: `/v3/projects/1221cbf9f7bd470891ea3e83e5d8030e/users/cca915f736e641cdae7bd6207bbd4efd/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.780710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1221cbf9f7bd470891ea3e83e5d8030e, user_id=cca915f736e641cdae7bd6207bbd4efd, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:10.783172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:10.805996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2349/4679] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:10 2022] PUT /identity/v3/projects/1221cbf9f7bd470891ea3e83e5d8030e/users/cca915f736e641cdae7bd6207bbd4efd/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:10.817433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:10.817970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:10.817970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:10.847346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] MFA Rules not processed for user `cca915f736e641cdae7bd6207bbd4efd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:10.848553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:10.920977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2331/4680] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:10.925309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.003569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd129d48-77eb-48f4-a2b1-805c064a4302 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.009230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.010028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.010381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.010723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.011437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.013592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.061152 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2350/4681] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:11.065605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.077479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9defe9-9415-4af2-aeee-b574887bb7fb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.157423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.158068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.158344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.158612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.159249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.161196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e300c-9a0e-4d89-b891-212ddcdc60f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.187408 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2332/4682] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:11 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:11.198010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.232558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefddc65-8b19-46c7-9fa5-7b93bd00f54e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.240174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.240802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.241103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.241403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.242245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.244032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.263839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5c71-f7ce-4194-8cf5-16023631f32e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.264960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5c71-f7ce-4194-8cf5-16023631f32e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.265490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5c71-f7ce-4194-8cf5-16023631f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.274114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2351/4683] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:11.277446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.290507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-44ed5c71-f7ce-4194-8cf5-16023631f32e None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:11.292025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44ed5c71-f7ce-4194-8cf5-16023631f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:11.296154 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2333/4684] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 16:24:11.299762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e480d9-478f-4dfd-a240-51c19f09139d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.302337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.302754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.302864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.314817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.315866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:11.322021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.322538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.324555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.325481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.328515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.329720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:11.331009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:11.345107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2352/4685] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:11.346544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.357924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911eb45-399f-4104-9813-35d54b3c13dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.363821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.364727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.365143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.365511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] PATH_INFO: `/v3/projects/de6ec33ca2164284b0d2631344feee0b/users/32b9af632c054639b440f5b2e4064ac5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.384451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6ec33ca2164284b0d2631344feee0b, user_id=32b9af632c054639b440f5b2e4064ac5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.388128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa709b-0595-44c4-87c1-92bfc1dc39a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.399841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:11.408804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2353/4686] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:11 2022] PUT /identity/v3/projects/de6ec33ca2164284b0d2631344feee0b/users/32b9af632c054639b440f5b2e4064ac5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:11.419243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.419833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.420810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.422122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2334/4687] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:11.426902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.436339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1331061-875b-4283-a21d-4491a1a44e48 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.464392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] MFA Rules not processed for user `32b9af632c054639b440f5b2e4064ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:11.465666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:11.498593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b9989d810824b4799a1db698e12bff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.499743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.500028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.500320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1/password` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.534597 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2354/4688] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:11.548905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.549147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:11.550401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:11.559696 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2335/4689] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:24:11 2022] POST /identity/v3/users/3b9989d810824b4799a1db698e12bff1/password => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:11.620150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc573-6087-4df2-96c1-2353aa70d34c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.624010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.624601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.624799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.625098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.693445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.695770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.707294 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2355/4690] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:11.840625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:11.852190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ce3a-8842-416a-a51d-f5e84c93bf10 tempest-IdentityV3UsersTest-2013178814 tempest-IdentityV3UsersTest-2013178814-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:11.856704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:11.857350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:11.857628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:11.857896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:11.876127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:11.877846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588b1e-199e-47bf-9384-5e198e6c56d1 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:11.889039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2336/4691] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:12.262045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:12.309170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:12.328035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a75d6-f025-46c0-941f-42f108df0804 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:12.332580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:12.333243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:12.333858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:12.333858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] PATH_INFO: `/v3/users/cca915f736e641cdae7bd6207bbd4efd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:12.334903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca915f736e641cdae7bd6207bbd4efd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:12.337208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:12.387704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca915f736e641cdae7bd6207bbd4efd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:12.394920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca915f736e641cdae7bd6207bbd4efd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:12.395569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca915f736e641cdae7bd6207bbd4efd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:12.405591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca915f736e641cdae7bd6207bbd4efd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:12.406332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca915f736e641cdae7bd6207bbd4efd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:12.425223 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2356/4692] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:12 2022] DELETE /identity/v3/users/cca915f736e641cdae7bd6207bbd4efd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:12.430177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c5599-d860-4442-9e53-cba620c8c8b6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:12.430486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c5599-d860-4442-9e53-cba620c8c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:12.430758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c5599-d860-4442-9e53-cba620c8c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:12.450575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2b3c5599-d860-4442-9e53-cba620c8c8b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:12.452029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b3c5599-d860-4442-9e53-cba620c8c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:12.524589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2337/4693] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:12.535072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:12.536568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:12.565850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:12.566140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:12.566432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:12.588313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:12.589710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:12.593030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2338/4694] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 16:24:12.620282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8143-f3d1-40a4-966e-f65ea0b2e0aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:12.624021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:12.624634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:12.624914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:12.625232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:12.635110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:12.636581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:12.650219 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2357/4695] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:13.234042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:13.235927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:13.282297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027a81-e1e0-43f4-a08a-59d2eaf9a857 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:13.292965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:13.293656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:13.293934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:13.294203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] PATH_INFO: `/v3/projects/1221cbf9f7bd470891ea3e83e5d8030e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:13.295374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1221cbf9f7bd470891ea3e83e5d8030e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:13.297308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:13.298997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:13.374711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1221cbf9f7bd470891ea3e83e5d8030e', 'request_id': 'req-228b78a4-3503-4261-8691-b3f46aac1dd4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.397809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1221cbf9f7bd470891ea3e83e5d8030e', 'request_id': 'req-228b78a4-3503-4261-8691-b3f46aac1dd4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.406249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1221cbf9f7bd470891ea3e83e5d8030e', 'request_id': 'req-228b78a4-3503-4261-8691-b3f46aac1dd4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.420143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] The token cache is being invalidate because project 1221cbf9f7bd470891ea3e83e5d8030e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:13.420460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.421198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-228b78a4-3503-4261-8691-b3f46aac1dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.422712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2339/4696] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:13 2022] DELETE /identity/v3/projects/1221cbf9f7bd470891ea3e83e5d8030e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:13.426696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:13.437774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c035a58-f6e9-40f8-a129-0404ce22a28b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:13.496256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:13.496918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:13.497227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:13.497498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] PATH_INFO: `/v3/users/32b9af632c054639b440f5b2e4064ac5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:13.498621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b9af632c054639b440f5b2e4064ac5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:13.500522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:13.505387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:13.551503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b9af632c054639b440f5b2e4064ac5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.559702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b9af632c054639b440f5b2e4064ac5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.560358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b9af632c054639b440f5b2e4064ac5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.567670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b9af632c054639b440f5b2e4064ac5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.568887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b9af632c054639b440f5b2e4064ac5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.592896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2358/4697] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:13 2022] DELETE /identity/v3/users/32b9af632c054639b440f5b2e4064ac5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:13.599192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552c8f-4eaf-404f-9024-30b69ac9887e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:13.599473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552c8f-4eaf-404f-9024-30b69ac9887e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:13.599753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6552c8f-4eaf-404f-9024-30b69ac9887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:13.623125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c6552c8f-4eaf-404f-9024-30b69ac9887e None None] MFA Rules not processed for user `3b9989d810824b4799a1db698e12bff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:13.624536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c6552c8f-4eaf-404f-9024-30b69ac9887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:13.695875 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2340/4698] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:13.702664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:13.704343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:13.782655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990346-f8a6-4ff3-bacd-286915514698 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:13.789784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:13.790445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:13.790691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:13.790958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] PATH_INFO: `/v3/users/3b9989d810824b4799a1db698e12bff1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:13.792218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9989d810824b4799a1db698e12bff1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:13.794181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:13.862436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.874706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.875902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.886516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.887970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9989d810824b4799a1db698e12bff1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:13.912193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2359/4699] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:13 2022] DELETE /identity/v3/users/3b9989d810824b4799a1db698e12bff1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:13.922612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:13.923030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:13.923160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:13.943376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:13.946011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:13.953552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:13.964176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:13.966511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.037807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcd6b9-f580-4813-8859-6992a107ae12 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.042448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2341/4700] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:14.043980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.044755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.045155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.045479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] PATH_INFO: `/v3/projects/de6ec33ca2164284b0d2631344feee0b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.047005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6ec33ca2164284b0d2631344feee0b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.049490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.052815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.055132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.102792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.107610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6ec33ca2164284b0d2631344feee0b', 'request_id': 'req-3fccc73c-149c-46e0-be60-a1baa0693306'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.115179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6ec33ca2164284b0d2631344feee0b', 'request_id': 'req-3fccc73c-149c-46e0-be60-a1baa0693306'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.123115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6ec33ca2164284b0d2631344feee0b', 'request_id': 'req-3fccc73c-149c-46e0-be60-a1baa0693306'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.129304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993133c9-2b1e-43c8-8b04-7453fb7c059a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.139634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] The token cache is being invalidate because project de6ec33ca2164284b0d2631344feee0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:14.140430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.141428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3fccc73c-149c-46e0-be60-a1baa0693306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.143539 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2360/4701] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:13 2022] DELETE /identity/v3/projects/de6ec33ca2164284b0d2631344feee0b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:14.149480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253475e-5be2-43fe-97d6-77c8064fa503 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.149910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253475e-5be2-43fe-97d6-77c8064fa503 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.150203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253475e-5be2-43fe-97d6-77c8064fa503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.173764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c253475e-5be2-43fe-97d6-77c8064fa503 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:14.175452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c253475e-5be2-43fe-97d6-77c8064fa503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.184765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.185468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.185841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.186123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.188017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.251871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2361/4702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:14.260771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.260771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.261112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.276043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.278632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.299229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:14.300450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.303834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2342/4703] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:14.312655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2362/4704] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:14.313888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.326453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe6e21-9d7b-4e37-b451-dbb50dd8a820 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.330944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.331881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.331881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.332118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.332774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:14.333297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.334893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.349012 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2343/4705] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:14.353753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.364156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dcef0-cd27-4a68-894b-1c6829387aba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.370303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.371351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.371792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.372269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.373152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.375580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.428294 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2363/4706] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:14.432148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.447405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb90b-5a44-4e37-a00a-6bcc6aa257b0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.576591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.578321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.578654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.578932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.579586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.581790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.610988 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2344/4707] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:14.615568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.624928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.636055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2f10c-c0c0-4d21-812c-c7af4ea746a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.666515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.667557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.668013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.668644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.669315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.671675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.714247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2364/4708] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:14.715491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.730349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fbc-4899-4ecb-a2c7-8dddc9963bc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.752767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.753520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.753933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.754266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.758037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.758037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.759418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.761281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.769926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2345/4709] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:14.778142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:14.780702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047bff-f748-4af1-991a-8e9095877228 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.786705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.787362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.787642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.789777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] PATH_INFO: `/v3/projects/e01f0d7cb5604b6592d5f37cecd24ba6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.791543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01f0d7cb5604b6592d5f37cecd24ba6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.793112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.799898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d3c2-d747-43f8-a751-14d1b28e19be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:14.806204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:14.807028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.807383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.807727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] PATH_INFO: `/v3/projects/2ad360d1f38d43a4890a7287c4b29a95/users/f4481091d36e44cf86f68c00c965b8f5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.810301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:14.829543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad360d1f38d43a4890a7287c4b29a95, user_id=f4481091d36e44cf86f68c00c965b8f5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:14.832714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a316235-1307-4bd0-98a3-aa9f2da69278 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:14.849359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'request_id': 'req-271c4306-1141-4e05-b61c-cb13e0617a6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.850552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2346/4710] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:14 2022] PUT /identity/v3/projects/2ad360d1f38d43a4890a7287c4b29a95/users/f4481091d36e44cf86f68c00c965b8f5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:14.861518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'request_id': 'req-271c4306-1141-4e05-b61c-cb13e0617a6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.864888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.865422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.865866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.869386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01f0d7cb5604b6592d5f37cecd24ba6', 'request_id': 'req-271c4306-1141-4e05-b61c-cb13e0617a6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.887108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] The token cache is being invalidate because project e01f0d7cb5604b6592d5f37cecd24ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:14.887108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.887781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-271c4306-1141-4e05-b61c-cb13e0617a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:14.889503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2365/4711] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:14 2022] DELETE /identity/v3/projects/e01f0d7cb5604b6592d5f37cecd24ba6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:14.894120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9bcb-d84b-4bb0-8ed1-56a5aa177f6d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:14.894573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9bcb-d84b-4bb0-8ed1-56a5aa177f6d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:14.894989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9bcb-d84b-4bb0-8ed1-56a5aa177f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:14.905723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] MFA Rules not processed for user `f4481091d36e44cf86f68c00c965b8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:14.906937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:14.919139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c59f9bcb-d84b-4bb0-8ed1-56a5aa177f6d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:14.920361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c59f9bcb-d84b-4bb0-8ed1-56a5aa177f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:15.020177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2366/4712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:15.028443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.029184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.029764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.034961 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2347/4713] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:15.048056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.049600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:15.067655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:15.068877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:15.086521 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2367/4714] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:15.087459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.098368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123fedd-d9b1-4d14-9235-7fcface6b8d5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.106330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.107093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.107472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.107859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.108618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:15.109072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.111032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.142039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2368/4715] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:15.142762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dae88-a7b7-4967-aa47-1c1402f88a3b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.146314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.148458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.149245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.149597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.149941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.164554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.167551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.173541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602717c-2cd4-4396-9db1-88194673f167 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.182206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2348/4716] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:15.183846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.184573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.184906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.185269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.186009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.188027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.233750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.235848 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2369/4717] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:15 2022] POST /identity/v3/projects => generated 411 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:15.246963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4b963-94a3-4c5c-9c3e-c8fb69be5ba6 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.339562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.340717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.340717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.340717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.341360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.343307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.374024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2349/4718] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:15 2022] POST /identity/v3/users => generated 306 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:15.377959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.392450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f01c48-026b-4792-88a3-3d85072c25d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.397478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.398773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.399048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.399385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.400161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.402064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.415188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2370/4719] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:24:15.418899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.425337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:15.431095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a008f7-1185-484f-8240-c2967c42e7c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.439185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.440090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.440462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.440827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.441826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.443589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627b96-94a9-4eca-8114-992de7b22ff3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.457043 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2350/4720] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:15.460943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.475751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963d1c-e584-40d2-b7e3-bff8301132cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.482869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.484127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.484638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.486013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] PATH_INFO: `/v3/projects/43bcfc30901148beb270aa546f942528/users/52f81d3323644fb8afbf15856e3e909a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.504161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bcfc30901148beb270aa546f942528, user_id=52f81d3323644fb8afbf15856e3e909a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.508906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:15.520846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:15.528557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2371/4721] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:15 2022] PUT /identity/v3/projects/43bcfc30901148beb270aa546f942528/users/52f81d3323644fb8afbf15856e3e909a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:15.543140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.543521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.545212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.579349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] MFA Rules not processed for user `52f81d3323644fb8afbf15856e3e909a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:15.580679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:15.706724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2351/4722] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:15.709817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:15.945218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6091af-6042-4fea-91c2-66ef4c036427 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:15.956933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:15.957836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:15.958273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:15.958985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:15.959952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:15.963756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.054998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2372/4723] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:15 2022] POST /identity/v3/projects => generated 411 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:16.056704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.072251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faf6b5-c9d1-4467-b1a6-ec908f43c6d1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.242755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.243783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.244285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.245443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.246913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.249634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.296474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2352/4724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:16 2022] POST /identity/v3/users => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:16.297068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.321676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0869-73b8-4f06-a2ca-549cc2ec6d0b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.323824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.324435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.324715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.324986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.325697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.327284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.343365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2373/4725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:16.347971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.362719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676005b7-5702-4e49-a65c-09914e24bb02 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.374100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.374788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.375072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.375682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] PATH_INFO: `/v3/projects/7d87e8d88343485ab7adeccd19b8ba90/users/a356cb78d7174c7b8e140e0566345eaa/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.398629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d87e8d88343485ab7adeccd19b8ba90, user_id=a356cb78d7174c7b8e140e0566345eaa, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.402632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.433320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2353/4726] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:16 2022] PUT /identity/v3/projects/7d87e8d88343485ab7adeccd19b8ba90/users/a356cb78d7174c7b8e140e0566345eaa/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:16.438646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.457468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d6bab-84d7-42c1-bc42-9e79f75a3a1f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.492885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.495436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:16.543455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.545788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.545788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.545788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.546344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.548889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.560098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:16.563954 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2374/4727] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:16.568644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.582367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870118-1ea8-4e79-9cd4-0e7237287125 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.583347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e16696-345f-4436-8b74-dc1765bfc856 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.587335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.588186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.588465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.588731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] PATH_INFO: `/v3/projects/7d87e8d88343485ab7adeccd19b8ba90/users/a356cb78d7174c7b8e140e0566345eaa/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.589328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.589972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.590303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.590578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] PATH_INFO: `/v3/users/f4481091d36e44cf86f68c00c965b8f5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.591117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d87e8d88343485ab7adeccd19b8ba90, user_id=a356cb78d7174c7b8e140e0566345eaa, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.591989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4481091d36e44cf86f68c00c965b8f5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.593792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8fbee-2292-43ba-bdcd-03a52724b221 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.593971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.607959 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2375/4728] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:16 2022] PUT /identity/v3/projects/7d87e8d88343485ab7adeccd19b8ba90/users/a356cb78d7174c7b8e140e0566345eaa/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:16.619672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.619672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.620064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.656681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] MFA Rules not processed for user `a356cb78d7174c7b8e140e0566345eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:16.657948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:16.676948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4481091d36e44cf86f68c00c965b8f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:16.677685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4481091d36e44cf86f68c00c965b8f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:16.689892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4481091d36e44cf86f68c00c965b8f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:16.691133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4481091d36e44cf86f68c00c965b8f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:16.707176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-72c967dd-571f-410f-beee-657889f98fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4481091d36e44cf86f68c00c965b8f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:16.725920 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2354/4729] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:16 2022] DELETE /identity/v3/users/f4481091d36e44cf86f68c00c965b8f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:16.731129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.731562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.731747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.736251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:16.754846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:16.756092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:16.779070 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2376/4730] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:16.787186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.789089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:16.832935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2355/4731] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:16.843341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:16.844853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:16.857963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee220c-3b6d-434c-9c04-e77ca53c9a1b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.911419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.911844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed79b5-eee2-41a7-859b-c6c5c979895d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:16.912337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.912685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.913085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.916766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:16.917477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:16.917826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:16.918173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:16.930180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.936512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:16.947905 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2356/4732] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:16.989448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:16.991151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41f7f-7f73-4cb3-b3e7-23cce6c39d4c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:17.004468 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2377/4733] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:17.474551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:17.476902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:17.512133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180f6b-7464-411a-83b6-1496065fadd5 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:17.517498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:17.518194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:17.518473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:17.518745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] PATH_INFO: `/v3/projects/2ad360d1f38d43a4890a7287c4b29a95` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:17.519959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad360d1f38d43a4890a7287c4b29a95)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:17.521966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:17.530939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:17.616872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad360d1f38d43a4890a7287c4b29a95', 'request_id': 'req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:17.627007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad360d1f38d43a4890a7287c4b29a95', 'request_id': 'req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:17.637026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad360d1f38d43a4890a7287c4b29a95', 'request_id': 'req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:17.649814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] The token cache is being invalidate because project 2ad360d1f38d43a4890a7287c4b29a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:17.650249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:17.651203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0f5dc8a3-d367-4a96-b7c8-8db1a98b361c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:17.654270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2357/4734] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:17 2022] DELETE /identity/v3/projects/2ad360d1f38d43a4890a7287c4b29a95 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:17.659435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:17.659929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:17.660059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:17.684544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:17.686066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:17.751729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:17.771098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2378/4735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:17.779729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:17.780108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:17.780444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:17.805850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:17.807340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:17.819262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2358/4736] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:17.824067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:17.835459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c0f6-34de-426a-90c4-031a8e3d0bf2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:17.840556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:17.841414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:17.841800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:17.842173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:17.842936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:17.843364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:17.845174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:17.859330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2379/4737] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:24:17.865525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:17.876273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3514a-42f2-40af-a97c-f27a28e80519 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:17.883430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:17.884018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:17.884364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:17.884640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:17.895779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:17.899428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:17.948777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2359/4738] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:17 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:17.950996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:17.962411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a684-ce76-485d-81ee-6e56342a893c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.031334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.032309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.032698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.033127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.033863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.035935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.062047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2380/4739] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:17 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:18.067070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.080415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0082-6506-4243-9e03-186ef136c074 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.096941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.097700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.098061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.098393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.099152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.100923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.116960 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2360/4740] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:18.121882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.133514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4fedc-649c-4679-84a4-9198e91e524c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.138935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.139687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.140081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.140450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.141247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.142974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89151bd7-d17c-44eb-9165-821391b8eb13 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.154937 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2381/4741] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:18.159333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.173445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c9cc-035f-4e7c-8b41-0a329a115c24 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.180332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.180332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.180332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.180866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] PATH_INFO: `/v3/projects/f17b1528d3cb485da5dac223a274f42b/users/8cb7b7b861994e1d94fc5ae8910b7bb1/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.204600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17b1528d3cb485da5dac223a274f42b, user_id=8cb7b7b861994e1d94fc5ae8910b7bb1, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.209909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.228980 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2361/4742] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:18 2022] PUT /identity/v3/projects/f17b1528d3cb485da5dac223a274f42b/users/8cb7b7b861994e1d94fc5ae8910b7bb1/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:18.240378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.240759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.241132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.280452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] MFA Rules not processed for user `8cb7b7b861994e1d94fc5ae8910b7bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:18.281531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:18.386075 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2382/4743] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:18.390335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.563618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3160d-5e6e-43d1-83e5-db3ec28ebd47 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.586996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.588197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.588795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.589458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.590719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.595565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.659267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2362/4744] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:18 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:18.665921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.676937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b40b69-9d46-4e86-b8f7-cb327c8f1e4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.726685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:18.746774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.747469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.747811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.748198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.749588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.753451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.782065 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2383/4745] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:18 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:18.786736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.809622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78034c9-5909-4493-aa4d-6618c3d194d0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.816522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.817494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.818175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.818790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.820205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.822230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.837194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2363/4746] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:18.841750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.855251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a4051-3377-4b57-ad4e-4b4bc27a641d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:18.860927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:18.861771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:18.862144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:18.862650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] PATH_INFO: `/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860/users/a619bdc902e44473894d185244901b59/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:18.885400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0a3af68b9a4c24aca663c01c2d9860, user_id=a619bdc902e44473894d185244901b59, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:18.888883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:18.907190 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2384/4747] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:18 2022] PUT /identity/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860/users/a619bdc902e44473894d185244901b59/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:18.912311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:18.920777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:18.929605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ee44-2d9d-41ae-967b-6a1836fc7d76 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.019536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.020325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.020905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.021537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.022816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.024522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae20e92-811a-41d8-a5c9-14b8dca5ebf5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.039398 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2364/4748] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:19.043410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.059912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98c4d-a40d-4839-8877-0e9d4513de65 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.065111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.065893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.066274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.066655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] PATH_INFO: `/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860/users/a619bdc902e44473894d185244901b59/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.068905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0a3af68b9a4c24aca663c01c2d9860, user_id=a619bdc902e44473894d185244901b59, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.072984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.085356 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2385/4749] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:19 2022] PUT /identity/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860/users/a619bdc902e44473894d185244901b59/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:19.095194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.095466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.095733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.133031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] MFA Rules not processed for user `a619bdc902e44473894d185244901b59`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:19.134731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:19.218788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2365/4750] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:19.223711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.240125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48399e7c-f604-44b4-9b6c-417e9a9ff966 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.247345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a619bdc902e44473894d185244901b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a0a3af68b9a4c24aca663c01c2d9860', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.248358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.249023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.249735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.250627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:19.250931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.252838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.290956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.295324 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2386/4751] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:19.310912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509700b7-b1ff-4d28-a590-d441d1420cc8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.326019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a619bdc902e44473894d185244901b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a0a3af68b9a4c24aca663c01c2d9860', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.327979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.328688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.329413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.331638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.336901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.421822 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2366/4752] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:19 2022] POST /identity/v3/projects => generated 348 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:19.426050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.454628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b3c6e-eb6e-4672-be15-aaba91d58936 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.650053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a619bdc902e44473894d185244901b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a0a3af68b9a4c24aca663c01c2d9860', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.650808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.659650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.660555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.661707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:19.662126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.665530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.683402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.686044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:19.692795 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2387/4753] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:19.703241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:19.706261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:19.834038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b38c9-8ef0-47ce-9bf1-ffcc7dd654f9 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.852221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b064-1c71-472d-83e3-44ce18990c85 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:19.858151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.859183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.859468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.860620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.860964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:19.862114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:19.862572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:19.863395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] PATH_INFO: `/v3/users/52f81d3323644fb8afbf15856e3e909a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:19.864840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f81d3323644fb8afbf15856e3e909a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.868406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.875757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:19.912804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:19.920592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c31e7-2ad3-4720-9559-05fac2b96dea service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:19.962926 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2388/4754] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:19.975261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f81d3323644fb8afbf15856e3e909a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:19.976464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f81d3323644fb8afbf15856e3e909a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:19.988497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f81d3323644fb8afbf15856e3e909a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:19.989477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f81d3323644fb8afbf15856e3e909a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:20.002256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f81d3323644fb8afbf15856e3e909a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:20.035087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2367/4755] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:19 2022] DELETE /identity/v3/users/52f81d3323644fb8afbf15856e3e909a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:20.036602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:20.036893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:20.037227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:20.075854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:20.077344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:20.101404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:20.233244 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2389/4756] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:20.242565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:20.244123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:20.461223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8792ac-4e72-4b80-a248-c540dafded07 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:20.466211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:20.467476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:20.467830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:20.468150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:20.490648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:20.492984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:20.505057 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2368/4757] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:20.542788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:20.544698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:20.714967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85f680-197b-4cba-b9e0-3f30ef340429 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:20.726677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:20.728122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:20.728750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:20.729126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:20.731390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:20.854644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:20.856557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:20.881437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2390/4758] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:21.031586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:21.033226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:21.059842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f83b5-01f9-4de4-b114-0531ebbb53ee service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:21.073519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:21.074189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:21.074593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:21.074857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] PATH_INFO: `/v3/projects/43bcfc30901148beb270aa546f942528` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:21.078533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bcfc30901148beb270aa546f942528)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:21.080449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:21.151778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bcfc30901148beb270aa546f942528', 'request_id': 'req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.162625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bcfc30901148beb270aa546f942528', 'request_id': 'req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.171806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bcfc30901148beb270aa546f942528', 'request_id': 'req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.192400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] The token cache is being invalidate because project 43bcfc30901148beb270aa546f942528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:21.193420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.194282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.200354 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2369/4759] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:21 2022] DELETE /identity/v3/projects/43bcfc30901148beb270aa546f942528 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:21.201484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:21.216122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dafb07-9f5e-4050-a522-bfd515494ffd service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:21.343023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:21.359310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:21.360981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:21.361286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:21.361556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] PATH_INFO: `/v3/users/a356cb78d7174c7b8e140e0566345eaa` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:21.363037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a356cb78d7174c7b8e140e0566345eaa)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:21.365995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:21.439151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a356cb78d7174c7b8e140e0566345eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.457711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a356cb78d7174c7b8e140e0566345eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.459784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a356cb78d7174c7b8e140e0566345eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.496904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a356cb78d7174c7b8e140e0566345eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.501578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1e7ac787-62ac-413d-a8dc-58d23f0b3ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a356cb78d7174c7b8e140e0566345eaa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:21.556231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2391/4760] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:21 2022] DELETE /identity/v3/users/a356cb78d7174c7b8e140e0566345eaa => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:21.862424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:21.864318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:21.884141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a7ece-426a-4ac4-ace9-e9a3f461a474 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:21.899865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:22.002995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.003637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.003911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.004175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] PATH_INFO: `/v3/projects/7d87e8d88343485ab7adeccd19b8ba90` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.005734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d87e8d88343485ab7adeccd19b8ba90)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.008538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.070500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d87e8d88343485ab7adeccd19b8ba90', 'request_id': 'req-78fb4a68-e800-4777-840b-bb35e095a4f9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.081339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d87e8d88343485ab7adeccd19b8ba90', 'request_id': 'req-78fb4a68-e800-4777-840b-bb35e095a4f9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.089600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d87e8d88343485ab7adeccd19b8ba90', 'request_id': 'req-78fb4a68-e800-4777-840b-bb35e095a4f9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.105828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] The token cache is being invalidate because project 7d87e8d88343485ab7adeccd19b8ba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:22.106365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.107028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78fb4a68-e800-4777-840b-bb35e095a4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.108506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2370/4761] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:21 2022] DELETE /identity/v3/projects/7d87e8d88343485ab7adeccd19b8ba90 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:22.113842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.114365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.114365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.149427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:22.151535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.235525 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2392/4762] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:22.243973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.244256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.244528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.271084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:22.272753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.281948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2371/4763] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:22.286300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.297651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7384-8c0f-4627-a157-d5d9d21ce624 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.302623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.303232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.303515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.304339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.305093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:22.305398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.307000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.324546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2393/4764] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:24:22.329190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.340068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019644af-94c2-42cb-b62f-f9dfad0b397f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.345357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.345957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.346238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.346509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.347144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.349088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.404452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2372/4765] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:22.407288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.423104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d99f4-3b69-4c83-9526-c6eabc5f4a27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.427018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.429937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.527902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.528571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.528870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.529595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.533160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.535147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.545943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:22.561508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055165-75c8-47bf-ac20-62473ada4045 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.569266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.569888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.570178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.570448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.573218 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2394/4766] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:22.575431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.575729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.579690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.615504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.617922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.635730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:22.659582 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2373/4767] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:22.660824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.681886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f4e26-7b05-4c17-bc2f-931b948c1599 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.688447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.689672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.690146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.690625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.691461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.693945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.703772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4a888-02c5-4afb-a40f-7da246158e52 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.709508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2374/4768] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:22.713994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.714556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a619bdc902e44473894d185244901b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a0a3af68b9a4c24aca663c01c2d9860', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.715308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.715662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.726069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c2a72-934b-4bbf-a410-8cad9c5d3f94 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.729843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] PATH_INFO: `/v3/projects/430ab4f858e4458cb3124f110980aea2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.731320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorizing `identity:delete_project(project_id=430ab4f858e4458cb3124f110980aea2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.732547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.733185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.733297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.733474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.733727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.734966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.737629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.753233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2375/4769] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:22.754676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.767770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eabfb2-108f-42bb-88ad-6707e1a152b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.772739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:22.773566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.773914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.774110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] PATH_INFO: `/v3/projects/50ca60d57685420a9e095da80d9efb28/users/5828d80933604cb883c69d914bcedc66/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.788830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430ab4f858e4458cb3124f110980aea2', 'request_id': 'req-f80708bb-2e16-4562-9ade-a5b7c2deb664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.792302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ca60d57685420a9e095da80d9efb28, user_id=5828d80933604cb883c69d914bcedc66, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:22.794224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1317f9-02fb-46a4-8773-2562954f69e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:22.797691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430ab4f858e4458cb3124f110980aea2', 'request_id': 'req-f80708bb-2e16-4562-9ade-a5b7c2deb664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.806119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430ab4f858e4458cb3124f110980aea2', 'request_id': 'req-f80708bb-2e16-4562-9ade-a5b7c2deb664'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.811278 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2376/4770] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:22 2022] PUT /identity/v3/projects/50ca60d57685420a9e095da80d9efb28/users/5828d80933604cb883c69d914bcedc66/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:22.823672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:22.824095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:22.824344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:22.834587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] The token cache is being invalidate because project 430ab4f858e4458cb3124f110980aea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:22.834910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.835581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:22.842630 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2395/4771] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:22 2022] DELETE /identity/v3/projects/430ab4f858e4458cb3124f110980aea2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:22.843557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.845242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.869270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] MFA Rules not processed for user `5828d80933604cb883c69d914bcedc66`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:22.871161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.936697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80708bb-2e16-4562-9ade-a5b7c2deb664 tempest-QuotasNegativeTest-1743149931 tempest-QuotasNegativeTest-1743149931-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:22.963794 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2377/4772] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:22.969481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:22.971198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:22.971851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:23.023810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.024031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.024295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.024581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] PATH_INFO: `/v3/users/8cb7b7b861994e1d94fc5ae8910b7bb1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.025806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb7b7b861994e1d94fc5ae8910b7bb1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.027754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.083621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08150f-c4fa-48e7-92a2-7750446d3306 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.090504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.090681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.090846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.091123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.091766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.094244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.101858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb7b7b861994e1d94fc5ae8910b7bb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:23.120654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb7b7b861994e1d94fc5ae8910b7bb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:23.122024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb7b7b861994e1d94fc5ae8910b7bb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:23.131074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb7b7b861994e1d94fc5ae8910b7bb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:23.132070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66f3b506-d93e-43b9-9511-efcdca1608e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb7b7b861994e1d94fc5ae8910b7bb1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:23.155686 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2378/4773] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:23.159876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.161076 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2396/4774] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:22 2022] DELETE /identity/v3/users/8cb7b7b861994e1d94fc5ae8910b7bb1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:23.161865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:23.166473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.166761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.169035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.199776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:23.201843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:23.205906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:23.259470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fd900-f773-4d74-8617-5fa3bbdee894 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.294300 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2397/4775] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:23.305652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.307013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:23.330420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.331496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.331776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.332050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.332688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.334668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.366886 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2379/4776] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:23 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:23.367987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:23.370987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.374443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694b26-8801-453a-b8f8-a7061261a944 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.384707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee3583-7adc-4880-af77-54e68a460943 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.388016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.390374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.390849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.391324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.391978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.392636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.393115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.393396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.394527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.396470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.410173 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2380/4777] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:23.410525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.411963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.415035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.426238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3553-cf86-4e01-8cc5-dae086c28224 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.426729 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2398/4778] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:23.432840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.435354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.435645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.435921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] PATH_INFO: `/v3/projects/f610c30db0c54828aabe6718561e7671/users/b8d056b486644a8b8826db76889efdee/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.458880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f610c30db0c54828aabe6718561e7671, user_id=b8d056b486644a8b8826db76889efdee, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.462729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.486337 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2381/4779] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:23 2022] PUT /identity/v3/projects/f610c30db0c54828aabe6718561e7671/users/b8d056b486644a8b8826db76889efdee/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:23.490717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.510887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c20fc-f669-421c-9a43-d4d19cb172ac service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.627154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.627779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.628106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.628383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.629267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.630879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa044942-2ac5-43ed-8979-2e2a2a3d3d0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.643343 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2399/4780] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:23.648028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.661525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaddc63-f701-464f-89de-3fbe791c82b8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:23.674079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:23.674748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.675021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.675285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] PATH_INFO: `/v3/projects/f610c30db0c54828aabe6718561e7671/users/b8d056b486644a8b8826db76889efdee/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.681834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f610c30db0c54828aabe6718561e7671, user_id=b8d056b486644a8b8826db76889efdee, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:23.684487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:23.711111 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2382/4781] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:23 2022] PUT /identity/v3/projects/f610c30db0c54828aabe6718561e7671/users/b8d056b486644a8b8826db76889efdee/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:23.713576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:23.714073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:23.714932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:23.761603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] MFA Rules not processed for user `b8d056b486644a8b8826db76889efdee`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:23.762824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:23.854257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.857326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:23.938575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2400/4782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:23.967076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:23.968754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:24.009202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c50c6-124b-4758-ae1e-d4400950a9b8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:24.021646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:24.022923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:24.023208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:24.023478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] PATH_INFO: `/v3/projects/f17b1528d3cb485da5dac223a274f42b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:24.024760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17b1528d3cb485da5dac223a274f42b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:24.026772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:24.066036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:24.124838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f10fd-3c40-40a7-bd7c-6510f4df372f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:24.138664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17b1528d3cb485da5dac223a274f42b', 'request_id': 'req-7351d699-e1f7-4123-9ca9-d789a5929cc0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.163254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17b1528d3cb485da5dac223a274f42b', 'request_id': 'req-7351d699-e1f7-4123-9ca9-d789a5929cc0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.184459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17b1528d3cb485da5dac223a274f42b', 'request_id': 'req-7351d699-e1f7-4123-9ca9-d789a5929cc0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.190909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:24.239392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] The token cache is being invalidate because project f17b1528d3cb485da5dac223a274f42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:24.239613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.242631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.246229 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2383/4783] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:23 2022] DELETE /identity/v3/projects/f17b1528d3cb485da5dac223a274f42b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:24.252657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:24.257911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:24.271278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:24.271919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:24.272194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:24.272500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:24.276783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:24.441703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351d699-e1f7-4123-9ca9-d789a5929cc0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:24.446823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:24.449521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:24.449731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:24.450408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:24.450694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:24.451035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] PATH_INFO: `/v3/users/a619bdc902e44473894d185244901b59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:24.452268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a619bdc902e44473894d185244901b59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:24.456065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:24.467316 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2401/4784] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:24.556018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a619bdc902e44473894d185244901b59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.556747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a619bdc902e44473894d185244901b59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.578582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a619bdc902e44473894d185244901b59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.580389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a619bdc902e44473894d185244901b59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.593556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-81925f04-45fe-4842-8387-1ef77c39c24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a619bdc902e44473894d185244901b59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:24.621215 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2384/4785] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:24 2022] DELETE /identity/v3/users/a619bdc902e44473894d185244901b59 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:25.158287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.186258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff27ca-ff4c-49ef-be73-a883add4bec9 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:25.286528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:25.287180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.287461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.287733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] PATH_INFO: `/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.289649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0a3af68b9a4c24aca663c01c2d9860)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:25.291554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:25.359675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0a3af68b9a4c24aca663c01c2d9860', 'request_id': 'req-0f67a10c-3591-4ebd-9066-79277c964007'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.372212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0a3af68b9a4c24aca663c01c2d9860', 'request_id': 'req-0f67a10c-3591-4ebd-9066-79277c964007'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.380821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0a3af68b9a4c24aca663c01c2d9860', 'request_id': 'req-0f67a10c-3591-4ebd-9066-79277c964007'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.409128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] The token cache is being invalidate because project 5a0a3af68b9a4c24aca663c01c2d9860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:25.409448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.410123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f67a10c-3591-4ebd-9066-79277c964007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.411641 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2402/4786] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:25 2022] DELETE /identity/v3/projects/5a0a3af68b9a4c24aca663c01c2d9860 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:25.417610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.418132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.418220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.440870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:25.442154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:25.465534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:25.521323 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2385/4787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:25.529503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.529817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.530147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.559672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:25.571499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:25.575432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:25.589808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.589808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:25.593587 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2403/4788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:25.597951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.604448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adbe28-9508-4afa-84c3-85152cb2d968 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:25.610822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:25.611717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.613074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.613074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] PATH_INFO: `/v3/users/0946acd9a88a44a18a04c50bf9312322` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.614186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0946acd9a88a44a18a04c50bf9312322)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:25.619219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:25.622533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f829af-7df6-4a95-aa1a-88d1a0ab5b40 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:25.628541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:25.629387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.629766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.633677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.634620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:25.634999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:25.638769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:25.664753 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2404/4789] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:25.667775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.683816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c3a31-c2f6-4694-bbb4-7e33e876e2d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:25.693345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:25.694839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.695391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.695729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.696754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:25.701330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:25.721291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0946acd9a88a44a18a04c50bf9312322'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.723588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0946acd9a88a44a18a04c50bf9312322'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.742400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0946acd9a88a44a18a04c50bf9312322'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.743793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0946acd9a88a44a18a04c50bf9312322'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.763511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63a6a466-a2ef-424e-8198-56a9ecf418f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0946acd9a88a44a18a04c50bf9312322'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:25.766131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2405/4790] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:25 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:25.770603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.773336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:25.817428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2386/4791] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:25 2022] DELETE /identity/v3/users/0946acd9a88a44a18a04c50bf9312322 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:25.834234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:25.834524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:25.843875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:25.878357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:25.881124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:25.925621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ead5e-6f0a-4b77-8a0a-4e27baac0447 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:25.984346 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2387/4792] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:25.993957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:25.996457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:26.037236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.038936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.040073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.040507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.041995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.045209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.076914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:26.097200 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2406/4793] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:25 2022] POST /identity/v3/users => generated 303 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:26.104400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.114146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0811e-c625-49ec-b19d-dcc5c68f2339 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.122610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.123383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.123666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.124084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.134376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9e0e-508b-4a64-9295-22bacc1597f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.142245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.144003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.148241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.149308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.149738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.150183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.151036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.153844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.156238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2388/4794] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:26.171188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2407/4795] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:26.179358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.193893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a4f3f-c0c0-4f2c-87d9-9474b7287ead service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.206647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.206647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.206986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.207427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.208428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.210918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4d535-d9df-444b-85f1-507f0a07ff32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.229966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2389/4796] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:26.231331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.244282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2643a-f097-492b-b569-29cff3af1365 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.267186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.267869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.268263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.268923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] PATH_INFO: `/v3/projects/54793df11cd946dcbe58f15c0e012dd4/users/3460260d63d246f7b8d789c9be65911c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.290493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54793df11cd946dcbe58f15c0e012dd4, user_id=3460260d63d246f7b8d789c9be65911c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.293576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.309539 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2408/4797] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:26 2022] PUT /identity/v3/projects/54793df11cd946dcbe58f15c0e012dd4/users/3460260d63d246f7b8d789c9be65911c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:26.404703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.405022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.405293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.447924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.449833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:26.477034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] MFA Rules not processed for user `3460260d63d246f7b8d789c9be65911c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:26.478132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:26.501712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:26.558801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eee95b-bd17-403a-b163-9e8873166771 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.569428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.570339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.570691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.571245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] PATH_INFO: `/v3/projects/d8b4d8a393a549d8b9d65fab5f050025` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.572556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b4d8a393a549d8b9d65fab5f050025)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.575291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.584204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2390/4798] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:26.586443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.607248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bc4b9-ad12-4e6d-a75a-9f1039da2440 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.615582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.617202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.617657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.618118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.618934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.627106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.677358 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2391/4799] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:26 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:26.679416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.698547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b4d8a393a549d8b9d65fab5f050025', 'request_id': 'req-62bc136a-7541-4895-bc14-636d5fd5a8d4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:26.730923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b4d8a393a549d8b9d65fab5f050025', 'request_id': 'req-62bc136a-7541-4895-bc14-636d5fd5a8d4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:26.742935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b4d8a393a549d8b9d65fab5f050025', 'request_id': 'req-62bc136a-7541-4895-bc14-636d5fd5a8d4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:26.765921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] The token cache is being invalidate because project d8b4d8a393a549d8b9d65fab5f050025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:26.766538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:26.767591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:26.769497 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2409/4800] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:26 2022] DELETE /identity/v3/projects/d8b4d8a393a549d8b9d65fab5f050025 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:26.773586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.775426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:26.778465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fca9d-f5c8-46fb-bae4-48064179a564 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.786669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.787326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.788332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.788623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.789690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.792573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.821223 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2392/4801] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:26 2022] POST /identity/v3/users => generated 309 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:26.825272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.827411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:26.845499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f82aa-d122-4a7d-8898-f1f58d5e9a88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.855292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.855510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.855791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.856074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.856702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.859490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.866051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc136a-7541-4895-bc14-636d5fd5a8d4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.875335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.877598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.877949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.878291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] PATH_INFO: `/v3/users/989ba1dcb3804fc7bcd5b6d719d0940c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.883604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2393/4802] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:24:26.884366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989ba1dcb3804fc7bcd5b6d719d0940c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.886380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.889571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:26.931738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fb243-d328-46e0-b064-e636843c867e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:26.938887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:26.939101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:26.939487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:26.939798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] PATH_INFO: `/v3/projects/8a1358783cb846a288632f88a4add2d8/users/d86d28abce0546d9aff364542d12230b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:26.963631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1358783cb846a288632f88a4add2d8, user_id=d86d28abce0546d9aff364542d12230b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:26.966360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:26.970458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:26.996446 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2394/4803] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:26 2022] PUT /identity/v3/projects/8a1358783cb846a288632f88a4add2d8/users/d86d28abce0546d9aff364542d12230b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:27.000969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:27.044679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989ba1dcb3804fc7bcd5b6d719d0940c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.056674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989ba1dcb3804fc7bcd5b6d719d0940c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.059084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989ba1dcb3804fc7bcd5b6d719d0940c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.067617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:27.083324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989ba1dcb3804fc7bcd5b6d719d0940c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.084354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989ba1dcb3804fc7bcd5b6d719d0940c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.123929 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2410/4804] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:26 2022] DELETE /identity/v3/users/989ba1dcb3804fc7bcd5b6d719d0940c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:27.138332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b5e6-e4bd-420b-855c-f3e98afff728 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:27.278979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:27.280354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:27.295285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:27.296507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:27.304366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:27.307409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7187477-f307-4304-9e8c-bad3d6dc7fbf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:27.342740 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2395/4805] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:24:27.345207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:27.347231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:27.368787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1a305-ced0-4bf3-a81b-dcf6327a0b11 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:27.377430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:27.378119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:27.378442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:27.378701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] PATH_INFO: `/v3/projects/8a1358783cb846a288632f88a4add2d8/users/d86d28abce0546d9aff364542d12230b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:27.382624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1358783cb846a288632f88a4add2d8, user_id=d86d28abce0546d9aff364542d12230b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:27.412520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:27.453510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2411/4806] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:27 2022] PUT /identity/v3/projects/8a1358783cb846a288632f88a4add2d8/users/d86d28abce0546d9aff364542d12230b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:27.457187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:27.457467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:27.457780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:27.507614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] MFA Rules not processed for user `d86d28abce0546d9aff364542d12230b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:27.510207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:27.656249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2396/4807] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:27.672952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:27.678053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:27.688727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:27.690647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:27.754622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:27.838102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94ab3c-d7eb-4778-92ff-1b60eb147e3a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:27.842966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9bfb3-f4d6-4473-8757-ab61ae1f86b1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:27.843541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:27.844346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:27.844630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:27.844904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] PATH_INFO: `/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:27.846260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f932cc4a2fe5498ea701eeda7be1b28f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:27.848345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:27.850012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:27.851095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:27.851680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:27.852168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:27.854997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:27.924930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f932cc4a2fe5498ea701eeda7be1b28f', 'request_id': 'req-7833346c-fd09-4590-9e8a-07dc5cd476ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.956541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f932cc4a2fe5498ea701eeda7be1b28f', 'request_id': 'req-7833346c-fd09-4590-9e8a-07dc5cd476ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.975529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f932cc4a2fe5498ea701eeda7be1b28f', 'request_id': 'req-7833346c-fd09-4590-9e8a-07dc5cd476ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.996589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] The token cache is being invalidate because project f932cc4a2fe5498ea701eeda7be1b28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:27.997312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:27.998631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7833346c-fd09-4590-9e8a-07dc5cd476ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:28.003382 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2397/4808] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:27 2022] DELETE /identity/v3/projects/f932cc4a2fe5498ea701eeda7be1b28f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:28.015301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.015612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.016025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.055618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:28.058315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:28.061978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.066166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43329d-d87a-4d65-86b7-a8c0a5696128 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.104068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2412/4809] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:28.241674 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2398/4810] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:28.243154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.243656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.243948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.291566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:28.293306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:28.308454 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2413/4811] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:28.309822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.322411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc5b3d-f727-492d-8f53-0fff00612ff5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.329902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.331335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.331769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.332060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.332699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:28.333057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.335628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.353397 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2399/4812] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:24:28.357993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.375590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee223-cdd9-49a5-83c7-f82c08983fdd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.384405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.385612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.386179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.387401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.388158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.392357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.456519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2414/4813] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:28 2022] POST /identity/v3/projects => generated 397 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:24:28.461570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.473499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eec99-e612-4f79-b346-46d6dc96dfb4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.558508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:28.599250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.600916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.601886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.602419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.603731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.612747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.658734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.671300 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2400/4814] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:28 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:28.683149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea505-c9bf-49a2-8877-bff557a7a913 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.691598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.691598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.691598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.691598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.695535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.698429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.716794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.722917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:28.756007 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2415/4815] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:28.757500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.774713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f343ba1-e79d-4efa-a5b9-f44c0b6b710c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.792375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.794395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.794878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.795342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.797748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.803777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.830333 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2416/4816] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:24:28.833010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:28.865148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d167b-1d48-457c-a934-7854c4f363e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.875187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.876890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.877121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.877587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] PATH_INFO: `/v3/projects/f60dce1cd8eb41018541468ed4be516e/users/509c1d87110a4122b3e7be91772ff2aa/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.913335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60dce1cd8eb41018541468ed4be516e, user_id=509c1d87110a4122b3e7be91772ff2aa, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:28.916324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090323-5c2e-47c4-8f14-33899eddaa33 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:28.916673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42aed8d-c64e-4636-a9b2-18a677df6ea2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:28.923392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:28.924534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.925024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.925149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.928038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:28.947701 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2417/4817] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:24:28 2022] PUT /identity/v3/projects/f60dce1cd8eb41018541468ed4be516e/users/509c1d87110a4122b3e7be91772ff2aa/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:28.947701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befff62-011c-481b-91e5-16a03ab1b510 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:28.948236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befff62-011c-481b-91e5-16a03ab1b510 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:28.948610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befff62-011c-481b-91e5-16a03ab1b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:28.961143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:29.000374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5befff62-011c-481b-91e5-16a03ab1b510 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:29.002276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5befff62-011c-481b-91e5-16a03ab1b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:29.083482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:29.089103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:29.116362 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2401/4818] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:29.222283 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2418/4819] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:29.240644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:29.242331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:29.480326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69d261-8a52-4979-a6fb-6157b8875c98 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:29.499472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:29.552131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:29.553153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:29.554181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:29.554635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:29.577118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:29.579626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:29.612938 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2402/4820] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:29.968824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:29.969485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:29.970966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:29.997441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:29.998700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:30.089211 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2419/4821] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:30.108122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:30.111912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:30.229566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342011-30ff-4249-bdbe-0511ced924a7 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:30.236529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:30.237278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:30.237565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:30.237967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:30.249071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:30.250690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:30.263947 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2403/4822] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:24:35.891379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:35.893592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:36.299894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8674-1345-4464-8e4d-26cefe077887 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:36.324353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d056b486644a8b8826db76889efdee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f610c30db0c54828aabe6718561e7671', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:36.324982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:36.325288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:36.325557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:36.329922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:36.330248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:36.333416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:36.378239 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2420/4823] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:36.380190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:36.452811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e0968-d903-41ed-960b-4f9df791aa8b service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:36.475611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d056b486644a8b8826db76889efdee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f610c30db0c54828aabe6718561e7671', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:36.476460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:36.477817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:36.479585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:36.482553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:36.484948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:36.547028 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2404/4824] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:36 2022] POST /identity/v3/projects => generated 347 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:36.548235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:36.566428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6ec7c-c36c-42e1-9e57-f75eba1c0f96 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:36.712952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:36.773261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d056b486644a8b8826db76889efdee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f610c30db0c54828aabe6718561e7671', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:36.777225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:36.777483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:36.777749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:36.778723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:36.778723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:36.793419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:36.836331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2421/4825] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:38.449361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:38.480967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387f7a-e28b-4b4e-bdc0-9ab760ee3818 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:38.490016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8d056b486644a8b8826db76889efdee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f610c30db0c54828aabe6718561e7671', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:38.490679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:38.492031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:38.492232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] PATH_INFO: `/v3/projects/f3dd8a67910b45d990353196e081f9ba` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:38.493463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3dd8a67910b45d990353196e081f9ba)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:38.496023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:38.597907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3dd8a67910b45d990353196e081f9ba', 'request_id': 'req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:38.617390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3dd8a67910b45d990353196e081f9ba', 'request_id': 'req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:38.672986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3dd8a67910b45d990353196e081f9ba', 'request_id': 'req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:38.699658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] The token cache is being invalidate because project f3dd8a67910b45d990353196e081f9ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:38.702063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:38.705121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a51d83f4-0302-4090-b7f0-dd05f9f7b06e tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:38.711243 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2405/4826] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:38 2022] DELETE /identity/v3/projects/f3dd8a67910b45d990353196e081f9ba => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:38.798930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:38.803015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:38.944421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d3169-c69e-4652-aeb1-d90477353c27 tempest-RoutersIpV6AdminTest-1813695156 tempest-RoutersIpV6AdminTest-1813695156-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:39.126516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:39.129675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:39.130514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:39.133211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:39.138043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:39.314489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:39.316880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594f75-12bd-43e9-a0fa-aa1f8846eb63 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:39.335466 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2422/4827] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:24:48.687460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:49.329980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=79 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:50.077617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:50.078611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:50.079077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:50.172249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] MFA Rules not processed for user `509c1d87110a4122b3e7be91772ff2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:50.186518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:50.455195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2406/4828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:50.472556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:50.473218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:50.473499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:50.562028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] MFA Rules not processed for user `509c1d87110a4122b3e7be91772ff2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:50.566184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:50.597356 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2423/4829] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:50.618395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:50.620441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:51.033078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894754c-fe65-4def-9f70-b646e6511a56 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:51.051279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:51.051927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:51.052363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:51.052482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:51.085231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:51.086878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f52cb0-8c98-4493-a13f-2dafd9929432 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:51.130984 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2407/4830] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:52.892279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:52.895825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:53.169307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b4aab-7217-4ada-897f-5bf9c68b98a5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:53.194702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:53.195697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:53.196017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:53.196387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] PATH_INFO: `/v3/users/3460260d63d246f7b8d789c9be65911c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:53.208407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3460260d63d246f7b8d789c9be65911c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:53.226776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:53.558719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3460260d63d246f7b8d789c9be65911c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:53.596340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3460260d63d246f7b8d789c9be65911c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:53.597456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3460260d63d246f7b8d789c9be65911c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:53.649766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3460260d63d246f7b8d789c9be65911c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:53.657046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3460260d63d246f7b8d789c9be65911c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:53.798701 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2424/4831] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:52 2022] DELETE /identity/v3/users/3460260d63d246f7b8d789c9be65911c => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:53.806959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:53.807584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:53.808262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:53.889338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:53.916215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:54.173279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:54.175528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:54.179621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2408/4832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:54.511304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c0e0c-90d1-4e5e-b90f-bdb949561193 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:54.529231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:54.530374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:54.531208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:54.531618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:54.572839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:54.575669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:54.624166 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2425/4833] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:24:55.681408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:55.683143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:55.720164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da23e8-f039-4182-ac57-d013bb453725 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:55.750330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:55.759783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:55.760349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:55.760828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] PATH_INFO: `/v3/projects/54793df11cd946dcbe58f15c0e012dd4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:55.764600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=54793df11cd946dcbe58f15c0e012dd4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:55.772363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:55.810921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:55.955899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54793df11cd946dcbe58f15c0e012dd4', 'request_id': 'req-19405ba7-9384-4478-8454-98d1c40da38f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:55.983921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54793df11cd946dcbe58f15c0e012dd4', 'request_id': 'req-19405ba7-9384-4478-8454-98d1c40da38f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.008141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54793df11cd946dcbe58f15c0e012dd4', 'request_id': 'req-19405ba7-9384-4478-8454-98d1c40da38f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.055616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] The token cache is being invalidate because project 54793df11cd946dcbe58f15c0e012dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:56.056052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.057096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.060360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2409/4834] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:55 2022] DELETE /identity/v3/projects/54793df11cd946dcbe58f15c0e012dd4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:56.066615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:56.086297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1341-9d90-4b8d-84d6-c5470e81cf99 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:56.117131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:56.301791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:56.302987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:56.303292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:56.303672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] PATH_INFO: `/v3/users/d86d28abce0546d9aff364542d12230b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:56.305211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86d28abce0546d9aff364542d12230b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:56.307131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:56.442184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86d28abce0546d9aff364542d12230b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.461036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86d28abce0546d9aff364542d12230b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.461036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86d28abce0546d9aff364542d12230b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.479025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86d28abce0546d9aff364542d12230b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.480406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d43d8cbc-536c-4a2a-92ef-55f8794dc2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86d28abce0546d9aff364542d12230b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:56.555107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2426/4835] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:24:56 2022] DELETE /identity/v3/users/d86d28abce0546d9aff364542d12230b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:24:58.124226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:58.127629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:58.194084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19405ba7-9384-4478-8454-98d1c40da38f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:58.463609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:58.469741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:58.474051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:58.474051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] PATH_INFO: `/v3/projects/8a1358783cb846a288632f88a4add2d8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:58.475855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1358783cb846a288632f88a4add2d8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:58.498962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:58.741795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1358783cb846a288632f88a4add2d8', 'request_id': 'req-cd8929a5-c690-4cac-af80-7b72cdf09600'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:58.762850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1358783cb846a288632f88a4add2d8', 'request_id': 'req-cd8929a5-c690-4cac-af80-7b72cdf09600'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:58.795534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1358783cb846a288632f88a4add2d8', 'request_id': 'req-cd8929a5-c690-4cac-af80-7b72cdf09600'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:58.854371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] The token cache is being invalidate because project 8a1358783cb846a288632f88a4add2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:24:58.854957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:58.858464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd8929a5-c690-4cac-af80-7b72cdf09600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:24:58.870675 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2410/4836] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:24:58 2022] DELETE /identity/v3/projects/8a1358783cb846a288632f88a4add2d8 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:24:58.879372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:58.879869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:58.880306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:58.987482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:59.012546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:59.343279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2427/4837] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:24:59.363469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:59.364008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:59.364629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:59.407989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:24:59.415854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:24:59.426922 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2411/4838] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:24:59.433320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:59.447601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7e8f2-3e60-43c4-a6a3-ca042bfa793c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:59.486295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:59.489802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:59.490084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:59.490465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:59.491109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:24:59.491513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:59.494301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:59.589961 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2428/4839] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:24:59.591353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:59.624877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8837e1-9848-4dc0-ba2f-6d8462910cb4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:24:59.661536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:24:59.665399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:24:59.666381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:24:59.667074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:24:59.671580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:24:59.679420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:24:59.798906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:24:59.854697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:24:59.856178 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2412/4840] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:24:59 2022] POST /identity/v3/projects => generated 357 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:24:59.889420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc12dc-afd7-46cf-9241-20453e750667 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:00.015187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:00.148515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:00.150064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:00.150597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:00.151205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:00.152737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:00.155673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:00.230634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2429/4841] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:24:59 2022] POST /identity/v3/users => generated 279 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:25:00.237832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:00.278610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba24000-ad4d-4c66-a5fe-a891a5677cba admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:00.297364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:00.298477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:00.298965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:00.299442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:00.300618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:00.306723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:00.361041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:00.369641 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2413/4842] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:00.398575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae8f2f-bb7c-46bc-a7bd-b0bd4ee9253d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:00.414734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:00.415528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:00.416181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:00.416324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:00.417187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:00.419006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df754b7-aa27-42c1-bb69-ca50e820a580 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:00.471766 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2430/4843] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:00.479167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:00.512165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80996cb3-359a-4f0b-a790-0beb1186993c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:00.529432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:00.532579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:00.537213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:00.537801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] PATH_INFO: `/v3/projects/d6c24e04da5544cba17bfbe1ac33953b/users/274222e7f3334d8bbc01c46cdc49a6bc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:00.626405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c24e04da5544cba17bfbe1ac33953b, user_id=274222e7f3334d8bbc01c46cdc49a6bc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:00.632349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:00.702752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2414/4844] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:00 2022] PUT /identity/v3/projects/d6c24e04da5544cba17bfbe1ac33953b/users/274222e7f3334d8bbc01c46cdc49a6bc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:00.705141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:00.705958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:00.706686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:00.797885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] MFA Rules not processed for user `274222e7f3334d8bbc01c46cdc49a6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:00.800536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:00.972316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:00.972811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2431/4845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:01.097553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e698-2184-4902-a7b7-94dc79b1f91d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:01.108508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:01.110381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:01.111087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:01.111711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:01.112906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:01.116645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:01.189599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:01.190147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2415/4846] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:25:00 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:01.225609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da93d2-0396-4ca6-b4ac-6562a36c81a1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:01.493307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:01.494650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:01.495280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:01.495908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:01.497289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:01.504300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:01.632501 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2432/4847] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:25:01 2022] POST /identity/v3/users => generated 285 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:01.641312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:01.691284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788296d-bc05-45b4-95af-4fc8d8856e0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:01.756264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:01.760472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:01.761605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:01.763212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:01.773411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:01.792789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:01.890413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2416/4848] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:01.898801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:01.934881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff1482-78d8-40f9-a07e-382e0c377816 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:01.956126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:01.962046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:01.962381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:01.962654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] PATH_INFO: `/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0/users/c359fd525b03464a9da6abd6a416660b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:02.045852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9f3db8b72d4e548db96b0c26023fe0, user_id=c359fd525b03464a9da6abd6a416660b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:02.062358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:02.072229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:02.120039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2433/4849] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:01 2022] PUT /identity/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0/users/c359fd525b03464a9da6abd6a416660b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:02.129223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:02.176800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ef2b-d463-4c00-8875-6930d9807971 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:02.495662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:02.496602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:02.496891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:02.497292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:02.506441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:02.508724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bdb70-692c-4e66-b434-61d6877585ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:02.561259 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2417/4850] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:02.563852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:02.588830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d05e6-6732-49af-be7a-4cb496ede359 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:02.601646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:02.602999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:02.603985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:02.604475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] PATH_INFO: `/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0/users/c359fd525b03464a9da6abd6a416660b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:02.607455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9f3db8b72d4e548db96b0c26023fe0, user_id=c359fd525b03464a9da6abd6a416660b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:02.618835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:02.646108 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2434/4851] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:02 2022] PUT /identity/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0/users/c359fd525b03464a9da6abd6a416660b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:02.670124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:02.670691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:02.671023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:02.798512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] MFA Rules not processed for user `c359fd525b03464a9da6abd6a416660b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:02.800621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:02.958641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:03.184901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:03.187265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2418/4852] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:03.205367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0077c6-cd3c-43ab-aab9-38b8f1139112 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:03.228855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c359fd525b03464a9da6abd6a416660b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9f3db8b72d4e548db96b0c26023fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:03.229721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:03.230265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:03.230265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:03.230985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:25:03.231299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:03.232881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:03.273440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2435/4853] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:25:03.279897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:03.325157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc2ba-9cd5-410b-9d2c-9405c378994d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:03.361268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c359fd525b03464a9da6abd6a416660b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9f3db8b72d4e548db96b0c26023fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:03.362350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:03.362859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:03.363365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:03.374626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:03.384335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:03.469781 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2419/4854] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:25:03 2022] POST /identity/v3/projects => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:03.473863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:03.499117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e1706-a588-4427-8bb9-bdfd99712915 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:03.624901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c359fd525b03464a9da6abd6a416660b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9f3db8b72d4e548db96b0c26023fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:03.625870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:03.626338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:03.626831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:03.627687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:25:03.628188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:03.630084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:03.664040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2436/4855] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:25:03.776609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:03.793047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:03.925257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14b9-19c2-4987-8fa1-1ef44e3e4c92 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:03.952955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:03.954056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:03.954545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:03.955023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:03.972545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:03.974890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:04.016167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2420/4856] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:05.114004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:05.155594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee3355-40cf-4aae-929b-16005e8a1d67 tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:05.169951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c359fd525b03464a9da6abd6a416660b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e9f3db8b72d4e548db96b0c26023fe0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:05.172404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:05.172905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:05.173707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] PATH_INFO: `/v3/projects/4262849e73f54159a9a88b49c8d17b7d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:05.177710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4262849e73f54159a9a88b49c8d17b7d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:05.187700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:05.301445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4262849e73f54159a9a88b49c8d17b7d', 'request_id': 'req-966fd553-4b93-4d07-b7c1-27bdf821e83c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:05.311329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4262849e73f54159a9a88b49c8d17b7d', 'request_id': 'req-966fd553-4b93-4d07-b7c1-27bdf821e83c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:05.320866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4262849e73f54159a9a88b49c8d17b7d', 'request_id': 'req-966fd553-4b93-4d07-b7c1-27bdf821e83c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:05.362367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] The token cache is being invalidate because project 4262849e73f54159a9a88b49c8d17b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:25:05.362659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:05.366263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-966fd553-4b93-4d07-b7c1-27bdf821e83c tempest-QuotasTest-1498597805 tempest-QuotasTest-1498597805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:05.373086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2437/4857] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:25:05 2022] DELETE /identity/v3/projects/4262849e73f54159a9a88b49c8d17b7d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:07.433900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:07.662815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bafcf0-36a0-4f00-926e-98dd00bd7510 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:07.812132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:07.850197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:07.851446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:07.852046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:07.852609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] PATH_INFO: `/v3/users/274222e7f3334d8bbc01c46cdc49a6bc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:07.854474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274222e7f3334d8bbc01c46cdc49a6bc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:07.857925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:08.023487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274222e7f3334d8bbc01c46cdc49a6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:08.028022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274222e7f3334d8bbc01c46cdc49a6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:08.063132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274222e7f3334d8bbc01c46cdc49a6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:08.064970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274222e7f3334d8bbc01c46cdc49a6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:08.084129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274222e7f3334d8bbc01c46cdc49a6bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:08.145932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:08.146560 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2421/4858] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:25:07 2022] DELETE /identity/v3/users/274222e7f3334d8bbc01c46cdc49a6bc => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:08.147086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:08.147703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:08.245133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:08.253247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:08.403892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:08.470083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2438/4859] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:08.496941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:08.499322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:08.689947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60776dcb-7336-4ec8-b23b-2da009897d66 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:08.702245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:08.703389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:08.704111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:08.704612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:08.727683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:08.738707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:08.754939 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2422/4860] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:09.582877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:09.585795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:09.769252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca5576-e63e-4ac3-9f3e-0e87ed74e7c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:09.780003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:09.781400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:09.782066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:09.782764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:09.785778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:09.971637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:09.974721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:10.001290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2439/4861] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:11.182788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:11.185481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:11.232721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05a91-bcd4-4e1f-9e0c-76f136f3afa8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:11.251703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:11.252773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:11.253268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:11.253617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] PATH_INFO: `/v3/projects/d6c24e04da5544cba17bfbe1ac33953b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:11.257742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c24e04da5544cba17bfbe1ac33953b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:11.263929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:11.414501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c24e04da5544cba17bfbe1ac33953b', 'request_id': 'req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.438236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c24e04da5544cba17bfbe1ac33953b', 'request_id': 'req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.467721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c24e04da5544cba17bfbe1ac33953b', 'request_id': 'req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.476782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:11.502047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] The token cache is being invalidate because project d6c24e04da5544cba17bfbe1ac33953b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:25:11.502673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.505670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.512325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2423/4862] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:25:11 2022] DELETE /identity/v3/projects/d6c24e04da5544cba17bfbe1ac33953b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:11.514310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:11.541417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3436094-b1c5-4917-8df8-58109c4f7110 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:11.736844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:11.737976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:11.738465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:11.738951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] PATH_INFO: `/v3/users/c359fd525b03464a9da6abd6a416660b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:11.747846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c359fd525b03464a9da6abd6a416660b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:11.750132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:11.812708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:11.861371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c359fd525b03464a9da6abd6a416660b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.882761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c359fd525b03464a9da6abd6a416660b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.884385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c359fd525b03464a9da6abd6a416660b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.926282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c359fd525b03464a9da6abd6a416660b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:11.928057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6070cfb-c218-41b1-bcf3-552d261fcc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c359fd525b03464a9da6abd6a416660b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:12.031174 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2440/4863] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:25:11 2022] DELETE /identity/v3/users/c359fd525b03464a9da6abd6a416660b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:14.650616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:14.652862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:14.731029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b23d6-0fc6-4a72-8ca2-2655f0b73b73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:15.014139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:15.014139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.014139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.014139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] PATH_INFO: `/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.030144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9f3db8b72d4e548db96b0c26023fe0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:15.033916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:15.236799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9f3db8b72d4e548db96b0c26023fe0', 'request_id': 'req-286a85e6-e279-487a-9005-c8126b418d97'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:15.264509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9f3db8b72d4e548db96b0c26023fe0', 'request_id': 'req-286a85e6-e279-487a-9005-c8126b418d97'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:15.314957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9f3db8b72d4e548db96b0c26023fe0', 'request_id': 'req-286a85e6-e279-487a-9005-c8126b418d97'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:15.350707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.351546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.351712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.367202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] The token cache is being invalidate because project 4e9f3db8b72d4e548db96b0c26023fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:25:15.367538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:15.376017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-286a85e6-e279-487a-9005-c8126b418d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:15.376017 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2424/4864] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:25:14 2022] DELETE /identity/v3/projects/4e9f3db8b72d4e548db96b0c26023fe0 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:15.387720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea59cb-a0b9-463b-9687-f46cb775df80 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.388002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea59cb-a0b9-463b-9687-f46cb775df80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.388274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea59cb-a0b9-463b-9687-f46cb775df80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.448882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:15.451144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:15.459473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c6ea59cb-a0b9-463b-9687-f46cb775df80 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:15.463050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c6ea59cb-a0b9-463b-9687-f46cb775df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:15.677930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2425/4865] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:15.689603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f12000-e056-401e-af02-141d4986046e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.689901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f12000-e056-401e-af02-141d4986046e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.690200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f12000-e056-401e-af02-141d4986046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.697257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2441/4866] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:15.702263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:15.705968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:15.743317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c1f12000-e056-401e-af02-141d4986046e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:15.744616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c1f12000-e056-401e-af02-141d4986046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:15.778150 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2426/4867] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:15.779102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f12000-e056-401e-af02-141d4986046e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:15.807513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f12000-e056-401e-af02-141d4986046e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:15.830187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:15.832337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.832621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.832933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.833772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:25:15.834088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:15.839147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:15.871401 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2427/4868] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:25:15.878215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:15.899793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:15.933063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533666-0052-4d5a-97b4-e910bf7b637a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:15.966985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:15.967879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:15.973527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:15.974042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:15.975734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:15.989036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.017488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bee77-297b-4022-aa77-07b5031423a2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:16.028389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:16.029870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.030624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.031368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:16.048400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:16.052519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.078250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2442/4869] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:25:16.168530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2428/4870] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:25:15 2022] POST /identity/v3/projects => generated 359 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:16.173517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:16.198957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7994-303c-4288-860f-e63bfb151ad6 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:16.396899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:16.450791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:16.451720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.452174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.452610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:16.453465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:16.455584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.504717 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2443/4871] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:25:16 2022] POST /identity/v3/users => generated 280 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:16.511013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:16.539926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea12bc9-9d72-4bfc-bb5a-e1696db037dc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:16.597319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:16.600234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.600548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.600838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:16.601552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:16.604741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.661309 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2429/4872] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:16.662834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:16.703299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526a5a6-4d47-4172-ae8c-6e25697767c2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:16.720287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:16.721124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.721579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.722161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:16.722940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:16.727552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17320e7-85c0-4eec-80b7-8a469c376d81 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.786309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:16.795741 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2444/4873] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:25:16.821415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec175b51-320e-43ee-8e0b-834b87ced356 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:16.841392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:16.843010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.843771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.852243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] PATH_INFO: `/v3/projects/d3a102e36f504c2ebf65829dff54c419/users/eac12244721941ca9fd94b79b323f153/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:16.896979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a102e36f504c2ebf65829dff54c419, user_id=eac12244721941ca9fd94b79b323f153, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:16.905494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:16.962144 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2430/4874] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:16 2022] PUT /identity/v3/projects/d3a102e36f504c2ebf65829dff54c419/users/eac12244721941ca9fd94b79b323f153/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:16.986183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7c27-11fe-4151-9bdf-3b58c2ba8103 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:16.986516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7c27-11fe-4151-9bdf-3b58c2ba8103 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:16.986717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a7c27-11fe-4151-9bdf-3b58c2ba8103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:17.079990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-936a7c27-11fe-4151-9bdf-3b58c2ba8103 None None] MFA Rules not processed for user `eac12244721941ca9fd94b79b323f153`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:17.083001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-936a7c27-11fe-4151-9bdf-3b58c2ba8103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:17.356312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2445/4875] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:17.404953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:17.406941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:17.541775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee43cf8-e7c2-4c10-bac5-27b9963d36e1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:17.554778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:17.557473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:17.558006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:17.559852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:17.583840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:17.586300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:17.628906 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2431/4876] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:19.909389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279b8c-6a5d-49ec-aff9-38c0b5cc3a6c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:19.910262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279b8c-6a5d-49ec-aff9-38c0b5cc3a6c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:19.910749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f279b8c-6a5d-49ec-aff9-38c0b5cc3a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:19.958673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8f279b8c-6a5d-49ec-aff9-38c0b5cc3a6c None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:19.960278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f279b8c-6a5d-49ec-aff9-38c0b5cc3a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:20.146747 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2446/4877] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:20.511526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:20.516299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:20.705238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5604ea-8daa-4bb1-af8f-32cd3e32e16e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:20.712814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:20.713717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:20.714300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:20.714689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] PATH_INFO: `/v3/users/af2f8147d8aa4fbfafc8a8fd322f06d5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:20.716052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2f8147d8aa4fbfafc8a8fd322f06d5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:20.718353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:20.803273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2f8147d8aa4fbfafc8a8fd322f06d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:20.804372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2f8147d8aa4fbfafc8a8fd322f06d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:20.815571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:20.821783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2f8147d8aa4fbfafc8a8fd322f06d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:20.823806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2f8147d8aa4fbfafc8a8fd322f06d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:20.847336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2f8147d8aa4fbfafc8a8fd322f06d5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:20.931890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2432/4878] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:25:20 2022] DELETE /identity/v3/users/af2f8147d8aa4fbfafc8a8fd322f06d5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:20.938735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:20.939618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:20.940036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:21.034537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:21.053413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:21.299050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:21.350950 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2447/4879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:21.397490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:21.400834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:21.558417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a3d5-8fad-4fac-87e2-309330e82f97 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:21.563070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:21.563699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:21.563970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:21.564235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:21.584405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:21.586219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1e25-5cb3-42d3-807d-68c87afcf507 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:21.618256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2433/4880] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:24.196209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:24.198003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:24.221039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a6d1-3f30-494e-bb14-e89933392afa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:24.232340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:24.233445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:24.234144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:24.234492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] PATH_INFO: `/v3/projects/6199b6b817e54eee8f9cc85292152fc4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:24.236467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6199b6b817e54eee8f9cc85292152fc4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:24.240682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:24.354840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6199b6b817e54eee8f9cc85292152fc4', 'request_id': 'req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:24.368864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6199b6b817e54eee8f9cc85292152fc4', 'request_id': 'req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:24.379252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6199b6b817e54eee8f9cc85292152fc4', 'request_id': 'req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:24.405658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] The token cache is being invalidate because project 6199b6b817e54eee8f9cc85292152fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:25:24.406369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:24.407445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32a1a5d1-bb2c-4eb0-8db3-9a94c00014ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:24.411121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2448/4881] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:25:24 2022] DELETE /identity/v3/projects/6199b6b817e54eee8f9cc85292152fc4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:24.416044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:24.416932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:24.417456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:24.474076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:24.477670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:24.613407 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2434/4882] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:25:24.625237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:24.625831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:24.626325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:24.660223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:24.664353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:24.686293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2449/4883] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:25:24.694081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:24.711953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197f34e-0986-4df4-9ee4-1e2cc7fb68c7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:24.717744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:24.718770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:24.719059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:24.719328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:24.720047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:25:24.720531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:24.724075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:24.762561 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2435/4884] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:25:24.768958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:24.785275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef3e2-26b8-4bfb-9d8e-476c229140b1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:24.796631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:24.802554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:24.803255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:24.803753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:24.805032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:24.811768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:24.885096 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2450/4885] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:25:24 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:24.885772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:24.904665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deff06b-08ac-4ecc-8e19-3af313c788a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:25.125053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:25.126319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:25.126802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:25.130135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:25.131305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:25.138633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:25.174915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:25.262313 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2436/4886] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:25:24 2022] POST /identity/v3/users => generated 299 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:25:25.267019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:25.313262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74981b2-5839-4e23-bf69-c115e1473c75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:25.340746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:25.340746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:25.340746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:25.340746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:25.341855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:25.347370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:25.407233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2451/4887] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:25:25.408634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:25.426978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfe4a-77df-4a04-a667-43a8998ca161 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:25.460347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:25.461705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:25.462202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:25.462672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:25.463948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:25.472381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db053e57-af53-49b6-a354-3362018b7d67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:25.515439 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2437/4888] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:25.522926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:25.539936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a200be-bb0c-4207-a9d6-45c1b7066b47 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:25.545050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:25.545741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:25.546012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:25.546269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] PATH_INFO: `/v3/projects/43eaa6a8a4c2474bb0682bbebce7ff49/users/ed8894f073b0473b9b47f997b78b3d30/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:25.584086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43eaa6a8a4c2474bb0682bbebce7ff49, user_id=ed8894f073b0473b9b47f997b78b3d30, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:25.592343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:25.651491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2452/4889] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:25 2022] PUT /identity/v3/projects/43eaa6a8a4c2474bb0682bbebce7ff49/users/ed8894f073b0473b9b47f997b78b3d30/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:25.654422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16096e-e899-4313-9e5e-acca0a32506b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:25.654922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16096e-e899-4313-9e5e-acca0a32506b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:25.655397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16096e-e899-4313-9e5e-acca0a32506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:25.749744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-be16096e-e899-4313-9e5e-acca0a32506b None None] MFA Rules not processed for user `ed8894f073b0473b9b47f997b78b3d30`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:25.753703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be16096e-e899-4313-9e5e-acca0a32506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:25.992671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2438/4890] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:26.016195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:26.018983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:26.140962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740734c6-ae4b-4a58-b719-6add56a7b115 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:26.149862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:26.150992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:26.151433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:26.152057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:26.165324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:26.168637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f24b0-ac2e-40c9-aa50-2a3e4444d837 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:26.184364 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2453/4891] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:27.815458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:27.816678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:27.817294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:27.873684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] MFA Rules not processed for user `509c1d87110a4122b3e7be91772ff2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:27.875971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:28.059476 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2439/4892] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:29.926204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:29.926798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:29.927191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:29.988552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] MFA Rules not processed for user `a51c470236904eb0a85bfee1703d3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:29.990246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:30.012467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:30.232277 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2454/4893] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:34.999107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:35.001829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:35.245206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547435-a61d-4616-bcfc-1befdfef38d8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:35.262485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:35.263596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:35.263876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:35.264452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:35.266502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:35.328077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:35.332260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:35.348969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:35.378364 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2440/4894] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:40.194130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=19 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:43.671953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:43.858264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06b23-0e40-4047-a493-ceeaa77a13b2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:43.864561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:43.865448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:43.865839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:43.866221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] PATH_INFO: `/v3/users/ed8894f073b0473b9b47f997b78b3d30` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:43.871124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8894f073b0473b9b47f997b78b3d30)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:43.876084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:44.034572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8894f073b0473b9b47f997b78b3d30'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:44.047035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8894f073b0473b9b47f997b78b3d30'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:44.047788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8894f073b0473b9b47f997b78b3d30'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:44.055248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:44.057017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:44.072611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8894f073b0473b9b47f997b78b3d30'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:44.073736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6e65e56e-02dd-41a6-afbf-b6e9d8c704b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8894f073b0473b9b47f997b78b3d30'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:44.126112 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2455/4895] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:25:43 2022] DELETE /identity/v3/users/ed8894f073b0473b9b47f997b78b3d30 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:44.127882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:44.128301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:44.128742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:44.182446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:44.188822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:44.238789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42441ec-8b88-44d7-ad68-9007e74fe432 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:44.368351 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2456/4896] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:44.489734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:44.493767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:44.494327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:44.495124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:44.517694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:44.520702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:44.529989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:44.551327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9748c-4319-4ffe-bd10-947d7352e0ce None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:44.557421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:44.559502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:44.560139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:44.562424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:44.586965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:44.589317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:44.613975 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2457/4897] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:25:44.718530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:44.720358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:44.736818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2441/4898] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:46.174047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:46.177576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:46.212265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671b5e8-d6ba-4c6b-b94a-fd3c2a1d8f2a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:46.221376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:46.222683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:46.223056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:46.223533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:46.227530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:46.257236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:46.266167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:46.275168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826861c7-71fc-413f-83dd-da19132ab6f2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:46.321507 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2458/4899] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:46.329526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:46.333207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:46.390164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79973a84-6b32-434d-a360-b8093e344bed service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:46.397019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:46.397843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:46.398214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:46.398532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] PATH_INFO: `/v3/projects/43eaa6a8a4c2474bb0682bbebce7ff49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:46.403235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43eaa6a8a4c2474bb0682bbebce7ff49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:46.411656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:46.552548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43eaa6a8a4c2474bb0682bbebce7ff49', 'request_id': 'req-074a9a70-4df8-46b4-86f2-7f237d53b636'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:46.556010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:46.569122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43eaa6a8a4c2474bb0682bbebce7ff49', 'request_id': 'req-074a9a70-4df8-46b4-86f2-7f237d53b636'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:46.585748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43eaa6a8a4c2474bb0682bbebce7ff49', 'request_id': 'req-074a9a70-4df8-46b4-86f2-7f237d53b636'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:46.614887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] The token cache is being invalidate because project 43eaa6a8a4c2474bb0682bbebce7ff49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:25:46.615211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:46.616514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-074a9a70-4df8-46b4-86f2-7f237d53b636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:25:46.625977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2442/4900] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:25:46 2022] DELETE /identity/v3/projects/43eaa6a8a4c2474bb0682bbebce7ff49 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:46.627700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:46.627987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:46.628261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:46.676766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:46.679136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:46.854996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2459/4901] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:25:46.859251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:46.859737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:46.860852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:46.906179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:46.910677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:46.959067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2443/4902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:46.965517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:46.979244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567bb92-e5cf-440f-9020-8e48dbb3692f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:46.986516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:46.987735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:46.988384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:46.989062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:46.989982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:25:46.990737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:46.992935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.023040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2460/4903] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:25:47.025132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.063567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde678a-e5d9-4d45-896a-f17bcb21ce55 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.073606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.074655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.075110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.075974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.077162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.079660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.122146 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2444/4904] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:25:47 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:25:47.123251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.138130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97199f-5355-43f4-994b-0caf9d4e5f75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.273132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.274002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.274136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.274417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.275001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.277163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.308878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2461/4905] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:25:47 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:25:47.311040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.322720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99f1a-4e13-4cee-83ab-61cb662c4a20 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.328672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.329064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.329521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.330015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.331461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.333974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.348333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2445/4906] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:25:47.362456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.379971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0ce-2b93-4a7a-9bbd-82054f4c2212 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.384915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.386658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.386658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.386658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.388276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.390375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6554f-6c2e-4044-80bb-24ea0287257b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.411688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2462/4907] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:25:47.418238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.458511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6f542-df58-42cf-a2a3-3050cdef2132 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.467190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.468156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.468624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.469164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] PATH_INFO: `/v3/projects/42d3c0e8672c4488b8762c9e522d7245/users/0674cdb0faa64406a58794e68d5e94a3/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.494644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d3c0e8672c4488b8762c9e522d7245, user_id=0674cdb0faa64406a58794e68d5e94a3, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.501706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.528814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2446/4908] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:25:47 2022] PUT /identity/v3/projects/42d3c0e8672c4488b8762c9e522d7245/users/0674cdb0faa64406a58794e68d5e94a3/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:25:47.536341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba4f-74d0-4e6c-873e-c57e034fec55 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.536929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba4f-74d0-4e6c-873e-c57e034fec55 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.537591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba4f-74d0-4e6c-873e-c57e034fec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.581475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c4b6ba4f-74d0-4e6c-873e-c57e034fec55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:47.584353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4b6ba4f-74d0-4e6c-873e-c57e034fec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:47.663988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:47.682357 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2463/4909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:47.708658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:25:47.711590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:47.831714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850d1fb-9403-4e69-91f4-da7d8cf73d45 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:25:47.836378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:25:47.837174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:47.837795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:47.838161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:47.850472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:25:47.852252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:25:47.877201 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2447/4910] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:25:48.398547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:25:48.399149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:25:48.399509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:25:48.439422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] MFA Rules not processed for user `9d2663d26c42412c8acb3ded09320213`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:25:48.442496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:25:48.584562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2464/4911] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:25:57.859057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=59 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:25:58.569353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:00.390920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:00.413048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1b1a-d885-4eb8-8d1f-35ff2d0490f8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:00.423747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:00.429192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:00.430005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:00.430722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:00.435584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:00.496550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:00.504210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78774-2833-49ea-addf-1af68589949d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:00.530767 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2448/4912] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:05.755311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:05.757919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:05.954737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25377a-25a3-4fca-8613-1834193e56bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:05.963396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:05.964352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:05.964867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:05.965359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:05.968281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:06.191769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:06.236571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:06.308157 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2465/4913] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:08.140023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:08.140023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:08.142726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:08.209499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] MFA Rules not processed for user `0674cdb0faa64406a58794e68d5e94a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:08.213570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:08.406250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:08.418566 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2449/4914] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:08.432267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07646-8c94-4317-8372-1dc70bc5f011 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:08.447993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:08.448628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:08.448904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:08.451395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:08.452126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:08.454815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:08.536849 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2466/4915] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:08 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:26:08.538737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:08.569473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027c9db-eb88-4511-85be-ab4da5865401 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:08.743611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:08.744271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:08.744546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:08.744810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:08.745669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:08.747492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:08.817139 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2450/4916] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:08 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:08.818297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:08.840597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf814514-85a6-41ee-9f8a-29131a074654 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:08.852976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:08.854090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:08.855054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:08.855454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:08.856242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:08.858308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:08.880184 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2467/4917] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:08.881892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:08.898175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77426-de12-4389-b10d-d3486fa8c868 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:08.911033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:08.911920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:08.912201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:08.912472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] PATH_INFO: `/v3/projects/9c6eb556a0b24a8784e7da3d3688e600/users/673efb39562d4fbf8b897c393b40ff3d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:08.966005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6eb556a0b24a8784e7da3d3688e600, user_id=673efb39562d4fbf8b897c393b40ff3d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:08.972394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:09.018275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2451/4918] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:08 2022] PUT /identity/v3/projects/9c6eb556a0b24a8784e7da3d3688e600/users/673efb39562d4fbf8b897c393b40ff3d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:26:09.020633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:09.033785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d18df-0b72-4223-91af-59971ba9ca8f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:09.147370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:09.148003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:09.148283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:09.148557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:09.149499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:09.151400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:09.158255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:09.177340 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2468/4919] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:09.182319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:09.211310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f768b93-1b5b-4809-855e-4f0e41fe2a5a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:09.235676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:09.236535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:09.242797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:09.243463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] PATH_INFO: `/v3/projects/9c6eb556a0b24a8784e7da3d3688e600/users/673efb39562d4fbf8b897c393b40ff3d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:09.256497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6eb556a0b24a8784e7da3d3688e600, user_id=673efb39562d4fbf8b897c393b40ff3d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:09.263738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa569e-ce76-4ee1-9ef5-c1c10c1399e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:09.295993 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2452/4920] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:09 2022] PUT /identity/v3/projects/9c6eb556a0b24a8784e7da3d3688e600/users/673efb39562d4fbf8b897c393b40ff3d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:19.280124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:23.537893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:23.774093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e424f-272d-491e-be03-dcaf013b10b6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:24.048491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:24.050859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:24.050859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:24.050859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:24.058385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:24.087236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:24.089684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877a615-407d-44db-ad90-19106b9f9b8a service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:24.123003 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2469/4921] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:29.875143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:29.875688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:29.876106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:29.921030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] MFA Rules not processed for user `ce708efbc05d40c7a2a04173d9871991`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:29.922372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:30.084470 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2453/4922] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:33.257973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:33.258835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:33.259291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:33.325965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] MFA Rules not processed for user `673efb39562d4fbf8b897c393b40ff3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:33.329479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:33.512120 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2470/4923] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:33.528287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:33.530183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:33.691948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8f51e-ef1d-477a-a839-7463e1758e19 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:33.706399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:33.707207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:33.707306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:33.707562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:33.896690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:33.901642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e1d03-a206-4e19-9b0c-b2272ba2ef46 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:33.927021 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2454/4924] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:34.675261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:34.678429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:34.708304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:34.878275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc22fc-fb2f-4fd0-936a-efdd5b614d8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:34.886124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:34.888031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:34.888031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:34.888395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] PATH_INFO: `/v3/users/5828d80933604cb883c69d914bcedc66` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:34.890094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5828d80933604cb883c69d914bcedc66)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:34.892942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:35.055167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5828d80933604cb883c69d914bcedc66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:35.090052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5828d80933604cb883c69d914bcedc66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:35.092237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5828d80933604cb883c69d914bcedc66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:35.130889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5828d80933604cb883c69d914bcedc66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:35.134973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5828d80933604cb883c69d914bcedc66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:35.179188 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2471/4925] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:34 2022] DELETE /identity/v3/users/5828d80933604cb883c69d914bcedc66 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:35.183884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:35.184406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:35.184498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:35.255434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:35.261335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:35.355081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:35.368159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2455/4926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:35.745805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:35.747206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:35.894342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22019-b772-4f2a-ab60-0d6e30c96b40 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:35.904181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:35.904845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:35.905201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:35.905482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:35.925686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:35.927173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:35.969988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2472/4927] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:37.775434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:37.777604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:37.805797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b21ef-8fc2-4a1a-965c-9b8c8d3b50ab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:37.832289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:37.833116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:37.833481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:37.833957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] PATH_INFO: `/v3/projects/50ca60d57685420a9e095da80d9efb28` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:37.837016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ca60d57685420a9e095da80d9efb28)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:37.850988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:37.989785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ca60d57685420a9e095da80d9efb28', 'request_id': 'req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.022196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ca60d57685420a9e095da80d9efb28', 'request_id': 'req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.040309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ca60d57685420a9e095da80d9efb28', 'request_id': 'req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.056525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] The token cache is being invalidate because project 50ca60d57685420a9e095da80d9efb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:38.067629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.069238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.077055 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2456/4928] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:37 2022] DELETE /identity/v3/projects/50ca60d57685420a9e095da80d9efb28 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:26:38.079139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:38.121210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb4b2-5dba-447b-960c-229769d69faf service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:38.227429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:38.304042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:38.305745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:38.306922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:38.307414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] PATH_INFO: `/v3/users/b8d056b486644a8b8826db76889efdee` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:38.311169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d056b486644a8b8826db76889efdee)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:38.315569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:38.430701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d056b486644a8b8826db76889efdee'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.466371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d056b486644a8b8826db76889efdee'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.470952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d056b486644a8b8826db76889efdee'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.548088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d056b486644a8b8826db76889efdee'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.550079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-23667f3d-0875-4d3d-b212-b2fd84f8a97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d056b486644a8b8826db76889efdee'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:38.624987 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2473/4929] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:38 2022] DELETE /identity/v3/users/b8d056b486644a8b8826db76889efdee => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:39.537786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:39.540608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:39.612403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d02f-ff3f-46ff-afb5-62d91f4ce1a3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:39.858365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:39.859104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:39.859365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:39.864063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] PATH_INFO: `/v3/projects/f610c30db0c54828aabe6718561e7671` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:39.865596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f610c30db0c54828aabe6718561e7671)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:39.878866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:40.020909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f610c30db0c54828aabe6718561e7671', 'request_id': 'req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:40.062002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f610c30db0c54828aabe6718561e7671', 'request_id': 'req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:40.075963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f610c30db0c54828aabe6718561e7671', 'request_id': 'req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:40.118394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] The token cache is being invalidate because project f610c30db0c54828aabe6718561e7671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:40.119842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:40.120953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc5b4bb8-3319-4a6f-9914-8e3b38aafe27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:40.123180 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2457/4930] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:39 2022] DELETE /identity/v3/projects/f610c30db0c54828aabe6718561e7671 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:40.128665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:40.129212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:40.129212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:40.168830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:40.171314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:40.395801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2474/4931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:40.409686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:40.410295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:40.410772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:40.455744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:40.459330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:40.494797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2458/4932] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:26:40.495656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:40.518410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca53255-a106-4a72-9b0c-f3ad23bc9bb8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:40.535840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:40.539465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:40.540413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:40.541005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:40.542636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:26:40.545516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:40.552615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:40.588047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2475/4933] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:26:40.594161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:40.624839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd618c6a-7463-49bd-8158-bc7af58ecc82 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:40.660253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:40.662127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:40.662999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:40.663815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:40.665901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:40.672598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:40.686996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:40.800006 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2459/4934] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:40 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:40.806595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:40.841661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355acd0e-6708-4aa1-9fdc-a73b0c37d769 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:40.960845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:41.030603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.031734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.032244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.032683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.034940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.038618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:41.094127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2476/4935] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:40 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:41.100544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:41.120445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b274-0297-4d98-b44d-db0f676a36ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:41.127091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.128310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.128669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.129174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.131065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.133784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:41.168598 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2460/4936] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:41.172675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:41.190922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39043e31-4ed7-42f6-ae5e-2378dea81371 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:41.201876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.209923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.210216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.213035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.225767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.227768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:41.256443 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2477/4937] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:26:41.258759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:41.301544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25279f-682b-4f20-ba92-c22beb451da7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:41.324643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.325428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.325714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.326033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] PATH_INFO: `/v3/projects/876e68d6d3f641f9b103cc174ed07649/users/743bd5af7df348f1984bf8df56c106eb/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.378779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] RBAC: Authorizing `identity:create_grant(project_id=876e68d6d3f641f9b103cc174ed07649, user_id=743bd5af7df348f1984bf8df56c106eb, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.381378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:41.383181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:41.393172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149d248-6fd8-42c0-8c52-b0b4fb53691d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:41.424706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2461/4938] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:41 2022] PUT /identity/v3/projects/876e68d6d3f641f9b103cc174ed07649/users/743bd5af7df348f1984bf8df56c106eb/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:41.444008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229da54-2660-47d6-bdc2-217313383eee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.444480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229da54-2660-47d6-bdc2-217313383eee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.444800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229da54-2660-47d6-bdc2-217313383eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.534348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0229da54-2660-47d6-bdc2-217313383eee None None] MFA Rules not processed for user `743bd5af7df348f1984bf8df56c106eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:41.543154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0229da54-2660-47d6-bdc2-217313383eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:41.597435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72f616-af68-4f7e-bb44-357dc6bdba6e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:41.754656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2462/4939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:41.761205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229da54-2660-47d6-bdc2-217313383eee None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:41.775388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.776726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.778567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.778567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.782335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:41.812294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.815469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:41.830038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2478/4940] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:41.924412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229da54-2660-47d6-bdc2-217313383eee None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:41.952047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:41.952914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:41.953337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:41.953857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:41.956413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:41.958497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.009959 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2463/4941] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:41 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:26:42.012186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.029057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e75fab-6b2f-4068-8435-a3f1bbd1d348 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:42.109268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:42.184306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:42.185398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.186259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.186425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.187249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:42.194427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.228838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2479/4942] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:42 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:42.230643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.256243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6242-4dc6-4f0c-8b05-041e6e550ef4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:42.266305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:42.268724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.269846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.270499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.273698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:42.278762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.306723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2464/4943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:26:42.308442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.325181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a82a40-90fd-459b-b2da-25b1a9673c18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:42.347297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:42.348747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.349879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.350528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] PATH_INFO: `/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c/users/cfa93c0d64064ecebab3a515085dbb9b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.385344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0128a4d5a54ec49c7151ddfa461e8c, user_id=cfa93c0d64064ecebab3a515085dbb9b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:42.390387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.424259 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2480/4944] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:42 2022] PUT /identity/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c/users/cfa93c0d64064ecebab3a515085dbb9b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:42.426650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.444572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b84fdd-61ac-48d8-b190-6c47ab6ed86d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:42.462618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:42.569476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:42.570805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.571870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.572630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.573727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:42.576586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae9738-cf1e-423d-9ecf-d0f2a308fe69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.599953 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2465/4945] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:42.605252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.623900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4743ed-1bf8-4cd1-8700-b541746c3f7c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:42.630360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:42.631642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.632485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.633945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] PATH_INFO: `/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c/users/cfa93c0d64064ecebab3a515085dbb9b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.652304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0128a4d5a54ec49c7151ddfa461e8c, user_id=cfa93c0d64064ecebab3a515085dbb9b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:42.664691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:42.698905 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2481/4946] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:42 2022] PUT /identity/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c/users/cfa93c0d64064ecebab3a515085dbb9b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:42.714786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:42.715504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:42.717033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:42.774847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] MFA Rules not processed for user `cfa93c0d64064ecebab3a515085dbb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:42.782168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:42.908810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2466/4947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:42.923144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:42.926672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:43.062805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171de349-87fd-4c0b-91f6-ed3636e2aa84 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:43.085465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:43.085465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:43.085465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:43.085465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:43.105511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:43.108341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847651c9-76c5-4426-8a2f-a69e386f7c14 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:43.126066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2482/4948] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:47.291564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:47.456369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3346d-03fc-48a9-8594-2aa520662c62 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:47.473502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:47.475439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:47.476039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:47.476508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] PATH_INFO: `/v3/users/743bd5af7df348f1984bf8df56c106eb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:47.478611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743bd5af7df348f1984bf8df56c106eb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:47.487128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:47.596314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:47.626325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743bd5af7df348f1984bf8df56c106eb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:47.629232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743bd5af7df348f1984bf8df56c106eb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:47.647544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743bd5af7df348f1984bf8df56c106eb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:47.650193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743bd5af7df348f1984bf8df56c106eb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:47.672853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743bd5af7df348f1984bf8df56c106eb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:47.727154 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2467/4949] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:47 2022] DELETE /identity/v3/users/743bd5af7df348f1984bf8df56c106eb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:47.731436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:47.731933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:47.732037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:47.772433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:47.779324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:48.021183 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2483/4950] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:26:48.075363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:48.077939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:48.167817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59c982-e782-4ed0-b047-caf26abffc84 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:48.172847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:48.174229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:48.174699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:48.175141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:48.186193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:48.188134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:48.203929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2468/4951] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:26:48.636848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:48.638788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:48.669678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42555b81-797d-45ed-b26f-8f61de35e602 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:48.698488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:48.699311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:48.699593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:48.699861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] PATH_INFO: `/v3/projects/876e68d6d3f641f9b103cc174ed07649` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:48.701933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=876e68d6d3f641f9b103cc174ed07649)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:48.705941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:48.778082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:48.815213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876e68d6d3f641f9b103cc174ed07649', 'request_id': 'req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:48.831305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876e68d6d3f641f9b103cc174ed07649', 'request_id': 'req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:48.844614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876e68d6d3f641f9b103cc174ed07649', 'request_id': 'req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:48.866362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] The token cache is being invalidate because project 876e68d6d3f641f9b103cc174ed07649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:48.867172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:48.868284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:48.873091 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2484/4952] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:48 2022] DELETE /identity/v3/projects/876e68d6d3f641f9b103cc174ed07649 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:48.877494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:48.893978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf8a2-24c4-4045-b94f-fae92fd21740 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:48.966453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:48.968911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:49.006844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:49.010677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:49.013061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:49.013683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] PATH_INFO: `/v3/users/cfa93c0d64064ecebab3a515085dbb9b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:49.015843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa93c0d64064ecebab3a515085dbb9b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:49.018912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:49.110489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa93c0d64064ecebab3a515085dbb9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:49.113138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa93c0d64064ecebab3a515085dbb9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:49.114002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedfe12-5dfa-4e7a-8d21-b34ecfa1bfb3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:49.128245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:49.129201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:49.129458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa93c0d64064ecebab3a515085dbb9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:49.130024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:49.130310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa93c0d64064ecebab3a515085dbb9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:49.130631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:49.134773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:49.134983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:49.145879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-11b5840a-0925-492f-a7ff-16e1cac225e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa93c0d64064ecebab3a515085dbb9b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:49.175729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:49.179340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:49.196087 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2485/4953] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:26:49.199440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2469/4954] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:48 2022] DELETE /identity/v3/users/cfa93c0d64064ecebab3a515085dbb9b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:26:49.677176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:49.680296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:49.697309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381b4ef-95c6-47f2-a3e6-d42e870ef9a7 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:49.871920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:49.872869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:49.872869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:49.873234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] PATH_INFO: `/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:49.874393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0128a4d5a54ec49c7151ddfa461e8c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:49.878360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.004627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0128a4d5a54ec49c7151ddfa461e8c', 'request_id': 'req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:50.006126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:50.026027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0128a4d5a54ec49c7151ddfa461e8c', 'request_id': 'req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:50.037889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0128a4d5a54ec49c7151ddfa461e8c', 'request_id': 'req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:50.060876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] The token cache is being invalidate because project 6d0128a4d5a54ec49c7151ddfa461e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:50.060876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:50.062469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-31bda8a9-5ba4-4215-9b95-1e417c6bfca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:50.068410 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2486/4955] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:49 2022] DELETE /identity/v3/projects/6d0128a4d5a54ec49c7151ddfa461e8c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:50.074354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.075639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.076098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.107295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:50.108911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:50.242521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2470/4956] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:50.249561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.249561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.250631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.294289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:50.295603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:50.318746 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2487/4957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:50.324231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.349519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e58d4-5cdd-44bf-b5a7-f1dded0d6e58 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.353183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.353827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.354187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.354457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.355131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:26:50.355422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:50.358013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.379433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2471/4958] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:26:50.380563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.391354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f87dc2-2bda-4cfc-a6bd-f050bf82706e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.401900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.402546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.402798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.403072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.404107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:50.407269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.472376 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2488/4959] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:50 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:50.477429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.498088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ced3ee-c258-417d-85b4-f95691d25520 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.644835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.649790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.650092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.650360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.651107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:50.655327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.735762 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2472/4960] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:50 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:50.742894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.763652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576aaed-f2c0-4c86-acea-a5a11873a07b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.772620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.773391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.773735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.774397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.776080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:50.778457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.813457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2489/4961] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:50.819712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.842460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f511-66be-443e-ad2d-44be89fc57fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.854357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.862485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.862787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.863066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:50.864275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:50.866321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6449cd7-e9b1-45b2-bef7-a7a369875d19 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:50.905827 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2473/4962] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:50.908685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:50.953740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32247fe-00f9-4cb5-9c0f-05ffdd9e3d43 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:50.988246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:50.989842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:50.990621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:50.991041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] PATH_INFO: `/v3/projects/9e822fd8436245dfb04c92c9f545fcf8/users/58be63a94690460ba6cad7341257a383/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:51.054332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e822fd8436245dfb04c92c9f545fcf8, user_id=58be63a94690460ba6cad7341257a383, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:51.071050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:51.123414 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2490/4963] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:50 2022] PUT /identity/v3/projects/9e822fd8436245dfb04c92c9f545fcf8/users/58be63a94690460ba6cad7341257a383/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:51.135485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:51.136083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:51.136630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:51.215590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] MFA Rules not processed for user `58be63a94690460ba6cad7341257a383`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:51.221460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:51.342868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:51.490415 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2474/4964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:51.503797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:51.508230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:51.696367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6031a2-1a38-4206-9c26-4ececddc84e9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:51.702843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:51.703901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:51.705260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:51.705795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:51.760630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:51.763065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3075a7-6b67-4b91-b5d0-5faf9b76f824 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:51.776964 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2491/4965] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:52.986963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:52.989105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:53.127705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e571-b88f-4c36-9c97-08541953cd63 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:53.137067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:53.138283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:53.138698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:53.139083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] PATH_INFO: `/v3/users/eac12244721941ca9fd94b79b323f153` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:53.140896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac12244721941ca9fd94b79b323f153)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:53.146186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:53.296691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac12244721941ca9fd94b79b323f153'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:53.298373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac12244721941ca9fd94b79b323f153'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:53.348563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac12244721941ca9fd94b79b323f153'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:53.351641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac12244721941ca9fd94b79b323f153'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:53.380075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac12244721941ca9fd94b79b323f153'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:53.443193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2475/4966] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:52 2022] DELETE /identity/v3/users/eac12244721941ca9fd94b79b323f153 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:53.449540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:53.450093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:53.450294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:53.510804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:53.512883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:53.666826 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2492/4967] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:53.687399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:53.691642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:53.866518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb01e9d-c6c3-43dc-806b-5c7918bbdd9c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:53.870466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:53.871089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:53.871370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:53.871639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:53.888494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:53.913972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:53.917073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:53.961121 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2476/4968] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:26:54.578757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:54.581667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:54.603388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a2bb4-3d93-4c25-a315-0812da6259ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:54.621357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:54.622253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:54.623004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:54.623764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] PATH_INFO: `/v3/users/509c1d87110a4122b3e7be91772ff2aa` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:54.625565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509c1d87110a4122b3e7be91772ff2aa)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:54.628554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:54.645865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:54.701509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509c1d87110a4122b3e7be91772ff2aa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:54.719425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509c1d87110a4122b3e7be91772ff2aa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:54.720813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509c1d87110a4122b3e7be91772ff2aa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:54.730884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509c1d87110a4122b3e7be91772ff2aa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:54.732261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509c1d87110a4122b3e7be91772ff2aa'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:54.762154 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2493/4969] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:54 2022] DELETE /identity/v3/users/509c1d87110a4122b3e7be91772ff2aa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:54.858799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:54.862356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:54.902137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182723-bb52-4785-84c3-9495b2d44a00 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:55.052684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:55.056350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.057256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.057573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] PATH_INFO: `/v3/projects/d3a102e36f504c2ebf65829dff54c419` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.059085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a102e36f504c2ebf65829dff54c419)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:55.061910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:55.221276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a102e36f504c2ebf65829dff54c419', 'request_id': 'req-ff705e4d-3b40-4b26-959e-c0524052b25a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.233051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a102e36f504c2ebf65829dff54c419', 'request_id': 'req-ff705e4d-3b40-4b26-959e-c0524052b25a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.239017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:55.243343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:55.245275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a102e36f504c2ebf65829dff54c419', 'request_id': 'req-ff705e4d-3b40-4b26-959e-c0524052b25a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.269674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca9ac-096f-4a7f-b487-0f7be2f28132 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:55.289833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] The token cache is being invalidate because project d3a102e36f504c2ebf65829dff54c419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:55.290141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.291982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff705e4d-3b40-4b26-959e-c0524052b25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.294102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2477/4970] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:54 2022] DELETE /identity/v3/projects/d3a102e36f504c2ebf65829dff54c419 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:55.300673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ff6d-93fd-4399-a2c5-445abed6165e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.300963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ff6d-93fd-4399-a2c5-445abed6165e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.301292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ff6d-93fd-4399-a2c5-445abed6165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.359143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4af5ff6d-93fd-4399-a2c5-445abed6165e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:55.365049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4af5ff6d-93fd-4399-a2c5-445abed6165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:55.438215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:55.444303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.444781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.446409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] PATH_INFO: `/v3/projects/f60dce1cd8eb41018541468ed4be516e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.456289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60dce1cd8eb41018541468ed4be516e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:55.462009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:55.572928 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2478/4971] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:55.582154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.582447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.582722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.628836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:55.630220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:55.649229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60dce1cd8eb41018541468ed4be516e', 'request_id': 'req-7019c6eb-5a71-43c3-8145-77b28460a159'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.660765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60dce1cd8eb41018541468ed4be516e', 'request_id': 'req-7019c6eb-5a71-43c3-8145-77b28460a159'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.676150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60dce1cd8eb41018541468ed4be516e', 'request_id': 'req-7019c6eb-5a71-43c3-8145-77b28460a159'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.679995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:55.701320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] The token cache is being invalidate because project f60dce1cd8eb41018541468ed4be516e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:26:55.702153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.703462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7019c6eb-5a71-43c3-8145-77b28460a159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:55.710292 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2494/4972] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:26:55 2022] DELETE /identity/v3/projects/f60dce1cd8eb41018541468ed4be516e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:26:55.722339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e0c0-7e15-4f10-9c01-52b246c757b6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.722624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e0c0-7e15-4f10-9c01-52b246c757b6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.729780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647e0c0-7e15-4f10-9c01-52b246c757b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.770886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d647e0c0-7e15-4f10-9c01-52b246c757b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:55.773665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d647e0c0-7e15-4f10-9c01-52b246c757b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:55.780305 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2479/4973] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:55.785654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:55.789988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2495/4974] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:55.800275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.800921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.801461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.812272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f676-66e5-49f2-bdbc-b26a2436a0bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:55.819597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:55.820240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.820559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.820767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.821752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:26:55.823501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:55.825139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:55.849208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2480/4975] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:26:55.853496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:55.867983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc191599-1cc9-4d90-92ce-756a02e5d99f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:55.874463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:55.875313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:55.875600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:55.875913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:55.877413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:55.878065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:55.879715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:55.881994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:55.902028 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2496/4976] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:26:55.908466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:55.932287 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2481/4977] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:55.932717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:55.937521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a529-a6d9-4999-bd81-289ff8a456d7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:55.964369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:56.044264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f062c2b-4b42-4eac-b77d-75379b75d5e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.061886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.062649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.062938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.063214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.063868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.069137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.079326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.079680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.079860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.080019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.080835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:26:56.081177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.083428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.108951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2482/4978] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:55 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:56.113411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.115121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2497/4979] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:26:56.116108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.129334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfb4af-dc54-42bb-8778-b82da06aceba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.135821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea188ec-b74e-496f-9fae-af58aaa76afc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.140530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.141185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.141528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.141807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.142251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.142465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.143320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.143834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.144378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.144503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.145181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.151788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.174660 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2498/4980] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:56.178126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.192798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cde73-84d9-44e1-8ded-e933994aa4d3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.202254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.203059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.203344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.203619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.204901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.207086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.210321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2483/4981] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:26:56 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:56.213491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.229314 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2499/4982] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:56.234002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.259764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bfc4e-c352-497f-8e9c-17ecf73670dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.325136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:56.330918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc859-224c-49bf-a329-ada9703d707a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.343703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.344385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.344693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.344965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.349967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.352246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.388489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.390246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.390619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.390976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] PATH_INFO: `/v3/projects/bf9810a0bd3a4147b7c90232609b0b88/users/312320732e6545ec92b6260c553efeff/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.405939 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2484/4983] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:26:56 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:26:56.419096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.451943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd372309-5b8f-4c11-8984-1d78568f731f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.457513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9810a0bd3a4147b7c90232609b0b88, user_id=312320732e6545ec92b6260c553efeff, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.465158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0569c07-3e6c-4914-80b9-a44477018da1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.486182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.487607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.493395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.493395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.493395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.493395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.515473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2485/4984] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:56.517022 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2500/4985] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:56 2022] PUT /identity/v3/projects/bf9810a0bd3a4147b7c90232609b0b88/users/312320732e6545ec92b6260c553efeff/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:26:56.522023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.536567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.539612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.540551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.543850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a05c-abce-4f78-8665-10fdd9018ebc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.608096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] MFA Rules not processed for user `312320732e6545ec92b6260c553efeff`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:56.609367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:56.650747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.651464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.651746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.652015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.652697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.654357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.672135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2486/4986] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:26:56.673889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.685719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:56.688478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6f5b8-3ea6-433f-846a-7cc18782ad9e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.694689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.695580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.695855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.696206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] PATH_INFO: `/v3/projects/4b2755737eb5470ea5e0d09a98f01587/users/5e938d41d3fb4f3e8c47b0c7e09230a8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.709016 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2501/4987] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:26:56.716939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2755737eb5470ea5e0d09a98f01587, user_id=5e938d41d3fb4f3e8c47b0c7e09230a8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:56.720228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa0a61-d6e0-450d-aa6d-1ba870088db7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:56.723623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.725716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:56.739495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2487/4988] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:26:56 2022] PUT /identity/v3/projects/4b2755737eb5470ea5e0d09a98f01587/users/5e938d41d3fb4f3e8c47b0c7e09230a8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:56.753049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.753459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.754554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.805695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] MFA Rules not processed for user `5e938d41d3fb4f3e8c47b0c7e09230a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:56.807064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:56.814975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f3b4-22fc-4298-b955-16a16e231961 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:56.947296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:56.947924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:56.948200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:56.948467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:56.949974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2488/4989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:26:56.972277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:56.973801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:57.069045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:57.081657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:57.083115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:57.103221 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2502/4990] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:57.135062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b059c89-b519-424a-a0d4-2b4119230d47 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:57.141124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:57.141894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:57.142212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:57.142568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:57.169305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:57.171202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a17b62-bac1-4410-91df-62e4aee208f0 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:57.185740 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2489/4991] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:26:59.198490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:59.304676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bfae-4ad2-4ded-97db-817a3b577169 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:59.310077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:59.310855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:59.311198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:59.311704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] PATH_INFO: `/v3/users/5e938d41d3fb4f3e8c47b0c7e09230a8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:59.314186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e938d41d3fb4f3e8c47b0c7e09230a8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:59.316544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:59.320428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:26:59.391936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e938d41d3fb4f3e8c47b0c7e09230a8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:59.401322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e938d41d3fb4f3e8c47b0c7e09230a8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:59.401993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e938d41d3fb4f3e8c47b0c7e09230a8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:59.412702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e938d41d3fb4f3e8c47b0c7e09230a8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:59.414107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e938d41d3fb4f3e8c47b0c7e09230a8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:26:59.437061 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2503/4992] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:26:59 2022] DELETE /identity/v3/users/5e938d41d3fb4f3e8c47b0c7e09230a8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:26:59.440622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:59.441573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:59.441847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:59.465116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:26:59.466636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:59.550405 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2490/4993] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:26:59.560008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:26:59.561721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:26:59.675586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0890-6eaf-4cc2-bcc6-949703b10ccc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:26:59.683308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:26:59.684268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:26:59.684773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:26:59.685223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:26:59.698099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:26:59.700430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0fb3e-5f4c-4370-af60-5852b619a5d8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:26:59.736274 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2504/4994] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:00.677084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:00.678936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:00.701695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4c47-cc2e-4daf-93f3-3c3cd2f4dbc2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:00.716564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:00.717241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:00.717696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:00.718132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] PATH_INFO: `/v3/projects/4b2755737eb5470ea5e0d09a98f01587` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:00.719909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2755737eb5470ea5e0d09a98f01587)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:00.723591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:00.861715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2755737eb5470ea5e0d09a98f01587', 'request_id': 'req-07af37e8-5af1-42eb-bbfc-5b5859243c93'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:00.874898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2755737eb5470ea5e0d09a98f01587', 'request_id': 'req-07af37e8-5af1-42eb-bbfc-5b5859243c93'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:00.887287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2755737eb5470ea5e0d09a98f01587', 'request_id': 'req-07af37e8-5af1-42eb-bbfc-5b5859243c93'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:00.904272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] The token cache is being invalidate because project 4b2755737eb5470ea5e0d09a98f01587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:00.904682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:00.905502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-07af37e8-5af1-42eb-bbfc-5b5859243c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:00.911207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2491/4995] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:00 2022] DELETE /identity/v3/projects/4b2755737eb5470ea5e0d09a98f01587 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:00.913403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:00.913403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:00.914031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:00.944184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:00.945839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:01.044632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2505/4996] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:01.052861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.053788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.054320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.115542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:01.118497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:01.143011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2492/4997] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:01.144031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.159347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01843692-5f6f-4de7-a07b-93c30cb65e22 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.166097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.166729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.167009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.167278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.167948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:01.168250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.169916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.187684 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2506/4998] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:01.189531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.200599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaea48-64d3-42dd-9023-3d8784e67715 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.206805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.207852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.208495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.209134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.210213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.212581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.267603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.269437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2493/4999] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:01 2022] POST /identity/v3/projects => generated 397 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:01.300349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14bae2-8406-4164-90e4-4ad1098d2ee8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.331028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:01.446948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.450276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.451719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.452105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.453532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.456685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.490457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2507/5000] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:01 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:01.491790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.521096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292e76-3c35-42b5-a68a-5b9634d3f061 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.526685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.527459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.527795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.528144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.528952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.531293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.551957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2494/5001] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:01.555642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.569194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3afee-4b00-4369-9947-7ddad8e3f495 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.578264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.580292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.580710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.581214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.584086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.587525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8738-9472-44be-abdb-2be44eb9c578 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.665165 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2508/5002] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:01.669897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:01.689208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3985d-4f33-4ec4-83cd-75fe8fb19604 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:01.709399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:01.712233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.714214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.714885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] PATH_INFO: `/v3/projects/413841261db046f688dfba9ce99b54df/users/73f81917919a413784988574f2006dcc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.720279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:01.768096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=413841261db046f688dfba9ce99b54df, user_id=73f81917919a413784988574f2006dcc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:01.776506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:01.805938 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2495/5003] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:01 2022] PUT /identity/v3/projects/413841261db046f688dfba9ce99b54df/users/73f81917919a413784988574f2006dcc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:01.818388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6295f-023c-41f4-b5f0-fe666820c95a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:01.818813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6295f-023c-41f4-b5f0-fe666820c95a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:01.820245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6295f-023c-41f4-b5f0-fe666820c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:01.892242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-17c6295f-023c-41f4-b5f0-fe666820c95a None None] MFA Rules not processed for user `73f81917919a413784988574f2006dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:01.894971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17c6295f-023c-41f4-b5f0-fe666820c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:02.040462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2509/5004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:02.054654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:02.056512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:02.203639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c663d-651e-46c6-a7ad-88be109ed95b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:02.215370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:02.216112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:02.216458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:02.216871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:02.227388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:02.230601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:02.268107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2496/5005] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:02.435131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803f4e-71f8-40fa-b6a8-200d10d2c97b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:02.435470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803f4e-71f8-40fa-b6a8-200d10d2c97b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:02.435746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803f4e-71f8-40fa-b6a8-200d10d2c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:02.486693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e803f4e-71f8-40fa-b6a8-200d10d2c97b None None] MFA Rules not processed for user `73f81917919a413784988574f2006dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:02.487018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e803f4e-71f8-40fa-b6a8-200d10d2c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:02.523786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2510/5006] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:03.457353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:03.652402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992467-1b23-47ee-af60-9e7249db40e7 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:03.660610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:03.661532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:03.661991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:03.662504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] PATH_INFO: `/v3/users/73f81917919a413784988574f2006dcc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:03.663932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f81917919a413784988574f2006dcc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:03.666156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:03.796306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f81917919a413784988574f2006dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:03.797940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f81917919a413784988574f2006dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:03.820700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f81917919a413784988574f2006dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:03.830637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f81917919a413784988574f2006dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:03.847039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f81917919a413784988574f2006dcc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:03.861498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:03.906380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2497/5007] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:03 2022] DELETE /identity/v3/users/73f81917919a413784988574f2006dcc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:03.911894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:03.912470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:03.912470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:03.971283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:03.976817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:04.158932 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2511/5008] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:04.175594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:04.178071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:04.315170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a504ca-27d3-4ab1-ab37-5291afb597e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:04.320547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:04.321703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:04.322888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:04.323437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:04.361086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:04.364151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de77dc-968a-4b28-8f11-a23311bf872c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:04.394888 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2498/5009] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:05.049763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:05.051264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:05.139128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:05.160008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c90dfe-431c-4019-94c5-2736b47a6a4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:05.183180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:05.184122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:05.185717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:05.187178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] PATH_INFO: `/v3/projects/413841261db046f688dfba9ce99b54df` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:05.192126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413841261db046f688dfba9ce99b54df)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:05.201061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:05.289531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413841261db046f688dfba9ce99b54df', 'request_id': 'req-8561ee03-356b-40ba-882a-c83243cd82d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:05.301018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413841261db046f688dfba9ce99b54df', 'request_id': 'req-8561ee03-356b-40ba-882a-c83243cd82d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:05.310055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413841261db046f688dfba9ce99b54df', 'request_id': 'req-8561ee03-356b-40ba-882a-c83243cd82d1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:05.332579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] The token cache is being invalidate because project 413841261db046f688dfba9ce99b54df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:05.333515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:05.334848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8561ee03-356b-40ba-882a-c83243cd82d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:05.337472 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2512/5010] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:05 2022] DELETE /identity/v3/projects/413841261db046f688dfba9ce99b54df => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:05.344716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:05.345610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:05.346055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:05.386446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:05.388009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:05.541087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2499/5011] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:05.549145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:05.550236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:05.550968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:05.624302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:05.629404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:05.668407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2513/5012] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:05.673452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:05.694777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483558d0-70b9-42a7-bd53-9056a57d56f6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:05.708213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:05.709467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:05.710490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:05.711992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:05.712956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:05.714594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:05.716339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:05.753177 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2500/5013] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:05.754649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:05.765275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea822-694b-48d8-826c-dfb96615a607 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:05.795091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:05.799467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:05.799999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:05.801592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:05.805243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:05.809675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:05.901125 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2514/5014] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:05.903109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:05.921180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344c904-d209-4536-b28d-8c8e362f2e6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:06.222207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:06.224963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:06.226743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:06.227250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:06.228935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:06.233012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:06.292386 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2501/5015] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:05 2022] POST /identity/v3/users => generated 293 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:06.297076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:06.325668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f8dbf-5482-40bb-b95c-1fafa0bbc471 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:06.340141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:06.340772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:06.341118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:06.341386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:06.343319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:06.346742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:06.377060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:06.387351 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2515/5016] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:06.390529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802104c5-ffb0-4358-b56c-dd0b70e21f44 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:06.405082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:06.405737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:06.406215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:06.406489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:06.410427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:06.412159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4a0ac-a752-463d-a506-d6c64d63233e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:06.415175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:06.447039 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2502/5017] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:06.452142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:06.471575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4e59-9239-470f-aa31-0c7bd04b6e61 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:06.495731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:06.496578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:06.497175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:06.499499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] PATH_INFO: `/v3/projects/9c6af1f8b7c04cbb9ac28658f20a36e2/users/5527f094f5ee4ada9aaae9885c272d7a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:06.535901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6af1f8b7c04cbb9ac28658f20a36e2, user_id=5527f094f5ee4ada9aaae9885c272d7a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:06.545739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:06.573201 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2516/5018] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:06 2022] PUT /identity/v3/projects/9c6af1f8b7c04cbb9ac28658f20a36e2/users/5527f094f5ee4ada9aaae9885c272d7a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:06.578214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:06.579249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:06.579945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:06.624708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:06.628095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:06.823331 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2503/5019] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:06.948047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:06.954736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:07.153269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8d587-4ecd-4e7b-914c-575af0a8de4d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:07.212617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:07.214902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:07.215427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:07.217561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:07.265740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:07.305271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:07.354063 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2517/5020] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:07.976380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:07.978792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:08.159653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6117ef9-a1b1-491d-a8d2-fbddd9c69eaf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:08.163021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:08.163874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:08.164213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:08.164494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:08.166682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:08.281025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:08.283926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:08.316311 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2504/5021] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:11.945716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:11.957116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925fa43-34e6-4600-a3cf-7986ad39f4d3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:11.971553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:11.972191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:11.972473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:11.972745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:11.983925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:12.030219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:12.036927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:12.061899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2518/5022] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:15.001484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:15.017352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878a088-e232-44f7-bcd6-8e16005a98d7 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:15.026316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:15.027400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:15.027400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:15.028313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:15.035772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:15.073289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:15.083353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488315-5a1e-4f41-97b6-30997f993a37 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:15.102270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2505/5023] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:16.225319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:16.228170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:16.238365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:16.246026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c54f-edbc-4e79-9320-dad460948bda service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:16.256758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:16.257712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:16.258149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:16.258616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] PATH_INFO: `/v3/users/58be63a94690460ba6cad7341257a383` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:16.261368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58be63a94690460ba6cad7341257a383)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:16.263495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:16.356303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58be63a94690460ba6cad7341257a383'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:16.366899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58be63a94690460ba6cad7341257a383'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:16.368028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58be63a94690460ba6cad7341257a383'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:16.378737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58be63a94690460ba6cad7341257a383'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:16.379853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58be63a94690460ba6cad7341257a383'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:16.408312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2519/5024] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:16 2022] DELETE /identity/v3/users/58be63a94690460ba6cad7341257a383 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:16.410046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:16.410540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:16.410683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:16.434261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:16.436450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:16.478025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:16.533721 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2506/5025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:16.628269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:16.629786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:16.772190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c969da2-ad4c-46d3-a568-9ecc9eda7b88 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:16.776088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:16.776719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:16.777035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:16.777298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:16.801593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:16.803050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced1eac-65c3-4ef8-87ae-84be87c472d7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:16.821515 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2520/5026] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:17.731610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:17.741747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:17.771825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbab570-b1f0-4e7c-a257-e3a20b0c638b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:17.784368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:17.785901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:17.786384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:17.786844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] PATH_INFO: `/v3/projects/9e822fd8436245dfb04c92c9f545fcf8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:17.788263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e822fd8436245dfb04c92c9f545fcf8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:17.790460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:17.974275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e822fd8436245dfb04c92c9f545fcf8', 'request_id': 'req-5b12b709-872e-458e-b4d4-f307696d1604'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:17.990457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e822fd8436245dfb04c92c9f545fcf8', 'request_id': 'req-5b12b709-872e-458e-b4d4-f307696d1604'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:18.023643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e822fd8436245dfb04c92c9f545fcf8', 'request_id': 'req-5b12b709-872e-458e-b4d4-f307696d1604'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:18.056894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] The token cache is being invalidate because project 9e822fd8436245dfb04c92c9f545fcf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:18.057413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:18.059378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b12b709-872e-458e-b4d4-f307696d1604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:18.065119 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2507/5027] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:17 2022] DELETE /identity/v3/projects/9e822fd8436245dfb04c92c9f545fcf8 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:18.071531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.072089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.072089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.125721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:18.127417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:18.256972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2521/5028] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:18.268519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3210a-bf5c-4988-9051-270751503801 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.269505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3210a-bf5c-4988-9051-270751503801 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.269797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3210a-bf5c-4988-9051-270751503801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.326012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-42b3210a-bf5c-4988-9051-270751503801 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:18.327658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42b3210a-bf5c-4988-9051-270751503801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:18.343359 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2508/5029] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:18.347906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.367689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cedd7-06a7-4ddc-b8bf-4d9fe2785994 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.390953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.391942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.392248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.392493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.393241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:18.393766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.402151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.419366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2522/5030] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:18.420512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3210a-bf5c-4988-9051-270751503801 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.431984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3210a-bf5c-4988-9051-270751503801 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.438333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.439518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.439518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.439772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.440906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.443133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.490574 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2509/5031] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:27:18.492114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.503893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcffaa-a282-458d-9dd0-3ad5401f8209 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.509364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:18.618327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.618962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.619655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.619932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.620590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.624397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.664020 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2523/5032] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:18 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:18.668808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.692424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95607d-17aa-4585-bf72-1ed0ff57a401 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.709590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.710581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.710581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.711083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.712595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.715404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.729418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2510/5033] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:18.733138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.751413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711331ee-c80e-4e03-92cc-6061f9efd23a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.775410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.777468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.777824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.778165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.783443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.785260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376498f-0e57-4dce-98b9-3ec449a48700 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.809443 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2524/5034] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:27:18.814500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:18.844561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dcd2-a897-4f4e-a5d3-29966eb2a852 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:18.853159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:18.854755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.855840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.856281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] PATH_INFO: `/v3/projects/acace77360a1449ba5d2b70781d10d31/users/f8753f321800422197df888d70579037/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.893038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acace77360a1449ba5d2b70781d10d31, user_id=f8753f321800422197df888d70579037, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:18.898834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:18.928943 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2511/5035] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:18 2022] PUT /identity/v3/projects/acace77360a1449ba5d2b70781d10d31/users/f8753f321800422197df888d70579037/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:18.940731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:18.941284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:18.944722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:18.986467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] MFA Rules not processed for user `f8753f321800422197df888d70579037`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:18.987881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:19.148398 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2525/5036] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:19.183568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:19.186398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:19.335007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c39c2-5af3-4d42-836c-03d18cacca5e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:19.347554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:19.348186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:19.348462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:19.348726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:19.370248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:19.371780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:19.391327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:19.397897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2512/5037] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:20.016628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:20.018313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:20.190265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3eb6-ac3b-4c03-a0cc-9700d7ded3a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:20.207184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:20.207835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:20.211495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:20.211811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:20.217238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:20.262724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:20.454999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:20.456824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0b28-bd28-45a4-930a-987a6e61bb00 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:20.479495 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2526/5038] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:21.929616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:22.073948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e25083-7526-4ff4-b504-b8d241405dec service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:22.102104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:22.102705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:22.102984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:22.103259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] PATH_INFO: `/v3/users/f8753f321800422197df888d70579037` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:22.111837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8753f321800422197df888d70579037)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:22.114061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:22.225872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8753f321800422197df888d70579037'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:22.226566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8753f321800422197df888d70579037'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:22.240140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8753f321800422197df888d70579037'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:22.241769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8753f321800422197df888d70579037'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:22.260141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8753f321800422197df888d70579037'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:22.309666 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2513/5039] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:21 2022] DELETE /identity/v3/users/f8753f321800422197df888d70579037 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:22.314396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:22.314940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:22.314940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:22.357847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:22.359117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:22.514345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2527/5040] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:22.535181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:22.537339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:22.695777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f99f5-007a-4eeb-aac9-4fab6576be1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:22.707459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:22.708087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:22.708362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:22.708627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:22.732411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:22.733866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488d460-79f1-41f1-8234-d593894bc319 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:22.765153 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2514/5041] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:23.875341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:23.877648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:23.908501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1940a1e-37cb-4942-abdb-2dbfce467973 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:23.928790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:23.929817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:23.957231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:23.958767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] PATH_INFO: `/v3/projects/acace77360a1449ba5d2b70781d10d31` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:23.967962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acace77360a1449ba5d2b70781d10d31)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:23.971137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:24.204815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acace77360a1449ba5d2b70781d10d31', 'request_id': 'req-5879d676-df05-447c-aad1-e2cad01e3a75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:24.224945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acace77360a1449ba5d2b70781d10d31', 'request_id': 'req-5879d676-df05-447c-aad1-e2cad01e3a75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:24.243135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acace77360a1449ba5d2b70781d10d31', 'request_id': 'req-5879d676-df05-447c-aad1-e2cad01e3a75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:24.287658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] The token cache is being invalidate because project acace77360a1449ba5d2b70781d10d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:24.287658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:24.292823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5879d676-df05-447c-aad1-e2cad01e3a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:24.301144 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2528/5042] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:23 2022] DELETE /identity/v3/projects/acace77360a1449ba5d2b70781d10d31 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:24.310362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:24.311808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:24.313426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:24.399588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:24.403654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:24.545851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:24.804422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2515/5043] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:24.806268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:24.806559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:24.806841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:24.908703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:24.915060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:24.960617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2529/5044] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:24.963988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.002528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d80f-5049-4d57-9280-0ff5ff4dcb9b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.020341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.024619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.025502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.028225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.029884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:25.033467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.075203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.132764 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2516/5045] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:25.134582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.167412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d49e61-0da5-49fd-8906-95fa9e39968f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.179657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.181188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.181777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.182410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.183875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.187134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.255979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2530/5046] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:25 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:25.257814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.270684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c062c-fb8b-43df-a299-b6a64a30756e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.422731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.424683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.425012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.425286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.425947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.436674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.494104 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2517/5047] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:25 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:25.495911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.523831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0544abf-0904-41a1-9acc-3595f018781f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.530453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.531820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.532194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.532553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.533402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.536083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.543104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:25.557061 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2531/5048] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:25.560236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.580369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c741-2f11-497d-a941-a4fb2bcd62d4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.592939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.596620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.597059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.598364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.599256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.601770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96830001-de96-4f7e-a665-348f02b92e93 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.631644 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2518/5049] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:25.633033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:25.647122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304784-2de6-4b59-8220-944b83b67062 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:25.654724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:25.655602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.656171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.669943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] PATH_INFO: `/v3/projects/31c93324cf86424988ec5f5784edc66e/users/9a28381538984467b6aaa5e4bad8d21a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.736962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c93324cf86424988ec5f5784edc66e, user_id=9a28381538984467b6aaa5e4bad8d21a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:25.739785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:25.779008 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2532/5050] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:25 2022] PUT /identity/v3/projects/31c93324cf86424988ec5f5784edc66e/users/9a28381538984467b6aaa5e4bad8d21a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:25.791563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dbf5-ebbd-4a80-abdd-38e7a24c2ebc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:25.791905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dbf5-ebbd-4a80-abdd-38e7a24c2ebc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:25.792142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dbf5-ebbd-4a80-abdd-38e7a24c2ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:25.845884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-60b0dbf5-ebbd-4a80-abdd-38e7a24c2ebc None None] MFA Rules not processed for user `9a28381538984467b6aaa5e4bad8d21a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:25.847128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60b0dbf5-ebbd-4a80-abdd-38e7a24c2ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:25.983586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2519/5051] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:26.186305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:26.189563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:26.390104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc408f5-71e8-4017-a32a-9777e0d1d6d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:26.400303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:26.406682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:26.407259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:26.407693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:26.430934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:26.432692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d8d2-af0f-413d-b1fb-9cfb95e7387f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:26.460407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2533/5052] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:27.320225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:27.321707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:27.322280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:27.407063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] MFA Rules not processed for user `08b0514cd6004596969d5d5caf689179`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:27.408657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:27.486786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:27.619861 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2520/5053] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:28.644016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:28.645376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:28.645837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:28.699689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] MFA Rules not processed for user `5527f094f5ee4ada9aaae9885c272d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:28.702154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:28.820362 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2534/5054] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:28.835646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:28.837808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:29.032675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bd2b4-0b8e-49dd-82e0-7bce787bde42 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:29.045934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:29.048090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:29.049451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:29.050195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:29.062074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:29.065353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:29.079143 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2521/5055] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:29.184153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:29.185867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:29.328318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fc28e-4a41-4c09-b440-e1cc18bdbe7e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:29.338759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:29.339423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:29.339698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:29.339967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] PATH_INFO: `/v3/users/ce708efbc05d40c7a2a04173d9871991` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:29.345817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce708efbc05d40c7a2a04173d9871991)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:29.347855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:29.379139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:29.471194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce708efbc05d40c7a2a04173d9871991'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:29.500619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce708efbc05d40c7a2a04173d9871991'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:29.501899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce708efbc05d40c7a2a04173d9871991'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:29.518640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce708efbc05d40c7a2a04173d9871991'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:29.519724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce708efbc05d40c7a2a04173d9871991'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:29.573836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2535/5056] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:29 2022] DELETE /identity/v3/users/ce708efbc05d40c7a2a04173d9871991 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:30.682756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:30.713280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf30216-f619-42e6-9df3-a1de7efaa9bf service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:30.979059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:30.982416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:31.069570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:31.075858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.081014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.083122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] PATH_INFO: `/v3/projects/4eeba274a6f342c1984385aa9a7fd804` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.088944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eeba274a6f342c1984385aa9a7fd804)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:31.100720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:31.239319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:31.255003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eeba274a6f342c1984385aa9a7fd804', 'request_id': 'req-d092c750-ed95-4033-aaa9-c3ec52d52923'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:31.270759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eeba274a6f342c1984385aa9a7fd804', 'request_id': 'req-d092c750-ed95-4033-aaa9-c3ec52d52923'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:31.281606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25acda-87f9-43d6-b4c7-8987df1707f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:31.289333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eeba274a6f342c1984385aa9a7fd804', 'request_id': 'req-d092c750-ed95-4033-aaa9-c3ec52d52923'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:31.307447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] The token cache is being invalidate because project 4eeba274a6f342c1984385aa9a7fd804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:31.307941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:31.308904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d092c750-ed95-4033-aaa9-c3ec52d52923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:31.310931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2522/5057] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:30 2022] DELETE /identity/v3/projects/4eeba274a6f342c1984385aa9a7fd804 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:31.317208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.317580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.318097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.340812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:31.342158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:31.429638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:31.430267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.430573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.430858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.432672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:31.464835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:31.473745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f0e1-1702-4df7-b8fe-dd933ebf9820 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:31.549062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2536/5058] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:27:31.588495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2523/5059] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:31.592945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.593650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.594260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.698623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:31.710162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:31.732632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2537/5060] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:31.738503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:31.766197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716c3e7-afe2-4d05-a29c-d9521f5d7439 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:31.814309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:31.815000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.815274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.816279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.816970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:31.817308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:31.819357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:31.859941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2524/5061] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:27:31.862110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:31.888768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9a959-df46-4d33-aba9-870eff457c28 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:31.924982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:31.927012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:31.931637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:31.932680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:31.935316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:31.937335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:31.996362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:32.067991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2538/5062] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:32.073201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:32.100143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c665-45a6-4d43-b917-862c712bb797 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:32.265922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:32.266555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:32.266830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:32.267101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:32.267724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:32.269685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:32.326719 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2525/5063] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:32 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:32.331801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:32.352976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b3c18-a21e-4b57-a000-b903d6e1248d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:32.376173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:32.378991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:32.379485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:32.379955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:32.386855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:32.401809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:32.459529 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2539/5064] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:27:32.464334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:32.519425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba921d72-e67b-4de2-950e-0301099758e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:32.561497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:32.565979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:32.566485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:32.566967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:32.568168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:32.571299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93467e1-cf7a-4f2d-89d0-633d07905f62 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:32.636427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:32.637218 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2526/5065] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:32.670467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf7e-2894-4225-909a-009333769141 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:32.690862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:32.692224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:32.692709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:32.695817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] PATH_INFO: `/v3/projects/d11b952197c4461badbca0712357944b/users/83c668dcae65428e99d6dab21f00fe88/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:32.771025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11b952197c4461badbca0712357944b, user_id=83c668dcae65428e99d6dab21f00fe88, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:32.791707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:32.848822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2540/5066] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:32 2022] PUT /identity/v3/projects/d11b952197c4461badbca0712357944b/users/83c668dcae65428e99d6dab21f00fe88/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:32.856417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:32.857587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:32.858064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:32.929877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:32.932065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:33.145744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:33.346214 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2527/5067] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:33.363582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:33.367586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:33.739966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c988565-9a5e-45ab-aeec-de4c4c9ed841 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:33.756207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:33.759487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:33.760067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:33.760532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:33.805995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:33.808714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2e79-e037-4b3b-9cba-6e31bfffbe7c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:33.895740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2541/5068] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:35.053315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:35.061476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:35.089970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444631a-fcf9-4967-9192-e59eba6e43f4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:35.106516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:35.107502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:35.107781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:35.108049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] PATH_INFO: `/v3/users/312320732e6545ec92b6260c553efeff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:35.111928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312320732e6545ec92b6260c553efeff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:35.113977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:35.209767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312320732e6545ec92b6260c553efeff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:35.211722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312320732e6545ec92b6260c553efeff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:35.235001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312320732e6545ec92b6260c553efeff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:35.246112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312320732e6545ec92b6260c553efeff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:35.297965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a94c7ed-6f65-45d2-a648-1523dd9e4784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312320732e6545ec92b6260c553efeff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:35.398641 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2528/5069] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:35 2022] DELETE /identity/v3/users/312320732e6545ec92b6260c553efeff => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:35.403168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:35.404047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:35.404495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:35.444860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:35.450022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:35.494878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:35.495264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:35.495672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:35.523227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] MFA Rules not processed for user `5527f094f5ee4ada9aaae9885c272d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:35.524781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:35.638822 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2542/5070] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:35.670159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:35.681034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:35.727660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2529/5071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:35.852146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e94e18-ab4e-474d-a66b-6b4b502a98b3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:35.863184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:35.863826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:35.864106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:35.864368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:35.885919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:35.895016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423703-8526-4f67-a07c-5c56dc5326cd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:35.927763 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2543/5072] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:27:38.319122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:38.321705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.354975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16903-7ee7-4551-855b-d620f1e76d78 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:38.368651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:38.369676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.370382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.371617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] PATH_INFO: `/v3/projects/bf9810a0bd3a4147b7c90232609b0b88` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.373085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9810a0bd3a4147b7c90232609b0b88)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:38.376809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:38.526799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:38.532373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9810a0bd3a4147b7c90232609b0b88', 'request_id': 'req-91c7c63b-7466-463d-bc3d-93034ab45542'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:38.553834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9810a0bd3a4147b7c90232609b0b88', 'request_id': 'req-91c7c63b-7466-463d-bc3d-93034ab45542'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:38.574020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9810a0bd3a4147b7c90232609b0b88', 'request_id': 'req-91c7c63b-7466-463d-bc3d-93034ab45542'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:38.574269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf890a0-73d1-49f1-a45b-875d1aac94e2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.574736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf890a0-73d1-49f1-a45b-875d1aac94e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.574736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf890a0-73d1-49f1-a45b-875d1aac94e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.590057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:38.596427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] The token cache is being invalidate because project bf9810a0bd3a4147b7c90232609b0b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:38.596909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:38.598425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-91c7c63b-7466-463d-bc3d-93034ab45542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:38.604626 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2530/5073] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:38 2022] DELETE /identity/v3/projects/bf9810a0bd3a4147b7c90232609b0b88 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:38.606211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eaed-b131-445e-be36-dcef8d5fcff1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.606561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eaed-b131-445e-be36-dcef8d5fcff1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.606846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eaed-b131-445e-be36-dcef8d5fcff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.638401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e142eaed-b131-445e-be36-dcef8d5fcff1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:38.640959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e142eaed-b131-445e-be36-dcef8d5fcff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.658858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3bf890a0-73d1-49f1-a45b-875d1aac94e2 None None] MFA Rules not processed for user `83c668dcae65428e99d6dab21f00fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:38.660115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3bf890a0-73d1-49f1-a45b-875d1aac94e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.833146 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2544/5074] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:38.844406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7448-6892-49fb-b028-3b726a33044f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.844406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7448-6892-49fb-b028-3b726a33044f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.844620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c7448-6892-49fb-b028-3b726a33044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.879541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ce9c7448-6892-49fb-b028-3b726a33044f None None] MFA Rules not processed for user `83c668dcae65428e99d6dab21f00fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:38.881041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ce9c7448-6892-49fb-b028-3b726a33044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.898196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2531/5075] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:38.911784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2545/5076] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:38.912916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.913236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.913382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:38.913506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.913677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:38.913954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:38.953880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:38.954573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] MFA Rules not processed for user `83c668dcae65428e99d6dab21f00fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:38.955840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.959385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:38.982263 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2546/5077] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:38.992606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:38.994762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:39.001126 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2532/5078] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:39.008518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.025747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1dde-4e51-4b9d-955d-d5107fccda73 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.034699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.035338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.035615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.035887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.036786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:39.037924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.040224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.070239 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2533/5079] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:39.071255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.133295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784d6f6-ba7e-4336-bac8-f80c7f1829dd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.152391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.153635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.154210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.154612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.157085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.159567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.254424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749fd4-91ff-4662-b23c-effe69af1e78 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.267199 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2534/5080] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:39 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:39.269581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.434284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.435092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.435486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.435878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.463718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:39.475595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20528-68be-4c85-bc5d-2726147ba0a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.489051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.489686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.489961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.490227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.490870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.492841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.542913 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2535/5081] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:39 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:39.548876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.573771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fde88-8e89-4ae6-8822-e46f1942aca2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.576736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.579107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.589549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.590182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.590457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.590728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.592147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.595354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.609784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2547/5082] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:27:39.620412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2536/5083] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:39.622696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.676350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d4bdb-5647-4d35-bc96-1f4819584de1 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.695295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.700086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.701357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.702326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.706021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.710137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcfae3-4060-4006-8cb5-cfdbea86f889 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.744675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2548/5084] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:39.745550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:39.767135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfcfa3-6ae0-46b4-a17e-258a70a5fa10 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:39.787807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:39.788648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.792518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.792939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] PATH_INFO: `/v3/projects/1e6461ac2f584040b8d3af779763be1f/users/d12da9588161461d9bb239bc17f4189f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:39.843337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:39.854579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6461ac2f584040b8d3af779763be1f, user_id=d12da9588161461d9bb239bc17f4189f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:39.864557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:39.899796 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2537/5085] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:39 2022] PUT /identity/v3/projects/1e6461ac2f584040b8d3af779763be1f/users/d12da9588161461d9bb239bc17f4189f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:39.913029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:39.913317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:39.913624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:40.060575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] MFA Rules not processed for user `d12da9588161461d9bb239bc17f4189f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:40.066047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:40.438644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2549/5086] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:40.476264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:40.478213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:40.671418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05633-e5a5-481e-9e8d-574208de9ad3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:40.687536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:40.689375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:40.690573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:40.691996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:40.745818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:40.750790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:40.799449 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2538/5087] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:40.987735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:41.008175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38bf9d-53de-43ad-977d-cf6979728292 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:41.022058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:41.026089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:41.027037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:41.028470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:41.032174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:41.072213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:41.073738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676c8d1-c193-457c-9c1a-5092a4aad172 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:41.113062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2550/5088] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:41.944302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:42.070120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820a0d3-6d8e-46c7-b2f3-5b4dfaad6e96 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:42.081948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:42.083041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:42.083717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:42.084220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] PATH_INFO: `/v3/users/d12da9588161461d9bb239bc17f4189f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:42.087691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12da9588161461d9bb239bc17f4189f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:42.093758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:42.166008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:42.166904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:42.167415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:42.190283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12da9588161461d9bb239bc17f4189f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:42.191263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12da9588161461d9bb239bc17f4189f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:42.206495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12da9588161461d9bb239bc17f4189f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:42.207535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12da9588161461d9bb239bc17f4189f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:42.236740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6841ef8a-3d0a-481a-ab7a-5cbca8329478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12da9588161461d9bb239bc17f4189f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:42.246563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] MFA Rules not processed for user `83c668dcae65428e99d6dab21f00fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:42.250712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:42.279808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2539/5089] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:41 2022] DELETE /identity/v3/users/d12da9588161461d9bb239bc17f4189f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:42.282003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:42.282321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:42.282678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:42.323314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:42.325384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:42.336783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:42.472443 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2551/5090] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:42.504024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2540/5091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:27:42.514314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:42.520084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:42.538343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28484e-9d37-4d77-a65e-f878a767da1f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:42.607854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:42.711252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:42.711935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:42.712221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:42.712489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:42.742334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:42.743801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81d45b-b8fb-4c29-a3bf-adbe560583d4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:42.779233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2552/5092] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:44.203263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:44.205923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:44.227529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f026e-f501-4617-bd38-69dc4f873fc2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:44.240368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:44.241382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:44.241994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:44.243588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] PATH_INFO: `/v3/projects/1e6461ac2f584040b8d3af779763be1f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:44.247725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6461ac2f584040b8d3af779763be1f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:44.251754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:44.461541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6461ac2f584040b8d3af779763be1f', 'request_id': 'req-1910a588-677b-4abe-bd70-6f6a11736765'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:44.480626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6461ac2f584040b8d3af779763be1f', 'request_id': 'req-1910a588-677b-4abe-bd70-6f6a11736765'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:44.495959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6461ac2f584040b8d3af779763be1f', 'request_id': 'req-1910a588-677b-4abe-bd70-6f6a11736765'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:44.509994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] The token cache is being invalidate because project 1e6461ac2f584040b8d3af779763be1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:44.510631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:44.511771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1910a588-677b-4abe-bd70-6f6a11736765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:44.514091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2541/5093] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:44 2022] DELETE /identity/v3/projects/1e6461ac2f584040b8d3af779763be1f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:44.520007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bb0f-d8ee-41ca-aef1-77ce9f84456b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:44.520558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bb0f-d8ee-41ca-aef1-77ce9f84456b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:44.520558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bb0f-d8ee-41ca-aef1-77ce9f84456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:44.581771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-09a9bb0f-d8ee-41ca-aef1-77ce9f84456b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:44.587674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-09a9bb0f-d8ee-41ca-aef1-77ce9f84456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:44.627132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:44.627559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:44.627937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:44.725465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] MFA Rules not processed for user `83c668dcae65428e99d6dab21f00fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:44.757628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:44.914970 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2553/5094] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:44.920412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:44.920698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:44.923113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:44.989425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2542/5095] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:45.033587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:45.037950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:45.091629 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2554/5096] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:45.102411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.133201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5b6c-30f6-47a3-8a55-e463fc521bcd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.155894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.159629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.165541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.165949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:45.168674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:27:45.169425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:45.176148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:45.235370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2543/5097] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:27:45.235977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.248879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e1895-4806-4731-b87c-c2595a8157ea None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.274126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.274773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.275049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.275325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:45.278315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:45.282517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:45.367387 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2555/5098] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:27:45 2022] POST /identity/v3/projects => generated 351 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:45.371670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.386532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea6447-db51-4701-90c2-b828d8e4d761 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.479473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:45.611911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.613969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.614252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.614527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:45.615367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:45.618689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:45.690971 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2544/5099] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:27:45 2022] POST /identity/v3/users => generated 276 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:27:45.694985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.711755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e7f99-5e17-4eff-9c06-35cdeede2c84 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.731260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.731891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.732165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.732432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:45.733107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:45.736240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:45.805917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.814339 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2556/5100] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:27:45.826455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63289-2e65-45f9-9f03-324396d9aaef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.841615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.844304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.844615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.845433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:45.848819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:45.853599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f40af-0a7c-467d-beb3-71cdd5332370 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:45.897461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:45.902728 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2545/5101] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:27:45.919664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafa7a1-7045-4cad-b4cb-397f4c395a7a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:45.946982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:45.959743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:45.960118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:45.960397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] PATH_INFO: `/v3/projects/81009f9a7ca14bf3999330b4b3fc10c2/users/1824baa8213547b29faa5d916b4e8b1c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:46.007311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81009f9a7ca14bf3999330b4b3fc10c2, user_id=1824baa8213547b29faa5d916b4e8b1c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:46.013339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:46.055617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2557/5102] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:27:45 2022] PUT /identity/v3/projects/81009f9a7ca14bf3999330b4b3fc10c2/users/1824baa8213547b29faa5d916b4e8b1c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:46.068420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:46.068782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:46.069026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:46.216836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] MFA Rules not processed for user `1824baa8213547b29faa5d916b4e8b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:46.219511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:46.392204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2546/5103] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:46.403727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:46.407287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:46.556149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa25ba1-56f9-4258-86ba-499c51f95b09 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:46.588452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:46.589629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:46.590170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:46.590719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:46.613873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:46.617593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4245425-dbfd-4a89-be36-049d8dee8dc0 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:46.632304 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2558/5104] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:48.730546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:48.733349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:48.998480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e565a18-81b0-4cd7-a36a-00fe1f9c1f55 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:49.028465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:49.029525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:49.031510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:49.032036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:49.034460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:49.051336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:49.053354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:49.067961 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2547/5105] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:49.527417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:49.527961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:49.527961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:49.544009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:49.557351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:49.560287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:49.753929 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2559/5106] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:49.848196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:49.850872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:49.892335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:50.047373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d85c-056d-4085-8598-8ebf7a85f854 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:50.064172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:50.068208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:50.068514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:50.068844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:50.097202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:50.102799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a83c50-3fd6-4ada-aeff-6f0b0042ecf2 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:50.138702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2548/5107] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:27:53.741843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:54.028282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62008603-1f8e-4380-a3c6-8f1df475f3bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:54.048400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:54.050964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:54.051277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:54.051540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] PATH_INFO: `/v3/users/1824baa8213547b29faa5d916b4e8b1c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:54.055828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1824baa8213547b29faa5d916b4e8b1c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:54.058870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:54.292464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1824baa8213547b29faa5d916b4e8b1c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:54.319569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1824baa8213547b29faa5d916b4e8b1c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:54.320440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1824baa8213547b29faa5d916b4e8b1c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:54.355179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1824baa8213547b29faa5d916b4e8b1c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:54.357858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1824baa8213547b29faa5d916b4e8b1c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:54.500367 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2560/5108] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:27:53 2022] DELETE /identity/v3/users/1824baa8213547b29faa5d916b4e8b1c => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:54.505750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:54.506408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:54.506408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:54.586920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:27:54.599489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:54.953823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2549/5109] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:27:54.961524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:54.962962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:55.089303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:27:55.240605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaee5e6-bbfa-4cbd-a887-6537e8a20f5d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:55.255177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:55.256551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:55.259478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:55.260198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:55.288415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:55.295089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edafeb-238e-437b-aeb2-360479b19d8b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:55.331116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2561/5110] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:27:59.606804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:27:59.609972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:27:59.673713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a0ab4-7eac-44f8-b8ff-2426b86542cb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:27:59.687867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:27:59.689338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:59.690083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:59.690787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] PATH_INFO: `/v3/projects/81009f9a7ca14bf3999330b4b3fc10c2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:27:59.695212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81009f9a7ca14bf3999330b4b3fc10c2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:27:59.714211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:27:59.875882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81009f9a7ca14bf3999330b4b3fc10c2', 'request_id': 'req-4aa79720-4856-4ab1-abd3-a98ef43dd507'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:59.891866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81009f9a7ca14bf3999330b4b3fc10c2', 'request_id': 'req-4aa79720-4856-4ab1-abd3-a98ef43dd507'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:59.906322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81009f9a7ca14bf3999330b4b3fc10c2', 'request_id': 'req-4aa79720-4856-4ab1-abd3-a98ef43dd507'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:59.932581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] The token cache is being invalidate because project 81009f9a7ca14bf3999330b4b3fc10c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:27:59.932874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:59.933847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4aa79720-4856-4ab1-abd3-a98ef43dd507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:27:59.936842 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2550/5111] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:27:59 2022] DELETE /identity/v3/projects/81009f9a7ca14bf3999330b4b3fc10c2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:27:59.943986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:27:59.944506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:27:59.946518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:00.011728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:00.016567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:00.188902 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2562/5112] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:00.199636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:00.200916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:00.201337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:00.249739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:00.254336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:00.279265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2551/5113] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:00.285216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:00.307098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157502-4750-4e90-b1a3-64e1ae982e1c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:00.330986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:00.335860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:00.337276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:00.337674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:00.339321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:28:00.340655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:00.346224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:00.380872 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2563/5114] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:28:00.384930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:00.409520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b2b3-4008-4c5f-a85a-8e075ba4dd07 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:00.427065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:00.430974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:00.431829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:00.434562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:00.435370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:00.442472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:00.549657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:00.578649 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2552/5115] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:28:00 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:28:00.583053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:00.611838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e779d6-18b8-4353-b6ca-f22200f03013 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:00.922720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:00.927408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:00.928424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:00.937760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:00.939179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:00.943446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:01.041268 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2564/5116] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:28:00 2022] POST /identity/v3/users => generated 289 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:28:01.042750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:01.065453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5670-923a-43d4-b04d-17c3e7529282 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:01.077839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:01.078557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:01.078881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:01.079527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:01.080197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:01.087836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:01.129441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2553/5117] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:28:01.133220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:01.150275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1382-ce89-4254-93fb-a7e0a18d8ec3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:01.180258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:01.181646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:01.181646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:01.181646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:01.187659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:01.195804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067370-9bf6-45f5-868e-f014a95fb64f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:01.239567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:01.251248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2565/5118] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:28:01.263616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001e48-914b-4eaa-a299-3296ca7ca025 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:01.275567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:01.277364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:01.279029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:01.280192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] PATH_INFO: `/v3/projects/74df76bcafa14d2dbfa360913f4c7f9c/users/4ca016013e074fac9773523434607a9c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:01.348002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74df76bcafa14d2dbfa360913f4c7f9c, user_id=4ca016013e074fac9773523434607a9c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:01.355363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:01.410150 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2554/5119] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:28:01 2022] PUT /identity/v3/projects/74df76bcafa14d2dbfa360913f4c7f9c/users/4ca016013e074fac9773523434607a9c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:01.418909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:01.419896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:01.420182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:01.494129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] MFA Rules not processed for user `4ca016013e074fac9773523434607a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:01.495627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:01.578257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:02.016933 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2566/5120] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 596 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:02.019876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:02.262838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172c09-8465-4389-b7b7-f5fe856b4c4d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:02.269067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:02.269693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:02.269976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:02.270249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:02.270892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:02.272823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:02.385296 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2555/5121] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:28:02 2022] POST /identity/v3/projects => generated 377 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:28:02.386369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:02.406045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75acec-0fa0-4c61-a52b-7a6d61f2a337 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:02.744694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:02.745348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:02.745608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:02.748189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:02.748189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:02.753045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:02.835278 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2567/5122] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:28:02 2022] POST /identity/v3/users => generated 295 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:28:02.840281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:02.885557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e4c52-b5a0-4d9d-adb2-7a9b712b095c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:02.906862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:02.908073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:02.908695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:02.909360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:02.912010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:02.934469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:03.002957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2556/5123] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:28:03.003353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:03.020878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e4672-3d4b-4bc2-90e9-f19bbb1f0d92 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:03.028406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:03.030741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:03.031393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:03.032011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] PATH_INFO: `/v3/projects/288af12cce7a4112a394976ad4c1875b/users/55897ff415454f0784e372fb4e2245e3/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:03.101400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=288af12cce7a4112a394976ad4c1875b, user_id=55897ff415454f0784e372fb4e2245e3, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:03.105035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:03.133178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2568/5124] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:28:02 2022] PUT /identity/v3/projects/288af12cce7a4112a394976ad4c1875b/users/55897ff415454f0784e372fb4e2245e3/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:03.144576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:03.204560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe7bc-5136-4715-9057-0be539743878 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:03.422131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:03.422805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:03.423396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:03.424178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:03.424530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:03.426285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353fcb1-9f6c-4fdf-8789-add8ba5c394b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:03.455994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:03.456897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2557/5125] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:28:03.470820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf55854-fcbc-430f-8cc5-a3355a23bccf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:03.494273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:03.495161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:03.495538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:03.495912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] PATH_INFO: `/v3/projects/288af12cce7a4112a394976ad4c1875b/users/55897ff415454f0784e372fb4e2245e3/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:03.502446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] RBAC: Authorizing `identity:create_grant(project_id=288af12cce7a4112a394976ad4c1875b, user_id=55897ff415454f0784e372fb4e2245e3, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:03.505179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:03.544533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:03.544952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:03.546019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:03.549018 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2569/5126] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:28:03 2022] PUT /identity/v3/projects/288af12cce7a4112a394976ad4c1875b/users/55897ff415454f0784e372fb4e2245e3/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:03.606899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] MFA Rules not processed for user `55897ff415454f0784e372fb4e2245e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:03.608854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:03.671414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:03.833275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:03.834083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2558/5127] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:03.835800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:03.957957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b7882-7b00-430d-8e4c-07a4576caada admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:03.967536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:03.968686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:03.969228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:03.969756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:04.058746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:04.161955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:04.163556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7207b0-fc19-426c-abcc-de9c4deccdec service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:04.194877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2570/5128] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:28:12.164117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:12.165599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:12.186978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6f216-855e-4340-8070-a4f3a4b36981 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:12.201832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:12.202477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:12.202774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:12.203081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:12.229564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:12.230985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:12.293159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2559/5129] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:28:14.179856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=15 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:21.219787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:21.220501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:21.220705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:21.284038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] MFA Rules not processed for user `a51c470236904eb0a85bfee1703d3c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:21.284038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:21.399393 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2571/5130] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:22.273568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=26 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:31.322727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:31.325661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:31.378723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:31.604153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f41f-2ca2-49f2-9785-8dece19fe48e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:31.613865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:31.615687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:31.615974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:31.616245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:31.625539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:31.893404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:31.914544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:31.951442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2560/5131] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:28:32.093947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:32.095850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:32.223359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381ab55-c9c6-478d-931d-641723c70a8b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:32.250998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:32.251752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:32.253116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:32.253907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:32.284424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:32.340349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:32.344497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7c7a-7d67-4f1f-b8ae-bc0e455c0a29 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:32.367754 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2572/5132] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:28:32.900525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:32.916599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46bb4-7fde-41b0-a802-19c7d9b24513 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:32.925971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:32.926772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:32.927178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:32.927558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:32.934446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:32.978353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:32.980938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:33.022187 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2561/5133] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:28:40.454395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2090-cf83-477c-a263-636353750763 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:40.455535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2090-cf83-477c-a263-636353750763 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:40.456606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2090-cf83-477c-a263-636353750763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:40.494913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3bbb2090-cf83-477c-a263-636353750763 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:40.499367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3bbb2090-cf83-477c-a263-636353750763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:40.633393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:40.635996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:40.645205 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2573/5134] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:28:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:28:40.750310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e8bf-b9cd-4f63-9891-bfe96c0da7a0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:40.757597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:40.758711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:40.759234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:40.759685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:40.783247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:40.785051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aa738-c7c2-4d92-b32f-e50d08068187 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:40.789163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:40.810943 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2562/5135] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:28:50.608203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=51 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:50.807260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:54.462167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb2090-cf83-477c-a263-636353750763 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:54.792066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb2090-cf83-477c-a263-636353750763 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:54.812178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:54.813322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:54.813803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:54.814295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] PATH_INFO: `/v3/users/4ca016013e074fac9773523434607a9c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:54.821840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca016013e074fac9773523434607a9c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:54.832749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:55.011354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca016013e074fac9773523434607a9c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:55.062919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca016013e074fac9773523434607a9c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:55.064947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca016013e074fac9773523434607a9c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:55.088666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca016013e074fac9773523434607a9c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:55.089217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca016013e074fac9773523434607a9c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:55.177178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2574/5136] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:28:54 2022] DELETE /identity/v3/users/4ca016013e074fac9773523434607a9c => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:55.181568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:55.183168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:55.184140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:55.259697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:55.266090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:55.478394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2563/5137] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:28:55.492906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:55.494610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:55.650452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:55.701256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3c061-21c0-408b-9fee-a655481d810a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:55.713921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:55.715069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:55.716141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:55.716614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:55.728567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:55.730386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:55.749990 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2575/5138] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:28:56.370702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:56.374770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:56.419252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ff299-f109-4c7a-be2e-204f15c38b02 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:56.441994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:56.444057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:56.445240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:56.448314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] PATH_INFO: `/v3/projects/74df76bcafa14d2dbfa360913f4c7f9c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:56.453044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74df76bcafa14d2dbfa360913f4c7f9c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:56.463319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:56.594969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74df76bcafa14d2dbfa360913f4c7f9c', 'request_id': 'req-89e47f35-ba61-477d-9bf0-66428262909d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:56.614818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74df76bcafa14d2dbfa360913f4c7f9c', 'request_id': 'req-89e47f35-ba61-477d-9bf0-66428262909d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:56.646376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74df76bcafa14d2dbfa360913f4c7f9c', 'request_id': 'req-89e47f35-ba61-477d-9bf0-66428262909d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:56.704232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] The token cache is being invalidate because project 74df76bcafa14d2dbfa360913f4c7f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:28:56.704582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:56.705263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:56.707094 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2564/5139] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:28:56 2022] DELETE /identity/v3/projects/74df76bcafa14d2dbfa360913f4c7f9c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:56.711844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:56.753524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612793d-8f39-4a43-b8b6-23fd9e4edf4b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:56.987444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:56.988437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:56.996867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:56.996867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] PATH_INFO: `/v3/users/55897ff415454f0784e372fb4e2245e3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:56.999256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55897ff415454f0784e372fb4e2245e3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:57.001353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:57.119767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55897ff415454f0784e372fb4e2245e3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:57.132596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55897ff415454f0784e372fb4e2245e3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:57.133265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55897ff415454f0784e372fb4e2245e3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:57.153331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55897ff415454f0784e372fb4e2245e3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:57.154438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72cb137b-94b3-49e7-b561-49e4dcaddb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55897ff415454f0784e372fb4e2245e3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:57.186275 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2576/5140] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:28:56 2022] DELETE /identity/v3/users/55897ff415454f0784e372fb4e2245e3 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:59.259265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:28:59.261437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:28:59.292914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47f35-ba61-477d-9bf0-66428262909d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:28:59.392005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:28:59.392667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:59.392947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:59.393399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] PATH_INFO: `/v3/projects/288af12cce7a4112a394976ad4c1875b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:59.394705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=288af12cce7a4112a394976ad4c1875b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:28:59.396827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:28:59.443794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:28:59.550987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288af12cce7a4112a394976ad4c1875b', 'request_id': 'req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:59.578986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288af12cce7a4112a394976ad4c1875b', 'request_id': 'req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:59.594860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288af12cce7a4112a394976ad4c1875b', 'request_id': 'req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:59.644408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] The token cache is being invalidate because project 288af12cce7a4112a394976ad4c1875b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:28:59.644769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:59.645499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cb3e64c6-c0ad-4fce-a159-f76b2fbccfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:28:59.651689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2565/5141] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:28:59 2022] DELETE /identity/v3/projects/288af12cce7a4112a394976ad4c1875b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:28:59.654674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:28:59.656668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:28:59.657757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:28:59.802041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:28:59.809449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:00.004461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:00.045108 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2577/5142] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:00.048337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.049010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.049590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.084648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:00.086588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:00.109822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.110729 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2566/5143] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:00.126449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d8bc-9489-456f-9fee-b80b981c854e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.139771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.140617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.141038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.141371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.142393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:29:00.142830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.145844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.205170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2578/5144] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:29:00.211915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.243663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3acd70-b5a1-4018-b7a8-cdb95a85dc11 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.250110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.250740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.251270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.251270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.251992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.254147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.336546 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2567/5145] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:29:00 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:29:00.337987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.354289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746b0b-876e-484e-841f-673cd4e6d9fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.508076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.508980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.509501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.509962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.510785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.514054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.560014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.569977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2579/5146] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:29:00 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:29:00.594991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f541f-b64b-4146-b076-d371d6ee1139 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.618865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.620244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.620802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.621634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.622555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.628527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.660151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2568/5147] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:00.665406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.679034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842bd5-f90f-4061-90f1-a6e82e34609b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.705103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.706141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.706667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.707188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.708138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.710142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae34e1-9acd-4141-a172-85f8247d1896 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.726338 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2580/5148] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:00.730950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:00.744984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5826872-c493-4814-92d7-cce8c91d1748 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:00.754132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:00.755041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.755392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.755726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] PATH_INFO: `/v3/projects/33f17be9611c47cd9aadda4645084046/users/cd12c09cb29f409bb8de477123e27e94/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.796424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f17be9611c47cd9aadda4645084046, user_id=cd12c09cb29f409bb8de477123e27e94, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:00.801065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:00.849481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2569/5149] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:29:00 2022] PUT /identity/v3/projects/33f17be9611c47cd9aadda4645084046/users/cd12c09cb29f409bb8de477123e27e94/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:29:00.853444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c456-b562-4369-88a6-bec3a60c7bfa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:00.854122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c456-b562-4369-88a6-bec3a60c7bfa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:00.854708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13c456-b562-4369-88a6-bec3a60c7bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:00.900518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d13c456-b562-4369-88a6-bec3a60c7bfa None None] MFA Rules not processed for user `cd12c09cb29f409bb8de477123e27e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:00.903673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d13c456-b562-4369-88a6-bec3a60c7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:01.044739 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2581/5150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:01.057824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:01.061587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:01.225059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1af5-2041-4deb-9924-4d36a785523e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:01.232648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:01.233520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:01.233764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:01.234104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:01.252076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:01.255545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:01.270424 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2570/5151] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:29:06.001447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:06.002249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:06.002750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:06.111780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:06.114096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:06.289645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:06.340788 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2582/5152] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:06.382681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:06.392235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:06.567011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:06.651984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28d82-055a-4c2e-9e9f-a9dec8b7ebeb service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:06.689879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:06.695951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:06.696833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:06.697711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:06.732762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:06.749339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:06.784388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2571/5153] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:29:08.982112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:08.983562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:09.225615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996677b-791a-44b0-8c47-d03bcf2ee9c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:09.252840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:09.253664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:09.254160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:09.255364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:09.258742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:09.320346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:09.328094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:09.362277 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2583/5154] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:09.793016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:09.794672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:09.852465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625f2da-f545-4267-9982-223e96147ec6 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:09.898873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:09.899803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:09.900312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:09.900931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:09.910746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:09.967620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:09.969497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f16b8d-018a-48dc-947b-f99d0e7831f4 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:10.003527 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2572/5155] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:29:10.783488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:11.117533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4422a-0a1f-42b6-8f49-c5e2d1b37ea5 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:11.139571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:11.140763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:11.141327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:11.141857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] PATH_INFO: `/v3/users/cd12c09cb29f409bb8de477123e27e94` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:11.145987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd12c09cb29f409bb8de477123e27e94)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:11.149150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:11.281811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd12c09cb29f409bb8de477123e27e94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:11.285194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:11.302660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd12c09cb29f409bb8de477123e27e94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:11.303462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd12c09cb29f409bb8de477123e27e94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:11.333557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd12c09cb29f409bb8de477123e27e94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:11.334843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd12c09cb29f409bb8de477123e27e94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:11.392110 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2584/5156] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:29:10 2022] DELETE /identity/v3/users/cd12c09cb29f409bb8de477123e27e94 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:11.397084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:11.397887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:11.397887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:11.537574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:11.538908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:11.750714 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2573/5157] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:11.764278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:11.766562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:11.998826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb0db-dc96-43b8-9bd8-84cc36a34bad admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:12.004536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:12.006028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:12.006511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:12.006961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:12.022726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:12.025237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60a81-9b94-4ab9-b76d-5013e1ce7766 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:12.079437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2585/5158] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:12.951080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:12.953358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:12.987441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb39f6-ce66-4271-af00-caae006a066a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:13.015499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:13.016217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:13.016500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:13.016777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] PATH_INFO: `/v3/projects/33f17be9611c47cd9aadda4645084046` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:13.018018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f17be9611c47cd9aadda4645084046)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:13.019974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:13.160194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f17be9611c47cd9aadda4645084046', 'request_id': 'req-66eb1d7a-55ba-4770-866e-a3fe327da594'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:13.194951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f17be9611c47cd9aadda4645084046', 'request_id': 'req-66eb1d7a-55ba-4770-866e-a3fe327da594'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:13.207895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f17be9611c47cd9aadda4645084046', 'request_id': 'req-66eb1d7a-55ba-4770-866e-a3fe327da594'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:13.241246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] The token cache is being invalidate because project 33f17be9611c47cd9aadda4645084046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:29:13.241520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:13.242194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-66eb1d7a-55ba-4770-866e-a3fe327da594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:13.244210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2574/5159] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:29:12 2022] DELETE /identity/v3/projects/33f17be9611c47cd9aadda4645084046 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:13.250510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:13.251105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:13.251761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:13.378956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:13.381075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:13.537906 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2586/5160] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:13.546157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:13.546961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:13.547633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:13.587053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:13.590023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:13.606384 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2575/5161] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:13.612158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:13.624710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ebe2f-a405-4a6c-ab53-3411aff3c628 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:13.630801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:13.632081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:13.632695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:13.633334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:13.634680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:29:13.635331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:13.639992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:13.706063 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2587/5162] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:29:13.714411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:13.744595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66c13-9086-4428-b891-bc6e055d775a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:13.763454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:13.767769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:13.768248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:13.768689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:13.769591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:13.771867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:13.840581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:13.874592 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2576/5163] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:29:13 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:29:13.880778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:13.925401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfe92-968a-406d-8ac4-82a72c774a55 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:14.082155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:14.147461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:14.151650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:14.153530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:14.154354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:14.156321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:14.166271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:14.228315 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2588/5164] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:29:13 2022] POST /identity/v3/users => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:29:14.234518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:14.249449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d5aa-bd3f-4bd9-ab66-42451c95ce17 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:14.262241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:14.266432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:14.267022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:14.267516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:14.268533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:14.270576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:14.315373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2577/5165] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:14.318319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:14.350915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1613a-9aad-4730-ac83-d46cf3f198b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:14.361634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:14.362261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:14.362592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:14.363004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:14.377253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:14.381545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcdad4-d471-41de-881f-31b4e958123c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:14.418982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2589/5166] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:14.422959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:14.436810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fea74-5b08-4bf3-8b2b-75b15cd92d9f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:14.469525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:14.473652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:14.474952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:14.475781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] PATH_INFO: `/v3/projects/ff3a0d95dfba48baa0c42c2189bbf5a5/users/1e19905859b1410abd0103590d7e1745/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:14.578466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3a0d95dfba48baa0c42c2189bbf5a5, user_id=1e19905859b1410abd0103590d7e1745, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:14.584891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:14.642849 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2578/5167] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:29:14 2022] PUT /identity/v3/projects/ff3a0d95dfba48baa0c42c2189bbf5a5/users/1e19905859b1410abd0103590d7e1745/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:14.660650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578fb7-daeb-4e61-8a6f-306cb15c20f2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:14.661381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578fb7-daeb-4e61-8a6f-306cb15c20f2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:14.661855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578fb7-daeb-4e61-8a6f-306cb15c20f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:14.731030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8d578fb7-daeb-4e61-8a6f-306cb15c20f2 None None] MFA Rules not processed for user `1e19905859b1410abd0103590d7e1745`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:14.732204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8d578fb7-daeb-4e61-8a6f-306cb15c20f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:14.962116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2590/5168] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:14.963654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:14.966532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:15.107854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5e53-c404-464c-8631-3b1871a1f950 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:15.115874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:15.117477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:15.118119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:15.118793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:15.141022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:15.145977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:15.186424 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2579/5169] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:18.603911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:18.605430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:18.605430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:18.658912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] MFA Rules not processed for user `1e19905859b1410abd0103590d7e1745`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:18.660944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:18.678635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2591/5170] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:25.166534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:28.654121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:32.511477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:32.513354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:32.761594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172d665-2dc3-4f40-918e-2f23f7f01e48 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:32.767251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:32.768254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:32.768750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:32.769271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] PATH_INFO: `/v3/users/83c668dcae65428e99d6dab21f00fe88` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:32.770730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c668dcae65428e99d6dab21f00fe88)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:32.773020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:32.891845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c668dcae65428e99d6dab21f00fe88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:32.892529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c668dcae65428e99d6dab21f00fe88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:32.905731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c668dcae65428e99d6dab21f00fe88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:32.906789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c668dcae65428e99d6dab21f00fe88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:32.920101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cbe32fed-0192-4292-b95e-b4591c3be6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c668dcae65428e99d6dab21f00fe88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:32.958704 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2580/5171] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:29:32 2022] DELETE /identity/v3/users/83c668dcae65428e99d6dab21f00fe88 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:33.411148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:33.425305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a154c4-b034-4899-bfa4-d720fe32ab78 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:33.510231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:33.511502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:33.511768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:33.512353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] PATH_INFO: `/v3/projects/d11b952197c4461badbca0712357944b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:33.513493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11b952197c4461badbca0712357944b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:33.515806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:33.575298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11b952197c4461badbca0712357944b', 'request_id': 'req-43c82c55-5792-40f6-bed9-4e6795648305'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:33.583008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11b952197c4461badbca0712357944b', 'request_id': 'req-43c82c55-5792-40f6-bed9-4e6795648305'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:33.592867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11b952197c4461badbca0712357944b', 'request_id': 'req-43c82c55-5792-40f6-bed9-4e6795648305'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:33.617461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] The token cache is being invalidate because project d11b952197c4461badbca0712357944b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:29:33.617901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:33.618870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-43c82c55-5792-40f6-bed9-4e6795648305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:33.621692 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2592/5172] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:29:33 2022] DELETE /identity/v3/projects/d11b952197c4461badbca0712357944b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:33.628720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:33.629482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:33.629482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:33.660028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:33.661181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:33.757097 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2581/5173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:33.765760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:33.766360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:33.766776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:33.792486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:33.793766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:33.806572 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2593/5174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:33.809733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:33.824607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e69d7-10a2-4a5c-ab7b-54081efae69b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:33.830327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:33.831246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:33.831726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:33.832947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:33.833843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:29:33.834310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:33.836614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:33.860553 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2582/5175] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:29:33.864559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:33.878566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29838610-5026-4ffa-abe8-b34b62a22ac3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:33.885104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:33.885998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:33.886780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:33.887767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:33.889156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:33.891275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:33.937046 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2594/5176] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:29:33 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:29:33.942183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:33.972479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c7379-f416-4f3c-8808-50c64ed05900 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:33.980312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:34.076233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:34.078161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.078622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.078622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.079687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:34.082189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:34.113913 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2583/5177] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:29:33 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:29:34.118473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:34.137765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9129-9a8b-452e-ab65-52f9537f6565 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:34.143027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:34.143684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.143964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.144228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.144936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:34.146632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:34.159856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2595/5178] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:34.164747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:34.177825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63648852-c55f-4142-8440-98ec496bd210 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:34.184266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:34.185075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.185428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.186357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.186539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:34.188152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1a8f6-b767-46a2-b26f-13fdf10ade5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:34.202784 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2584/5179] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:29:34.207757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:34.221663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770979d6-3e47-42f6-9380-ff97d862613b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:34.227871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:34.228696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.230761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.230761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] PATH_INFO: `/v3/projects/95e9fcede8164144ba3c05683a2bc44c/users/23622288141c4af2b2dfb82941f3b2e0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.254478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e9fcede8164144ba3c05683a2bc44c, user_id=23622288141c4af2b2dfb82941f3b2e0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:34.260693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:34.295430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2596/5180] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:29:34 2022] PUT /identity/v3/projects/95e9fcede8164144ba3c05683a2bc44c/users/23622288141c4af2b2dfb82941f3b2e0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:29:34.303290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560366-cca4-4954-ae8d-3affa0097a73 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.304776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560366-cca4-4954-ae8d-3affa0097a73 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.305376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560366-cca4-4954-ae8d-3affa0097a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.363979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96560366-cca4-4954-ae8d-3affa0097a73 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:34.363979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96560366-cca4-4954-ae8d-3affa0097a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:34.511677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2585/5181] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:34.520233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:34.523426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:34.571857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:34.613941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d64b-229b-4711-8e56-efec94004700 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:34.618015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:34.618766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:34.619171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:34.619522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:34.632959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:34.635048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc10b8-7b85-4251-b8a1-220711957787 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:34.659091 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2597/5182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:44.490654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:44.642669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=14 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:45.143980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:45.144286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:45.144551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:45.203439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] MFA Rules not processed for user `23622288141c4af2b2dfb82941f3b2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:45.204697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:45.335892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2586/5183] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:29:45.351391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:45.351906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:45.352286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:45.412778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] MFA Rules not processed for user `23622288141c4af2b2dfb82941f3b2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:45.414141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:45.436434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2598/5184] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:45.471892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:45.473419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:45.699440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8f67f-c959-4e78-b6b8-94de716d6ab1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:45.712946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:45.718378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:45.718718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:45.718952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:45.738936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:45.740508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ffe64-1fb9-4516-81c9-5ba1023dd0a4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:45.768673 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2587/5185] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:46.426434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:46.428857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:46.585881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603b1e-dd97-42c2-9255-17013d421174 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:46.601281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:46.602759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:46.608980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:46.610351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:46.613778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:46.657977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:46.691442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:46.691442 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2599/5186] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:49.167302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c1e7-1241-4d44-ba7c-f29a762f6f45 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:49.168096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c1e7-1241-4d44-ba7c-f29a762f6f45 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:49.168813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c1e7-1241-4d44-ba7c-f29a762f6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:49.271737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9b79c1e7-1241-4d44-ba7c-f29a762f6f45 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:49.276858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b79c1e7-1241-4d44-ba7c-f29a762f6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:49.694052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2588/5187] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:49.696155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:49.696155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:49.848722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d076e3-36da-45da-9ff1-6ec503afb414 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:49.869215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:49.870170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:49.870460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:49.870736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:49.900467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:49.903131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:49.943879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2600/5188] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:51.282682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813fd3-5fa2-45d6-b8fc-fe788f157884 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:51.284064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813fd3-5fa2-45d6-b8fc-fe788f157884 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:51.284660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813fd3-5fa2-45d6-b8fc-fe788f157884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:51.340756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-79813fd3-5fa2-45d6-b8fc-fe788f157884 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:51.342123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-79813fd3-5fa2-45d6-b8fc-fe788f157884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:51.417714 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2589/5189] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:51.444927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:51.457852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e99d1-7a1a-4f60-8eb5-8dc1082d38a8 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:51.473957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:51.474986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:51.475491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:51.480647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:51.498375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:51.500493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:51.529161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2601/5190] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:52.014431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:52.015282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:52.016007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:52.031897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:52.079719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:52.081195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:52.091137 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2590/5191] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:52.109238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:52.129381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aafe3-e429-4137-a085-10a0b393d2bd service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:52.139343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:52.140478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:52.142349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:52.142832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:52.171709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:52.173640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4386-2917-41dc-810a-a1f7e825955b service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:52.188751 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2602/5192] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:29:53.102728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:53.104258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:53.143618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e30d32-af4d-4ea2-beb9-af3ea76f8e3e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:53.153443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:53.154696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:53.155126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:53.156253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] PATH_INFO: `/v3/users/9a28381538984467b6aaa5e4bad8d21a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:53.157968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a28381538984467b6aaa5e4bad8d21a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:53.163193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:53.289879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a28381538984467b6aaa5e4bad8d21a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:53.290568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a28381538984467b6aaa5e4bad8d21a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:53.309167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a28381538984467b6aaa5e4bad8d21a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:53.310125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a28381538984467b6aaa5e4bad8d21a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:53.321048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a28381538984467b6aaa5e4bad8d21a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:53.353036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2591/5193] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:29:53 2022] DELETE /identity/v3/users/9a28381538984467b6aaa5e4bad8d21a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:53.353779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:53.354252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:53.354512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:53.376580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:53.377973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:53.489231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2603/5194] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:53.490159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:53.492798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:53.570304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0d1cb-e2fc-4ab2-b689-8f04a514a9af admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:53.575630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:53.577099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:53.577547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:53.578003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:53.590239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:53.591691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d6d9d-9048-47d5-98de-235afc084342 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:53.602623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2592/5195] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:29:53.873440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:53.875298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:53.903319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f65ed-c6a2-4869-b513-4d70a822ce7b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:53.917675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:53.918392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:53.918702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:53.918993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] PATH_INFO: `/v3/projects/31c93324cf86424988ec5f5784edc66e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:53.920291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c93324cf86424988ec5f5784edc66e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:53.923163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:53.970524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:53.992152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c93324cf86424988ec5f5784edc66e', 'request_id': 'req-a1e48740-8130-4dc9-88dd-2e5a85d887a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:54.000243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c93324cf86424988ec5f5784edc66e', 'request_id': 'req-a1e48740-8130-4dc9-88dd-2e5a85d887a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:54.008784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c93324cf86424988ec5f5784edc66e', 'request_id': 'req-a1e48740-8130-4dc9-88dd-2e5a85d887a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:54.026806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] The token cache is being invalidate because project 31c93324cf86424988ec5f5784edc66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:29:54.027108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:54.027829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a1e48740-8130-4dc9-88dd-2e5a85d887a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:29:54.032966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2604/5196] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:29:53 2022] DELETE /identity/v3/projects/31c93324cf86424988ec5f5784edc66e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:54.034680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.034963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.035266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.074215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:54.075824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:54.174735 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2593/5197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:54.184118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.184403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.184679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.214672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:54.215905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:54.247101 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2605/5198] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:54.248174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.265257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b29749-0007-48ed-adc2-9e4abbd0bffa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.277026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.281551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.282870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.285734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.286691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:29:54.288628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.295699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.313660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:54.332690 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2594/5199] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:29:54.333411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.363623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd5505-cb54-4c2e-b253-0a463515de33 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.384234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.386465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.386873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.387261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.388124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.392659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.462124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2606/5200] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:29:54 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:29:54.468266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.481580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1c36-d67e-4f33-836d-d0be4ab9ff96 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.596193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.597262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.597996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.598434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.599382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.601313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.634521 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2595/5201] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:29:54 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:29:54.636044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.647827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c2fb-44bb-4f95-ad26-acb758b48766 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.653856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.654585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.654928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.655542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.656363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.658545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.675378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.681889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2607/5202] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:29:54.687728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf871-1827-452d-97f0-2c019a45702f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.692782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.693800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.694537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.694719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.695333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.697558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b888b0-6411-4a72-a1bb-0a73f5735be4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.711070 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2596/5203] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:29:54.716117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.727086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b0c40-8d52-4aa0-a153-8e6f08804ca8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:54.734254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:54.735276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.735617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.735950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] PATH_INFO: `/v3/projects/7ce825a5d4d745fa9e70669ac5f8f60a/users/3af3e1e41f4b4c1f98b64c6343c9e3da/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.763475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce825a5d4d745fa9e70669ac5f8f60a, user_id=3af3e1e41f4b4c1f98b64c6343c9e3da, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:54.766105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:54.797881 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2608/5204] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:29:54 2022] PUT /identity/v3/projects/7ce825a5d4d745fa9e70669ac5f8f60a/users/3af3e1e41f4b4c1f98b64c6343c9e3da/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:29:54.808246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8fa88-60f7-4a79-8249-e2ec27d07e90 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:54.808530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8fa88-60f7-4a79-8249-e2ec27d07e90 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:54.808805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8fa88-60f7-4a79-8249-e2ec27d07e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:54.841805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dbf8fa88-60f7-4a79-8249-e2ec27d07e90 None None] MFA Rules not processed for user `3af3e1e41f4b4c1f98b64c6343c9e3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:54.843433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbf8fa88-60f7-4a79-8249-e2ec27d07e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:54.929999 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2597/5205] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:29:54.940963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:54.942751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:55.022572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6398f-62a3-4f8a-bf0b-b3cc9c21cbf8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:55.027976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:55.028842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:55.029287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:55.029691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:55.041315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:55.043035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:55.053067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2609/5206] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:29:55.561392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:55.561903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:55.561903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:55.629746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:29:55.636664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:55.819649 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2598/5207] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:29:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:29:55.844145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:55.846132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:56.011541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:56.044985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b3c4-0f48-4494-b574-c7cfd0c7121b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:56.058810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:56.059467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:56.059865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:56.059976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:56.079262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:56.081219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:56.101632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2610/5208] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:29:56.746076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:29:56.747997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:56.772502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:29:56.968480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e7c00-f4fe-4710-a0d6-1fe79f14edcf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:29:56.977234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:29:56.978855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:29:56.979335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:29:56.979967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:29:56.984118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:29:57.003036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:29:57.005735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c3d1-3196-4dc0-bea6-5a6fe4f62671 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:29:57.036772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2599/5209] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:03.414615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:03.417075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:03.639735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e131e8-a22c-410c-8aec-78f4353e76d4 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:03.652575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:03.653273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:03.653553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:03.653830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] PATH_INFO: `/v3/users/1e19905859b1410abd0103590d7e1745` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:03.656308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e19905859b1410abd0103590d7e1745)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:03.658653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:03.765799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e19905859b1410abd0103590d7e1745'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:03.783264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e19905859b1410abd0103590d7e1745'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:03.783908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e19905859b1410abd0103590d7e1745'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:03.796669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e19905859b1410abd0103590d7e1745'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:03.797814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e19905859b1410abd0103590d7e1745'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:03.862768 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2611/5210] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:03 2022] DELETE /identity/v3/users/1e19905859b1410abd0103590d7e1745 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:30:03.867581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:03.868038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:03.868308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:03.969939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:03.971573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:04.127044 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2600/5211] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:04.208418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:04.210984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:04.518607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb8e03-45f0-4721-9249-acfef8e28b1e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:04.553976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:04.558718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:04.559060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:04.559340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:04.629986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:04.637996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4b1c-f8d1-46c7-8068-92550527a8ad service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:04.707621 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2612/5212] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:07.033963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:07.035684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:07.063748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e726e-2a01-4710-b7d3-3bdbf6dbbb44 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:07.076259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:07.077202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:07.077667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:07.078084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] PATH_INFO: `/v3/projects/ff3a0d95dfba48baa0c42c2189bbf5a5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:07.083347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3a0d95dfba48baa0c42c2189bbf5a5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:07.086930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:07.234409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'request_id': 'req-fdcaccd3-f38a-471a-8828-0e4e3df772ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:07.250673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'request_id': 'req-fdcaccd3-f38a-471a-8828-0e4e3df772ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:07.263859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3a0d95dfba48baa0c42c2189bbf5a5', 'request_id': 'req-fdcaccd3-f38a-471a-8828-0e4e3df772ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:07.293633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] The token cache is being invalidate because project ff3a0d95dfba48baa0c42c2189bbf5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:07.294750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:07.298181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdcaccd3-f38a-471a-8828-0e4e3df772ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:07.306473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2601/5213] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:07 2022] DELETE /identity/v3/projects/ff3a0d95dfba48baa0c42c2189bbf5a5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:07.308485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:07.309067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:07.309183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:07.352089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:07.374813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:07.381413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:07.588308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2613/5214] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:07.600550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798567-1b69-4680-a3ba-80f30541857d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:07.600833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798567-1b69-4680-a3ba-80f30541857d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:07.601140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798567-1b69-4680-a3ba-80f30541857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:07.681319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61798567-1b69-4680-a3ba-80f30541857d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:07.683612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61798567-1b69-4680-a3ba-80f30541857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:07.761304 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2602/5215] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:07.761675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:07.785636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c78ad-d63b-4d2c-9384-55e1b49347f8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:07.797667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:07.798655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:07.799116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:07.799561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:07.800412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:30:07.800957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:07.802782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:07.837644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2614/5216] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:30:07.840235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798567-1b69-4680-a3ba-80f30541857d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:07.855426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798567-1b69-4680-a3ba-80f30541857d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:07.887925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:07.888587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:07.890009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:07.890360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:07.901415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:07.912342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:07.995918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:08.020367 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2603/5217] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:07 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:08.025261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:08.051429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415abef-5b2d-4bf0-9207-b2792bd01236 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:08.249554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:08.250768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:08.251777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:08.252318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:08.253402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:08.257031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:08.309663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2615/5218] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:08 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:08.314188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:08.329800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60cc97-0201-4970-b609-22a39f3fd2df admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:08.340884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:08.341744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:08.342167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:08.342606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:08.343415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:08.345546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:08.360624 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2604/5219] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:08.364394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:08.381689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22015a-926d-46a0-8565-89992a9ccc1b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:08.403703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:08.404799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:08.405728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:08.409785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:08.410996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:08.414418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e19d0-90bc-4a80-95f0-f6e87c9443ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:08.440196 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2616/5220] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:08.444277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:08.471656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9744d98-3fb3-44a1-85ee-6ca2d0dd2e13 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:08.478906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:08.481027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:08.481457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:08.482676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] PATH_INFO: `/v3/projects/976b54b6eab44e55966fc82e46b4ba09/users/c4c6af8f2f3b4b6a9080cb6b207763f5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:08.528661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=976b54b6eab44e55966fc82e46b4ba09, user_id=c4c6af8f2f3b4b6a9080cb6b207763f5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:08.533993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:08.596406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2605/5221] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:08 2022] PUT /identity/v3/projects/976b54b6eab44e55966fc82e46b4ba09/users/c4c6af8f2f3b4b6a9080cb6b207763f5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:30:08.611472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:08.611472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:08.611472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:08.704198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] MFA Rules not processed for user `c4c6af8f2f3b4b6a9080cb6b207763f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:08.705568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:08.880411 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2617/5222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:08.885236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:09.042715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d673d60-89ef-4a79-9216-5665cdc711e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:09.060726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:09.063373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:09.063813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:09.064097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:09.064782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:09.078913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:09.192292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2606/5223] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:09.193751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:09.200226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:09.208872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f84e3b-dc07-4fb7-91d5-452987c08781 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:09.468963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:09.469766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:09.470167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:09.470537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:09.471282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:09.473378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:09.536864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:09.546752 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2618/5224] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:09 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:09.585486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354bfe6-c9f3-494f-8822-b770ba85e9b9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:09.606003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:09.607972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:09.608304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:09.608597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:09.611962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:09.615782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409af1a3-03b9-434c-8c83-245531cee54c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:09.666910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:09.679957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2607/5225] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:30:09.684949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e391d-6fd2-44e4-9dc9-9cd4362df0dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:09.700938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:09.701746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:09.701930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:09.702205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] PATH_INFO: `/v3/projects/b12ddac1dc2149ebab764a40b6594faa/users/3bad96cb738f413c8e3e1e6a4a831a4a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:09.781779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12ddac1dc2149ebab764a40b6594faa, user_id=3bad96cb738f413c8e3e1e6a4a831a4a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:09.789255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:09.838723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2619/5226] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:09 2022] PUT /identity/v3/projects/b12ddac1dc2149ebab764a40b6594faa/users/3bad96cb738f413c8e3e1e6a4a831a4a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:30:09.849908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:09.850480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:09.850961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:09.905696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] MFA Rules not processed for user `3bad96cb738f413c8e3e1e6a4a831a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:09.907500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:10.068237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2608/5227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:10.120782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:10.122568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:10.256221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ece66-f74f-4a92-a86f-867ca74a6fa4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:10.263017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:10.263923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:10.264382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:10.264804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:10.297720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:10.301548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92999160-f848-40da-967b-8b3ab7718573 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:10.334154 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2620/5228] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:30:11.831546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:11.980583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:12.216011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a68f6-58aa-4e4c-b5c8-13285d03a4fe None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:12.244615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:12.245846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:12.246919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:12.247829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] PATH_INFO: `/v3/users/c4c6af8f2f3b4b6a9080cb6b207763f5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:12.254122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c6af8f2f3b4b6a9080cb6b207763f5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:12.260102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:12.518216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c6af8f2f3b4b6a9080cb6b207763f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:12.521247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c6af8f2f3b4b6a9080cb6b207763f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:12.555635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c6af8f2f3b4b6a9080cb6b207763f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:12.578356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c6af8f2f3b4b6a9080cb6b207763f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:12.614336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c6af8f2f3b4b6a9080cb6b207763f5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:12.720001 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2609/5229] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:11 2022] DELETE /identity/v3/users/c4c6af8f2f3b4b6a9080cb6b207763f5 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:12.721831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:12.722335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:12.723517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:12.794457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:12.800077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:13.083466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:13.142780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2621/5230] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:13.177772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:13.180427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:13.471653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540504b1-4705-430f-ab54-7915f0fce0a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:13.478950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:13.479729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:13.480325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:13.480937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:13.511376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:13.516222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:13.545515 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2610/5231] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:13.548409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:13.550158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:13.582068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73d835-add2-4b27-853d-5568b878bec0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:13.608154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:13.609382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:13.610147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:13.610486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] PATH_INFO: `/v3/users/5527f094f5ee4ada9aaae9885c272d7a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:13.612675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5527f094f5ee4ada9aaae9885c272d7a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:13.623069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:13.742789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5527f094f5ee4ada9aaae9885c272d7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:13.758778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5527f094f5ee4ada9aaae9885c272d7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:13.759499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5527f094f5ee4ada9aaae9885c272d7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:13.776647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5527f094f5ee4ada9aaae9885c272d7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:13.778337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5527f094f5ee4ada9aaae9885c272d7a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:13.840307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2622/5232] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:13 2022] DELETE /identity/v3/users/5527f094f5ee4ada9aaae9885c272d7a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:14.308495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:14.310072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:14.333378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474cfa-e4a3-4224-a763-175fc3eddbd9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:14.395649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:14.398592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:14.498097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:14.534709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:14.536637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:14.538442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:14.538887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] PATH_INFO: `/v3/projects/976b54b6eab44e55966fc82e46b4ba09` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:14.542553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=976b54b6eab44e55966fc82e46b4ba09)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:14.548085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:14.599665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567ced-d4b4-417b-9556-bb9308187b90 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:14.613794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:14.614797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:14.615241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:14.615673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] PATH_INFO: `/v3/projects/9c6af1f8b7c04cbb9ac28658f20a36e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:14.618051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6af1f8b7c04cbb9ac28658f20a36e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:14.624977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:14.734081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '976b54b6eab44e55966fc82e46b4ba09', 'request_id': 'req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.771823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '976b54b6eab44e55966fc82e46b4ba09', 'request_id': 'req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.786188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '976b54b6eab44e55966fc82e46b4ba09', 'request_id': 'req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.815703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] The token cache is being invalidate because project 976b54b6eab44e55966fc82e46b4ba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:14.815703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.815703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.816966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2611/5233] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:14 2022] DELETE /identity/v3/projects/976b54b6eab44e55966fc82e46b4ba09 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:14.822224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:14.826015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:14.836508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'request_id': 'req-e1f0cfbf-d731-46e3-8891-19e7a191b18c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.863537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'request_id': 'req-e1f0cfbf-d731-46e3-8891-19e7a191b18c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.882348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6af1f8b7c04cbb9ac28658f20a36e2', 'request_id': 'req-e1f0cfbf-d731-46e3-8891-19e7a191b18c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.902468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:14.924053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] The token cache is being invalidate because project 9c6af1f8b7c04cbb9ac28658f20a36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:14.924281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.927631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1f0cfbf-d731-46e3-8891-19e7a191b18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:14.933716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2623/5234] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:14 2022] DELETE /identity/v3/projects/9c6af1f8b7c04cbb9ac28658f20a36e2 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:14.942854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b128a-ad95-45ed-8049-7c30ea28451a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:14.943183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b128a-ad95-45ed-8049-7c30ea28451a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:14.943411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b128a-ad95-45ed-8049-7c30ea28451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:14.986684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-450b128a-ad95-45ed-8049-7c30ea28451a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:14.989659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-450b128a-ad95-45ed-8049-7c30ea28451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:14.991198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4685a-7c33-48f4-b9ad-102ddfd2bef8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.195924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.201432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.202689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.202998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] PATH_INFO: `/v3/users/3bad96cb738f413c8e3e1e6a4a831a4a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.205481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bad96cb738f413c8e3e1e6a4a831a4a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.208227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2624/5235] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:15.210278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.217469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399de75-5068-4157-966d-c07bc1172884 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.217808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399de75-5068-4157-966d-c07bc1172884 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.218083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399de75-5068-4157-966d-c07bc1172884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.278223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1399de75-5068-4157-966d-c07bc1172884 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:15.279457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1399de75-5068-4157-966d-c07bc1172884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:15.294765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:15.306317 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2625/5236] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:15.314270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399de75-5068-4157-966d-c07bc1172884 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.339313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bad96cb738f413c8e3e1e6a4a831a4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:15.340202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bad96cb738f413c8e3e1e6a4a831a4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:15.349251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399de75-5068-4157-966d-c07bc1172884 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.353235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bad96cb738f413c8e3e1e6a4a831a4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:15.354346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bad96cb738f413c8e3e1e6a4a831a4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:15.364780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.367818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.369638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.370504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.371753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bad96cb738f413c8e3e1e6a4a831a4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:15.371922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:30:15.372564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.376534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.400527 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2626/5237] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:30:15.402054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.404023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:15.407454 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2612/5238] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:14 2022] DELETE /identity/v3/users/3bad96cb738f413c8e3e1e6a4a831a4a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:15.435116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84986ac-fc2d-47b9-a2cb-864952f11651 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.516679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.517328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.517606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.517875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.518943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.521514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.566697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2627/5239] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:15 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:15.568259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.580625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae5679-d803-48f2-87a1-7b54befa151e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.676873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.677539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.677812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.678077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.678724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.689738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.742676 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2613/5240] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:15 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:15.744892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.761449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153fee9-153a-4aa3-9147-bca0f30ae745 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.773353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.773643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.773924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.774226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.775415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.777212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.789804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2628/5241] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:15.794396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.811565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35e66-1580-481c-afea-e64b790ada1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.826707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.827339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.827606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.827875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.828527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.830199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2f69e-8a4b-4584-a98f-e5d275f37400 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.843517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2614/5242] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:15.847573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:15.867145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8d04-f2d6-42e2-b360-5c2acc1360cc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:15.876955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:15.877673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.877976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.878216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] PATH_INFO: `/v3/projects/4329dc19129c4c4783c5934ff48b045a/users/ed5f927857d54bba9371256669c262f1/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.918646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4329dc19129c4c4783c5934ff48b045a, user_id=ed5f927857d54bba9371256669c262f1, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:15.921438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:15.944973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2629/5243] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:15 2022] PUT /identity/v3/projects/4329dc19129c4c4783c5934ff48b045a/users/ed5f927857d54bba9371256669c262f1/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:30:15.951754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:15.953253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:15.953519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:15.983071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:15.984319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:16.107512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2615/5244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:16.117837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:16.128739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:16.197445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:16.238463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f520a1d-3fae-442b-b008-0fbad7093178 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:16.243668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:16.244460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:16.244850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:16.245174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:16.257171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:16.258581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:16.281425 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2630/5245] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:16.865073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:16.867086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:16.964063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e69b0c-18ca-48fc-8dc7-3cda6bf40b5c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:17.012276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:17.012951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.013260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.013533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] PATH_INFO: `/v3/projects/b12ddac1dc2149ebab764a40b6594faa` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.015493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12ddac1dc2149ebab764a40b6594faa)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:17.017816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:17.108478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:17.155728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:17.158000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:17.338649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dfff7-4f5e-46c9-9231-ed6d5c8cc66f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:17.345483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12ddac1dc2149ebab764a40b6594faa', 'request_id': 'req-1ab6cab0-0da7-4488-878f-a365e7c48079'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:17.365728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12ddac1dc2149ebab764a40b6594faa', 'request_id': 'req-1ab6cab0-0da7-4488-878f-a365e7c48079'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:17.387839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12ddac1dc2149ebab764a40b6594faa', 'request_id': 'req-1ab6cab0-0da7-4488-878f-a365e7c48079'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:17.413874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] The token cache is being invalidate because project b12ddac1dc2149ebab764a40b6594faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:17.414363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:17.416342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1ab6cab0-0da7-4488-878f-a365e7c48079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:17.420290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2616/5246] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:16 2022] DELETE /identity/v3/projects/b12ddac1dc2149ebab764a40b6594faa => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:17.425873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afdbc-1af7-4d88-91c2-7c0a527ed48e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.426631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afdbc-1af7-4d88-91c2-7c0a527ed48e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.426917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afdbc-1af7-4d88-91c2-7c0a527ed48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.471380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4a8afdbc-1af7-4d88-91c2-7c0a527ed48e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:17.471636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:17.472057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.472365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.472617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.472779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a8afdbc-1af7-4d88-91c2-7c0a527ed48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:17.477597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:17.655247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2617/5247] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:30:17.668699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.669142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.669574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.678120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:17.679408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:17.723282 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2631/5248] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:17.728619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:17.732594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:17.777725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2618/5249] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:17.778815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:17.801691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e62e-931d-4a23-9e2c-3ee771bbc416 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:17.812939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:17.813592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.815214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.815462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.817248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:30:17.817570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:17.820619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:17.852290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2632/5250] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:30:17.857150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:17.871611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d0a72-88fd-443a-82dc-41bf981c2fda None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:17.885825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:17.886692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:17.887844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:17.889021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:17.891321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:17.901967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:17.968463 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2619/5251] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:17 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:17.973624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:17.979902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:17.996311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec797-a7d7-4e35-9802-e4a4b5f05478 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:18.256453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:18.257919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:18.258401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:18.259463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:18.260867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:18.279740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:18.339240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2633/5252] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:17 2022] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:18.342523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:18.360772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1a10-5d66-4c14-978e-443d85de05a3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:18.392555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:18.393153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:18.404811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:18.405473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:18.406487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:18.408374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:18.443174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2620/5253] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:18.447440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:18.465261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef244b-cf89-46d2-8c2f-ed7f38f2888e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:18.481971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:18.482935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:18.483718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:18.486578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:18.487747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:18.491692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5ee84-ad55-4b21-8c33-345014bc1e41 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:18.539708 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2634/5254] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:18.545190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:18.563438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a690a-9326-4006-8c85-1c64f5873442 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:18.570609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:18.571304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:18.571721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:18.573403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] PATH_INFO: `/v3/projects/9d36e2aefcbe4a37a390a41917a828d4/users/85ef590207844cc5b5ecb86cc00fc862/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:18.633434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d36e2aefcbe4a37a390a41917a828d4, user_id=85ef590207844cc5b5ecb86cc00fc862, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:18.636634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:18.673386 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2621/5255] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:18 2022] PUT /identity/v3/projects/9d36e2aefcbe4a37a390a41917a828d4/users/85ef590207844cc5b5ecb86cc00fc862/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:18.678261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:18.678726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:18.679093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:18.717713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:18.719053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:18.907324 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2635/5256] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:18.996623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:19.000182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:19.066678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:19.108197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aa4b-8b9e-4d3e-8bd6-21a0f6b15dc8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:19.119881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:19.120568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:19.121022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:19.121402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:19.142461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:19.144745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30fc82-14dd-4b91-9320-aa82948f0b10 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:19.162050 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2622/5257] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:21.943787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:21.946785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:21.989388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d22f-4c8a-42c7-ba07-affc0b8cfc72 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:22.005453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:22.006285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:22.006589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:22.009484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] PATH_INFO: `/v3/users/3af3e1e41f4b4c1f98b64c6343c9e3da` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:22.011076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af3e1e41f4b4c1f98b64c6343c9e3da)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:22.025720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:22.164618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af3e1e41f4b4c1f98b64c6343c9e3da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:22.183965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af3e1e41f4b4c1f98b64c6343c9e3da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:22.185578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af3e1e41f4b4c1f98b64c6343c9e3da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:22.206989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af3e1e41f4b4c1f98b64c6343c9e3da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:22.208934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af3e1e41f4b4c1f98b64c6343c9e3da'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:22.249561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:22.281238 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2636/5258] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:21 2022] DELETE /identity/v3/users/3af3e1e41f4b4c1f98b64c6343c9e3da => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:22.285814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:22.286494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:22.286494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:22.331933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:22.337437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:22.558668 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2623/5259] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:30:22.677365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:22.679453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:22.895944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ba445-0aee-4502-a94e-aa3967889760 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:22.906872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:22.912168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:22.912642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:22.913272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:22.944304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:22.946476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5256bea-5a5c-46f2-9420-03e104badbc5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:22.960312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2637/5260] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:25.040556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:25.042257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:25.066779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d4e87-474f-41ef-8ae1-e68654b6bcf1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:25.096632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:25.097357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:25.097640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:25.097913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] PATH_INFO: `/v3/projects/7ce825a5d4d745fa9e70669ac5f8f60a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:25.099723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce825a5d4d745fa9e70669ac5f8f60a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:25.105981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:25.243579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce825a5d4d745fa9e70669ac5f8f60a', 'request_id': 'req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:25.256175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce825a5d4d745fa9e70669ac5f8f60a', 'request_id': 'req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:25.280919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce825a5d4d745fa9e70669ac5f8f60a', 'request_id': 'req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:25.299393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] The token cache is being invalidate because project 7ce825a5d4d745fa9e70669ac5f8f60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:25.299762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:25.302058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94dc4e5d-d61a-4f81-b387-155a2cc9f4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:25.309476 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2624/5261] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:25 2022] DELETE /identity/v3/projects/7ce825a5d4d745fa9e70669ac5f8f60a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:25.314532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:25.315063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:25.315063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:25.355512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:25.356743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:25.485362 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2638/5262] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:25.495415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:25.495714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:25.495966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:25.569112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:25.575262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:25.623764 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2625/5263] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:25.628226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:25.639865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c22d2-4e8b-4051-9d41-b8f36be4db44 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:25.667322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:25.667957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:25.668231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:25.668494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:25.669188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:30:25.669487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:25.671140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:25.715902 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2639/5264] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:30:25.720769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:25.738800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea71f12-05bb-479c-8983-3b5f15689c48 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:25.748517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:25.749222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:25.749495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:25.749760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:25.755800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:25.758138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:25.871836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2626/5265] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:25 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:25.876097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:25.889876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6c5e-fbe4-4398-a370-8b15d4e07565 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:26.027973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:26.028754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:26.030099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:26.030578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:26.031401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:26.033579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:26.136675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2640/5266] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:25 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:26.141130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:26.182485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73717df-5963-4567-8440-4216bf0a55e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:26.200731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:26.205802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:26.206464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:26.207155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:26.209013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:26.211867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:26.276695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:26.288253 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2627/5267] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:26.295540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f2bc2-70af-428a-916a-161def256ba9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:26.308601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:26.309540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:26.309540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:26.309814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:26.310491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:26.313979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87645fc2-65ed-490f-b869-69b0dbed2b85 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:26.354645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:26.355601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2641/5268] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:26.371775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2005f-8b17-4a01-b6b2-a681db8d9a88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:26.378277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:26.379067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:26.389174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:26.389603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] PATH_INFO: `/v3/projects/ff93b7c3620c46a586b0347aa7115a7c/users/949ef0760cd040ddab99470b2051d245/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:26.438567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff93b7c3620c46a586b0347aa7115a7c, user_id=949ef0760cd040ddab99470b2051d245, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:26.441877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:26.491563 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2628/5269] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:26 2022] PUT /identity/v3/projects/ff93b7c3620c46a586b0347aa7115a7c/users/949ef0760cd040ddab99470b2051d245/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:26.509203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:26.509554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:26.509829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:26.519279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:26.710654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] MFA Rules not processed for user `949ef0760cd040ddab99470b2051d245`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:26.737521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:27.033839 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2642/5270] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:27.107164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:27.109309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:27.118945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:27.253190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddbded-30fb-4a35-b293-d9344e293bc3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:27.264461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:27.265547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:27.266478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:27.266774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:27.279727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:27.281295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:27.306190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2629/5271] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:29.667669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:29.677568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:29.986837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9210f7-de93-4d0e-a7a0-2cb7c408617a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:29.999611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:30.001284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:30.001588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:30.001864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] PATH_INFO: `/v3/users/23622288141c4af2b2dfb82941f3b2e0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:30.006476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23622288141c4af2b2dfb82941f3b2e0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:30.009670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:30.187945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23622288141c4af2b2dfb82941f3b2e0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:30.210230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23622288141c4af2b2dfb82941f3b2e0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:30.216473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23622288141c4af2b2dfb82941f3b2e0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:30.236020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23622288141c4af2b2dfb82941f3b2e0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:30.237757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-53078700-041e-49db-8e14-dccbdfa74c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23622288141c4af2b2dfb82941f3b2e0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:30.281596 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2643/5272] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:30:29 2022] DELETE /identity/v3/users/23622288141c4af2b2dfb82941f3b2e0 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:32.385332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:32.427332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf963-55b3-4bad-a631-9dbadc81522c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:32.676440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:32.683727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:32.684943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:32.685491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] PATH_INFO: `/v3/projects/95e9fcede8164144ba3c05683a2bc44c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:32.689900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e9fcede8164144ba3c05683a2bc44c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:32.694367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:32.881895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e9fcede8164144ba3c05683a2bc44c', 'request_id': 'req-1fdee766-567a-413f-a18e-bba2f06bc2bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:32.905710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e9fcede8164144ba3c05683a2bc44c', 'request_id': 'req-1fdee766-567a-413f-a18e-bba2f06bc2bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:32.957209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e9fcede8164144ba3c05683a2bc44c', 'request_id': 'req-1fdee766-567a-413f-a18e-bba2f06bc2bf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:33.010905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] The token cache is being invalidate because project 95e9fcede8164144ba3c05683a2bc44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:30:33.017296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:33.021591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1fdee766-567a-413f-a18e-bba2f06bc2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:30:33.028823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2630/5273] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:30:32 2022] DELETE /identity/v3/projects/95e9fcede8164144ba3c05683a2bc44c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:33.036160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:33.041397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:33.042151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:33.108908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:33.111504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:33.149814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:33.420373 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2644/5274] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:33.429510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:33.430565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:33.430686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:33.501685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:33.502927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:33.588235 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2631/5275] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:33.594354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:33.669264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaf177-e051-4ed4-aaf0-4c5393669da4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:33.712662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:33.713486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:33.713945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:33.714410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:33.726011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:30:33.726412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:33.741420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:33.824678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:33.834096 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2645/5276] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:30:33.837165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dd70c-2f8d-42e5-830b-f6016b3a2a54 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:33.883181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:33.883944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:33.884222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:33.884500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:33.888361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:33.895158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:34.092192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2632/5277] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:33 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:30:34.095493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:34.147846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8a6ef-6944-4918-8650-0ff99a237f12 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:34.462064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:34.464950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:34.465336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:34.465615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:34.469189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:34.471226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:34.567288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2646/5278] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:34 2022] POST /identity/v3/users => generated 286 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:34.573896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:34.644373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d65d8-b167-4a61-8cda-f8ac67d59ff6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:34.693579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:34.694506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:34.697431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:34.697720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:34.703289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:34.723349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:34.731509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:34.837919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:34.849113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1e64c-15c7-4210-8e42-91dc90fdc8cb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:34.862280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2633/5279] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:30:34.886833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:34.887652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:34.888093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:34.888534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:34.891292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:34.908051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:35.005074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2647/5280] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:35.019240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:35.143792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037713d-4f28-4eb4-b9dc-0efcd4d9aea7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:35.178868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:35.200421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:35.201340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:35.205175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] PATH_INFO: `/v3/projects/7f29daf24c5246769f01a77605400704/users/542988ec50ec4409b03d1620b5d9d23f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:35.275455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:35.279218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:35.403156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f29daf24c5246769f01a77605400704, user_id=542988ec50ec4409b03d1620b5d9d23f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:35.419071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a014207-9ebc-4753-80ca-516a9cb748d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:35.460320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2634/5281] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:35 2022] PUT /identity/v3/projects/7f29daf24c5246769f01a77605400704/users/542988ec50ec4409b03d1620b5d9d23f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:35.489025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709e46-0d75-411b-8b4d-43bac81f060d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:35.490147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709e46-0d75-411b-8b4d-43bac81f060d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:35.490414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709e46-0d75-411b-8b4d-43bac81f060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:35.567448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c165-6587-4406-b611-7ccc23d1f8b5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:35.595484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b709e46-0d75-411b-8b4d-43bac81f060d None None] MFA Rules not processed for user `542988ec50ec4409b03d1620b5d9d23f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:35.599185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b709e46-0d75-411b-8b4d-43bac81f060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:35.642435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:35.743497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:35.744313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:35.744596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:35.745063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:35.750611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:35.870172 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2635/5282] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:30:35.897165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:35.903841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:35.904621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:36.013941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] MFA Rules not processed for user `542988ec50ec4409b03d1620b5d9d23f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:36.021450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:36.036429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:36.040525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:36.090684 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2636/5283] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:36.093692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:36.108406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:36.161817 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2648/5284] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:36.164984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:36.177036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:36.187254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8bc66-4b7f-4242-8524-31bcbfa38fd9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:36.223560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:36.224558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:36.225062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:36.228782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:36.301492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:36.304562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ef1ba-a05f-4b49-9d2e-2827190bd9e3 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:36.381537 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2637/5285] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:36.531088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f797cee-219c-4b4a-8d22-1e38995ad275 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:36.557868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:36.558526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:36.558805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:36.559073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:36.599075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:36.605057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb318a1-bca8-4fc7-831c-3f2d17c5886c service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:36.637424 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2649/5286] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:38.505776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:38.506618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:38.507075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:38.557696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:38.558239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:38.558239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:38.628644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] MFA Rules not processed for user `85ef590207844cc5b5ecb86cc00fc862`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:38.632216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:38.675620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] MFA Rules not processed for user `ed5f927857d54bba9371256669c262f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:38.691557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:38.692296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:38.798523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2650/5287] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:30:38.807040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:38.810572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:38.917893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2638/5288] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:38.940271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:38.964834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:39.090702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51339c-3d48-4031-9536-20a0c4b8c2e1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:39.139571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:39.146319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:39.146319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:39.147147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:39.147446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:39.148110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:39.158220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:39.247383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75a49b-287e-41d9-b749-cfd90585ea31 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:39.251177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2651/5289] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:30:38 2022] POST /identity/v3/projects => generated 373 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:39.251177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:39.444330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:39.449648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:39.450364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:39.451030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:39.507813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d628709-973f-48a9-bbf3-6c6c1d048a9d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:39.522452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:39.525208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:39.525734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:39.526235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:39.527909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:39.531322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:39.574250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2652/5290] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:30:39 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:30:39.580233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:39.595063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066ce1-9a3a-40e8-92d3-d422a99f4011 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:39.619209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:39.620671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:39.621073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:39.621431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:39.623552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:39.628223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:39.692851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:39.699745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:39.733957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2639/5291] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:39.738908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:39.740311 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2653/5292] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:39.775889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfec44-cebd-47d3-a2fe-6f043e155f67 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:39.787501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:39.788524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:39.791863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:39.792449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] PATH_INFO: `/v3/projects/50a8cd3fa01f4e76bad896691591ae5b/users/8e68b5170a7f4b83b4b295cedb610206/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:39.880528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a8cd3fa01f4e76bad896691591ae5b, user_id=8e68b5170a7f4b83b4b295cedb610206, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:39.890531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:39.942486 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2640/5293] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:39 2022] PUT /identity/v3/projects/50a8cd3fa01f4e76bad896691591ae5b/users/8e68b5170a7f4b83b4b295cedb610206/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:39.948804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:39.971828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482d80c-26fd-4ef9-a2fc-1f5fce949975 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:40.042054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:40.130803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:40.131821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:40.132302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:40.132747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:40.133706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:40.135593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:40.175470 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2654/5294] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:30:40.181313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:40.202988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708c4c1-80a5-475f-a11f-5c6c82fb7a66 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:40.226002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:40.226347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:40.226973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:40.227677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] PATH_INFO: `/v3/projects/50a8cd3fa01f4e76bad896691591ae5b/users/8e68b5170a7f4b83b4b295cedb610206/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:40.244305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a8cd3fa01f4e76bad896691591ae5b, user_id=8e68b5170a7f4b83b4b295cedb610206, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:40.247045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:40.303796 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2641/5295] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:30:40 2022] PUT /identity/v3/projects/50a8cd3fa01f4e76bad896691591ae5b/users/8e68b5170a7f4b83b4b295cedb610206/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:30:45.116139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:45.119449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:45.304547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d55a-0493-4224-bbf0-e18f672c65d3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:45.460981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:45.461756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:45.462803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:45.463192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:45.466004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:45.646307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:45.650616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4abc5-2512-4406-a73f-0fc2f0821bdf service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:45.685386 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2655/5296] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:47.722751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:47.726248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:48.056385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd2bd-2ba4-40c4-8bf3-615b6f70e11d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:48.116121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:48.117286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:48.117848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:48.118545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:48.123849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:48.189340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:48.190008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:48.190460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:48.191574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:48.193459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e20d6-b428-4df9-868f-0f0aef78db05 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:48.243048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2642/5297] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:48.250681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] MFA Rules not processed for user `0674cdb0faa64406a58794e68d5e94a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:48.251973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:48.354130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:48.579920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2656/5298] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:48.803211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e47b8-2dd3-4098-a28b-528b2d84efc9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:48.803826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e47b8-2dd3-4098-a28b-528b2d84efc9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:48.803947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e47b8-2dd3-4098-a28b-528b2d84efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:48.931181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0e5e47b8-2dd3-4098-a28b-528b2d84efc9 None None] MFA Rules not processed for user `ed5f927857d54bba9371256669c262f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:48.933281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e5e47b8-2dd3-4098-a28b-528b2d84efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:48.976782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:30:49.255975 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2643/5299] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:52.783288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:52.799420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddc14a-a249-472c-bbb1-e82eed471add None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:52.810869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:52.811798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:52.813044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:52.814035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:52.820873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:52.989945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:52.992570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:53.015081 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2657/5300] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:30:57.229832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:57.230344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:57.230511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:57.374971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] MFA Rules not processed for user `8e68b5170a7f4b83b4b295cedb610206`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:30:57.396636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:57.670902 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2644/5301] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:30:57.689658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:30:57.691402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:30:57.735975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ff05-dec4-4daa-a9bf-e17e527af423 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:30:57.760704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:30:57.761602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:30:57.762430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:30:57.762817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:30:57.904184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:30:57.905826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf65bd-6cbe-4469-8dd1-d794e0dce748 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:30:57.956068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2658/5302] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:30:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:00.914515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:00.933396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b700-9eaa-44e1-961f-bff99099b883 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:00.946824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:00.950543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:00.951204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:00.951728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:00.963431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:01.020257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:01.032391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:01.054418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2645/5303] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:07.921897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=73 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:10.138699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:10.139317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:10.139317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:10.196790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] MFA Rules not processed for user `85ef590207844cc5b5ecb86cc00fc862`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:10.200433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:10.222183 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2659/5304] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:10.788529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:10.789997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:10.813655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988d449-5acf-4d41-a109-dce1704a3a9f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:10.830453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:10.831355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:10.831805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:10.832219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] PATH_INFO: `/v3/users/9d2663d26c42412c8acb3ded09320213` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:10.834447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2663d26c42412c8acb3ded09320213)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:10.841039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:10.945868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2663d26c42412c8acb3ded09320213'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:10.947347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2663d26c42412c8acb3ded09320213'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:10.982841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2663d26c42412c8acb3ded09320213'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:10.989578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2663d26c42412c8acb3ded09320213'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:11.010044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2663d26c42412c8acb3ded09320213'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:11.043701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:11.061860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2646/5305] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:10 2022] DELETE /identity/v3/users/9d2663d26c42412c8acb3ded09320213 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:12.887170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:12.902984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a7e2a-c2e6-47a5-8438-50dae15184f3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:12.925215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:12.927529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:13.054976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:13.056196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.056480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.056755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] PATH_INFO: `/v3/projects/31333817b5a74a6c9bb6cfcfb4ec940a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.060217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31333817b5a74a6c9bb6cfcfb4ec940a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:13.064030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:13.107989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447cd0-a41f-4280-800b-8794597fea99 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:13.119329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:13.121513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.122111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.123221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.126845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:13.156816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:13.159205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c3b00-4716-4d85-af1d-7175be40a56b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:13.175842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31333817b5a74a6c9bb6cfcfb4ec940a', 'request_id': 'req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:13.183498 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2647/5306] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:13.191551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31333817b5a74a6c9bb6cfcfb4ec940a', 'request_id': 'req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:13.208823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31333817b5a74a6c9bb6cfcfb4ec940a', 'request_id': 'req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:13.232190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] The token cache is being invalidate because project 31333817b5a74a6c9bb6cfcfb4ec940a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:13.232722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:13.233593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35ea2ea4-26fb-42db-8d8b-6c1721cfd62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:13.240735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2660/5307] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:12 2022] DELETE /identity/v3/projects/31333817b5a74a6c9bb6cfcfb4ec940a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:13.243595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.243808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.244661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.306904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:13.308167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:13.599941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2648/5308] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:13.607245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.607550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.607831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.660055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:13.664643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:13.685220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2661/5309] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:13.686342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:13.705649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4022f-8d26-42eb-aeaf-7908cc2ae5f1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:13.716419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:13.717839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.718352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.718825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.719724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:13.720845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:13.722758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:13.738261 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2649/5310] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:31:13.743880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:13.759608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4e0b5-d3de-489a-95ee-5c5d915deb04 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:13.769679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:13.771079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:13.771799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:13.772813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:13.773729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:13.776483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:13.844402 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2662/5311] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:13 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:13.850522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:13.878040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7051d9f-8c33-4563-b482-c898dac703a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:14.052928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:14.054216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.054408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.055165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.056066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:14.058252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:14.102412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2650/5312] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:13 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:31:14.106299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:14.137010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaeb11-a806-4367-89b3-35f6f090b16d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:14.145640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:14.146905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.147454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.147957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.149206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:14.152865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:14.174429 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2663/5313] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:14.177962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:14.196428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37abb3-04fc-4143-a786-ad0bb241eedf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:14.202655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:14.203419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.204103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.204466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.205513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:14.207515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9647b-8782-433c-a2fe-41cf67a0ceb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:14.221727 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2651/5314] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:14.225830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:14.242826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b424-958c-41db-8712-6980f1857a39 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:14.263529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:14.264211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.264490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.264756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] PATH_INFO: `/v3/projects/3e44d05280ce4c5bb9c5d734fb2f4608/users/fd456fe2229b49c081abdacf76249918/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.294032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e44d05280ce4c5bb9c5d734fb2f4608, user_id=fd456fe2229b49c081abdacf76249918, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:14.306462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:14.332150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2664/5315] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:14 2022] PUT /identity/v3/projects/3e44d05280ce4c5bb9c5d734fb2f4608/users/fd456fe2229b49c081abdacf76249918/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:14.344058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.345233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.345972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.373354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:14.432178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] MFA Rules not processed for user `fd456fe2229b49c081abdacf76249918`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:14.433433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:14.609020 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2652/5316] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:14.631950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:14.635293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:14.663387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:14.815972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601674-e776-485c-844f-5c53df6ed179 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:14.824123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:14.824786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:14.825043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:14.825316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:14.835255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:14.842188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6887e-bf4a-43c9-b964-2410c96a6120 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:14.863131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2665/5317] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:18.092035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:18.093513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:18.285424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb3aac-f9f4-4f13-adbe-ecb3b8b743bd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:18.301964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:18.302471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:18.302750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:18.303033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] PATH_INFO: `/v3/users/949ef0760cd040ddab99470b2051d245` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:18.309334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949ef0760cd040ddab99470b2051d245)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:18.326516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:18.434577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949ef0760cd040ddab99470b2051d245'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:18.435343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949ef0760cd040ddab99470b2051d245'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:18.455101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949ef0760cd040ddab99470b2051d245'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:18.465191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949ef0760cd040ddab99470b2051d245'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:18.479463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949ef0760cd040ddab99470b2051d245'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:18.564402 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2653/5318] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:18 2022] DELETE /identity/v3/users/949ef0760cd040ddab99470b2051d245 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:18.570180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:18.570686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:18.571392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:18.617035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:18.618490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:19.027695 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2666/5319] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:19.056600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:19.058516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:19.134383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:19.250020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28269-f68b-4d9a-941d-0c943abb0f10 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:19.253303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:19.255036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:19.255036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:19.255036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:19.282750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:19.284320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45935641-48c3-44ae-afac-04e0e55c6251 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:19.309618 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2654/5320] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:20.480364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:20.482434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:20.508711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166437b4-c758-48a0-bb42-1e27bac47358 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:20.524033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:20.524717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:20.525066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:20.525298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] PATH_INFO: `/v3/projects/ff93b7c3620c46a586b0347aa7115a7c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:20.534200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff93b7c3620c46a586b0347aa7115a7c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:20.536162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:20.684577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff93b7c3620c46a586b0347aa7115a7c', 'request_id': 'req-5c611d91-13d4-4b2d-814f-19684de537ab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:20.692875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff93b7c3620c46a586b0347aa7115a7c', 'request_id': 'req-5c611d91-13d4-4b2d-814f-19684de537ab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:20.707292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff93b7c3620c46a586b0347aa7115a7c', 'request_id': 'req-5c611d91-13d4-4b2d-814f-19684de537ab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:20.736906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] The token cache is being invalidate because project ff93b7c3620c46a586b0347aa7115a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:20.737148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:20.737903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c611d91-13d4-4b2d-814f-19684de537ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:20.743615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2667/5321] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:20 2022] DELETE /identity/v3/projects/ff93b7c3620c46a586b0347aa7115a7c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:20.745308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:20.745752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:20.745940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:20.805985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:20.807221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:20.941174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2655/5322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:20.942183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:20.942465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:20.942735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:20.986252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:20.987802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:21.010729 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2668/5323] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:21.012000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.030427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481604b2-d7c6-4b33-8c82-a867467d94ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.062991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.063622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.063903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.064172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.069123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:21.069123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.070569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.108675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.108903 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2656/5324] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:21.124562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e228-ccc6-4579-85be-618b3e7aa239 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.137577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.138298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.139481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.139481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.140396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.145527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.173317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:21.205972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2669/5325] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:21 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:31:21.210138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.234133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53965-a77b-4a42-ac48-39cd6cded18a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.435920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.437086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.437545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.438003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.438878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.440968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.480399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2657/5326] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:21 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:21.485219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.500926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b6b7-2b61-4a31-a9a0-b80ff2d2bc22 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.509032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.509996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.510339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.510715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.511551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.513352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.525815 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2670/5327] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:21.530057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.575446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796037b-b12f-4747-9da9-e04e0f4b1c42 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.596819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.602212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.605185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.608213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.610600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.616143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802e532-2837-426c-9036-ec4b7896baa3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.689739 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2658/5328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:21.693457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:21.715896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974dd79-0a06-418e-b8bc-d88e08318b0f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:21.766094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:21.766879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.767160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.767441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] PATH_INFO: `/v3/projects/cd1cacf40ecb43db80bd38a6da3496d1/users/0bc007edec544fb3a076fec131137d4a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.811876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1cacf40ecb43db80bd38a6da3496d1, user_id=0bc007edec544fb3a076fec131137d4a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:21.814613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:21.834736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2671/5329] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:21 2022] PUT /identity/v3/projects/cd1cacf40ecb43db80bd38a6da3496d1/users/0bc007edec544fb3a076fec131137d4a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:21.845283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:21.845727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:21.845914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:21.891184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] MFA Rules not processed for user `0bc007edec544fb3a076fec131137d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:21.893289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:21.953223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:22.086004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2659/5330] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:22.205849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:22.207746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:22.321840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7c49-6f05-40fe-aa21-46b80781c442 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:22.326054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:22.326525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:22.326809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:22.327081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:22.343918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:22.347049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465af5-b862-4fba-abf1-de99fb47e440 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:22.368543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2672/5331] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:22.733449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:22.735479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:22.904290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0feaf-3045-4aad-982f-2a9319963139 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:22.925318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:22.926270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:22.926696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:22.927114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] PATH_INFO: `/v3/users/fd456fe2229b49c081abdacf76249918` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:22.929824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd456fe2229b49c081abdacf76249918)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:22.932010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:23.091898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd456fe2229b49c081abdacf76249918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:23.092712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd456fe2229b49c081abdacf76249918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:23.116147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd456fe2229b49c081abdacf76249918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:23.118111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd456fe2229b49c081abdacf76249918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:23.153693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd456fe2229b49c081abdacf76249918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:23.206856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2660/5332] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:22 2022] DELETE /identity/v3/users/fd456fe2229b49c081abdacf76249918 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:23.208955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:23.210777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:23.211219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:23.265343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:23.270320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:23.458389 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2673/5333] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:23.502224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:23.504089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:23.632000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:23.790561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b30c-6929-48bc-934a-d1d30719a73b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:23.803625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:23.805852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:23.806436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:23.807716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:23.835721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:23.837739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:23.864860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2661/5334] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:24.456593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:24.458232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:24.480398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9065a-f612-4440-a5a7-6cdec39c75c0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:24.488350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:24.489438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:24.489927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:24.491292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:24.494769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:24.608863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:24.610586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:24.626822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c0c9-4dfb-4aae-8ca2-4287b53a6362 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:24.643588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:24.644517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:24.644793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:24.645098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] PATH_INFO: `/v3/users/08b0514cd6004596969d5d5caf689179` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:24.647372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b0514cd6004596969d5d5caf689179)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:24.649401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:24.701404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:24.710784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:24.716954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:24.745553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b0514cd6004596969d5d5caf689179'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:24.747168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b0514cd6004596969d5d5caf689179'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:24.758318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b0514cd6004596969d5d5caf689179'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:24.759367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b0514cd6004596969d5d5caf689179'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:24.772670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-63d23762-b7a2-4684-938c-2451a0cc8600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b0514cd6004596969d5d5caf689179'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:24.780555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2674/5335] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:24.809122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2662/5336] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:24 2022] DELETE /identity/v3/users/08b0514cd6004596969d5d5caf689179 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:25.002362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:25.003905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:25.048716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc64224-b89c-4a23-8fa2-26ff924030aa service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:25.252649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:25.253481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:25.253865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:25.254240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] PATH_INFO: `/v3/projects/3e44d05280ce4c5bb9c5d734fb2f4608` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:25.256172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e44d05280ce4c5bb9c5d734fb2f4608)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:25.260824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:25.377863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e44d05280ce4c5bb9c5d734fb2f4608', 'request_id': 'req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:25.406426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e44d05280ce4c5bb9c5d734fb2f4608', 'request_id': 'req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:25.430605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e44d05280ce4c5bb9c5d734fb2f4608', 'request_id': 'req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:25.464196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] The token cache is being invalidate because project 3e44d05280ce4c5bb9c5d734fb2f4608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:25.469691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:25.474488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe3bb7d9-e849-4d89-9aeb-06fcfc7167b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:25.478019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2675/5337] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:25 2022] DELETE /identity/v3/projects/3e44d05280ce4c5bb9c5d734fb2f4608 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:25.484550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:25.485132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:25.485447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:25.523581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:25.524409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:25.663066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2663/5338] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:25.671826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:25.672404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:25.672882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:25.706870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:25.708195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:25.725765 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2676/5339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:25.730020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:25.748324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f196c-143b-4571-9fa3-c73c7fe68c03 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:25.757740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:25.758436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:25.758724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:25.759217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:25.760196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:25.760496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:25.764946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:25.795943 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2664/5340] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:25.799804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:25.823258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75f88-9741-4f12-a7fa-58be20dbe449 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:25.836103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:25.837500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:25.837972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:25.838451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:25.839290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:25.846881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:25.915046 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2677/5341] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:25 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:25.919727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:25.948534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf0553-0eb0-4db2-87ac-29f5e62e2a0c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:26.026349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:26.090376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:26.091586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.092203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.092757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.093813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:26.096516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:26.164467 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2665/5342] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:25 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:26.169501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:26.186040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc0366-d9f3-4dde-ba39-29e7c9b7ae68 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:26.203474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:26.204431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.204885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.205331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.206402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:26.208958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:26.244688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2678/5343] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:26.248063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:26.273585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4749d-70d8-40df-904e-22326918e27d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:26.282406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:26.288932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.289318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.289667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.290404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:26.292314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d4b1a-48d2-4991-9965-752f997c8e5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:26.340558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:26.347956 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2666/5344] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:26.357658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486858-e3a0-42f5-b341-1f2810f4ef2e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:26.373670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:26.374447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.374796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.375141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] PATH_INFO: `/v3/projects/2cc1fe651af948d1bd5208d3d10c854b/users/e7300d1107ac4d25919b3a3324d573fd/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.424854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc1fe651af948d1bd5208d3d10c854b, user_id=e7300d1107ac4d25919b3a3324d573fd, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:26.430219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:26.469193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2679/5345] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:26 2022] PUT /identity/v3/projects/2cc1fe651af948d1bd5208d3d10c854b/users/e7300d1107ac4d25919b3a3324d573fd/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:26.486292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.487173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.487763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.535600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] MFA Rules not processed for user `e7300d1107ac4d25919b3a3324d573fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:26.537920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:26.726597 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2667/5346] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:26.732372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:26.796250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:26.956226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23a16-b2e8-4d58-99a3-350306dc414a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:26.981220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:26.983140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:26.985250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:26.993930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:26.995744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:26.997925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.036641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.038718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:27.065257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2680/5347] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:26 2022] POST /identity/v3/projects => generated 369 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:27.080771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.081027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b42ac-1104-4936-b9e7-6f1109d4dfa9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.208196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809211b7-fa13-4a29-8ea3-8c01722d0d75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.216384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.217129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.217493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.217988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.218868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.220873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.247671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.248457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.248903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.249308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] PATH_INFO: `/v3/projects/238c6a4d6aa046c6becaba98873f63fc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.250892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238c6a4d6aa046c6becaba98873f63fc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.253835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.255076 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2681/5348] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:27 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:27.261049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.296133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35918362-d6c0-4da9-a215-33edca5130ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.315196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.316559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.317056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.317520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.318866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.326048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.360502 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2682/5349] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:31:27.361730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.370712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:27.377815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fa15b-02e7-4696-a0c8-62a76b0f72c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.381861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238c6a4d6aa046c6becaba98873f63fc', 'request_id': 'req-a3788a88-8b5c-4604-a582-4fe3f334d126'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:27.397603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238c6a4d6aa046c6becaba98873f63fc', 'request_id': 'req-a3788a88-8b5c-4604-a582-4fe3f334d126'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:27.433675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238c6a4d6aa046c6becaba98873f63fc', 'request_id': 'req-a3788a88-8b5c-4604-a582-4fe3f334d126'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:27.479310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] The token cache is being invalidate because project 238c6a4d6aa046c6becaba98873f63fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:27.479655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:27.486140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a3788a88-8b5c-4604-a582-4fe3f334d126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:27.488823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2668/5350] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:27 2022] DELETE /identity/v3/projects/238c6a4d6aa046c6becaba98873f63fc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:27.503420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69621a-0b1f-4a06-9919-1e4d7f0812e6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.504930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69621a-0b1f-4a06-9919-1e4d7f0812e6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.505252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69621a-0b1f-4a06-9919-1e4d7f0812e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.574266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fa69621a-0b1f-4a06-9919-1e4d7f0812e6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:27.575533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa69621a-0b1f-4a06-9919-1e4d7f0812e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:27.578494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.579924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.580417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.580885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] PATH_INFO: `/v3/projects/24de6707babe4758a7757e99d99785d5/users/def6ddefc95249fa8c6a99ebd802d032/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.611983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2669/5351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:27.613608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.613935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.614384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.626146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24de6707babe4758a7757e99d99785d5, user_id=def6ddefc95249fa8c6a99ebd802d032, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.642042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.670682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:27.672447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:27.676979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2683/5352] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:27 2022] PUT /identity/v3/projects/24de6707babe4758a7757e99d99785d5/users/def6ddefc95249fa8c6a99ebd802d032/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:27.691857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.699598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:27.736183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:27.839511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2670/5353] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:27.840866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.869513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec4f52-f54a-4656-bd7f-5f642613ff5e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.880733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351140-2e7b-46ef-ac85-837b30ca7520 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.880984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.884258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.884579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.885254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.885530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:27.885830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.887440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.893215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.893854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.894135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.894413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.895223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.898598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.921555 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2671/5354] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:27.932955 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2684/5355] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:27.932955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.933302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:27.953836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99637b5-6c0b-4992-b3d7-17420466fc66 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.959797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:27.960728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:27.961036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:27.961319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] PATH_INFO: `/v3/projects/24de6707babe4758a7757e99d99785d5/users/def6ddefc95249fa8c6a99ebd802d032/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:27.963625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24de6707babe4758a7757e99d99785d5, user_id=def6ddefc95249fa8c6a99ebd802d032, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:27.966564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfcca67-20d1-47e1-baee-004af2af2e7d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:27.975592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f39e2f-79ee-4e41-9a5d-d5f31d2d359f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:27.995348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2685/5356] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:27 2022] PUT /identity/v3/projects/24de6707babe4758a7757e99d99785d5/users/def6ddefc95249fa8c6a99ebd802d032/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:28.008833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.009178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.009424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.101974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] MFA Rules not processed for user `def6ddefc95249fa8c6a99ebd802d032`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:28.109142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:28.111648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.112415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.112958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.126675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.127617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.133522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.207454 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2672/5357] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:27 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:28.213218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.381717 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2686/5358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:28.384111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.403117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:28.417423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e473a-478f-4fd6-aa57-5ca1ed0f9763 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.460559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cb36-cabe-4dc1-82d6-1933e29c8002 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.471693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.474253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.474669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.476695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.478668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.482831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.533594 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2673/5359] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:31:28.534432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.556689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfef6-9a40-4eb6-8b4e-5887adc32250 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.564724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.565997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.566718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.566718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.569105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.570958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.573148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.573995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.574421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.574695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.575493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.577176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.607206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2687/5360] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/services => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:28.610403 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2674/5361] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:28.610825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.612006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.637040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cd23-3254-418e-8750-6b1ceabcc5b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.642576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:28.665195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53ae6-9563-464a-ac80-b8e22270a000 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.674385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.675384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.676663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.676934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.677224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.678426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.678962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.679431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.679902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.680535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.682430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.684949 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:28.684949 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:28.684949 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:28.686555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.716004 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2688/5362] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:28.716227 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2675/5363] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:28.717610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.719011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.743410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307604f-5541-4765-aec4-56519de95a5e tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.748836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511b1d-10bd-4bd7-ad3c-78a57c259242 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:28.758005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.758641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.758925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.759205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.764370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.766052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.781967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:28.782499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:28.782835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:28.783107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] PATH_INFO: `/v3/projects/208c8e45649947bca67d44d5403d5b29/users/0b58f6fba7964b09979de5482ef56da3/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:28.822390 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2689/5364] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/services => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:28.823696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.826629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=208c8e45649947bca67d44d5403d5b29, user_id=0b58f6fba7964b09979de5482ef56da3, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:28.829989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:28.832166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:28.875949 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2676/5365] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:28 2022] PUT /identity/v3/projects/208c8e45649947bca67d44d5403d5b29/users/0b58f6fba7964b09979de5482ef56da3/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:28.878773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:28.903027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ace46-be7d-45a8-b7b8-d7dda957877d tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.031895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.032731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.033158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.033541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] PATH_INFO: `/v3/users/542988ec50ec4409b03d1620b5d9d23f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.034867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542988ec50ec4409b03d1620b5d9d23f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:29.039591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:29.044873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb9014-cee1-4f6a-9a91-bd0b59106ddb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.100049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.102102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.102529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.102750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.104614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:29.109222 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:29.109222 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:29.109222 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:29.110517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca7af8-4961-4a95-aa8c-a1a54d44211b tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:29.137653 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2677/5366] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 18 16:31:28 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:29.138951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96b8d-d658-42d9-847f-9d3a23eb9c8c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.139246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96b8d-d658-42d9-847f-9d3a23eb9c8c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.139518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96b8d-d658-42d9-847f-9d3a23eb9c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.192043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542988ec50ec4409b03d1620b5d9d23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:29.212172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-47c96b8d-d658-42d9-847f-9d3a23eb9c8c None None] MFA Rules not processed for user `0b58f6fba7964b09979de5482ef56da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:29.213540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47c96b8d-d658-42d9-847f-9d3a23eb9c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:29.224301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542988ec50ec4409b03d1620b5d9d23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:29.226991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542988ec50ec4409b03d1620b5d9d23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:29.252771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542988ec50ec4409b03d1620b5d9d23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:29.256133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542988ec50ec4409b03d1620b5d9d23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:29.291388 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2690/5367] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:28 2022] DELETE /identity/v3/users/542988ec50ec4409b03d1620b5d9d23f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:29.292421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:29.295846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:29.386800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.398124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:29.420673 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2678/5368] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:29 2022] POST /identity/v3/auth/tokens => generated 3520 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:29.422684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.424048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.424918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.437047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98bdb-4c0d-4992-9431-582eabf6af32 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.444899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.445594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.445879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.446153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.447079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:29.448604 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:29.448604 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:29.448604 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:29.449898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:29.455221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:29.458007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:29.460392 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2691/5369] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:31:29 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:29.461539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:29.464239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:29.546931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2679/5370] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:29 2022] POST /identity/v3/auth/tokens => generated 3507 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:29.548489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:29.566325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e97c4-ef76-4a5e-ba34-e58284a0dd6f tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.574899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.575532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.575807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.576076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.577026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:29.579019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:29.590474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84d05-1ab1-44a1-be20-546f1524e4ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.598148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.599551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.600012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.600447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.601235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dd91da4e23674bfca32cb2985989d865)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:29.602446 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:29.602446 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:29.602446 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:29.603794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:29.613701 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2680/5371] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 18 16:31:29 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865 => generated 333 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:29.614989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:29.617834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:29.636100 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2692/5372] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:29 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:29.636100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:29.727013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462dac-c2ee-49a7-9bc2-672563fa2a0c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:29.898613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:29.900181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:29.905930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:29.909690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:29.993951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd90fe-d934-425e-bcec-e30989a62518 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.032469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.035765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.035765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.036019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.039758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dd91da4e23674bfca32cb2985989d865)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.042411 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:30.042411 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:30.042411 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:30.048948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.066556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:30.074290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2693/5373] 10.222.0.78 () {58 vars in 1291 bytes} [Tue Oct 18 16:31:29 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865 => generated 0 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 16:31:30.074290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.119583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.129546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.161380 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2681/5374] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:29 2022] GET /identity/v3/auth/tokens => generated 3507 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:30.162672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.199323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967be2f-5037-4a5f-86a9-bad0e7fb3580 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.214505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.215214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.215496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.215768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.216381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dd91da4e23674bfca32cb2985989d865)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.217629 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:30.217629 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:30.217629 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:30.218514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.249770 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2682/5375] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:31:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:30.253573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.275690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ddbf5-c899-40f4-b2ee-3d1738a5a548 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.276404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49293a-1844-4009-ac37-a061505984c4 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.291172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.292362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.297590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.297873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.301268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.301595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.301870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.302625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.304979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.308408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.309279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.320833 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:30.320833 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:30.320833 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:30.321839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.332093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2683/5376] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Oct 18 16:31:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:30.339772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.347109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:30.359151 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2694/5377] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:30 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:30.365651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.370379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2a4aa-374a-4559-b97f-40efb8778749 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.383072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1b6c-0b9e-4974-867a-fe9585f7fa4d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.387029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.388143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.389099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.389279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.391474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dd91da4e23674bfca32cb2985989d865)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.393035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.393897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.394541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.394687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.395545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.397679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.402594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.422979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2695/5378] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Could not find Endpoint Group: dd91da4e23674bfca32cb2985989d865.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dd91da4e23674bfca32cb2985989d865. Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 18 16:31:30.428583 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dd91da4e23674bfca32cb2985989d865. Oct 18 16:31:30.429557 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:30.431418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2684/5379] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:31:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dd91da4e23674bfca32cb2985989d865 => generated 120 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:31:30.432566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.436524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.457033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a36598-f613-4518-a2f4-fb13a44f953e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.466286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99faac00-f6f7-4559-9392-9f5f91ec0ad1 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.472496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.473203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.473476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.473742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] PATH_INFO: `/v3/projects/faa4f90b361c41a29e91f8a033941089/users/ae0d03f00f9846b39098d1dc57e63e23/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.487932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.491082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.491920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.492723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services/bb4872678d384a3eac3096a837eef186` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.494099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bb4872678d384a3eac3096a837eef186)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.499272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.513430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa4f90b361c41a29e91f8a033941089, user_id=ae0d03f00f9846b39098d1dc57e63e23, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.516167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.539735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2696/5380] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:30 2022] PUT /identity/v3/projects/faa4f90b361c41a29e91f8a033941089/users/ae0d03f00f9846b39098d1dc57e63e23/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:30.547223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.563224 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2685/5381] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:30 2022] DELETE /identity/v3/services/bb4872678d384a3eac3096a837eef186 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:30.573444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.644962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7a6e8-e76a-43b3-b577-d8f040ff2e32 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.707596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93be66b-0e25-46d2-b455-ff9bcdbc955a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.732670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.733707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.734387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.735234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.736187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.745805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.764729 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2697/5382] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:30.765864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.787670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acbf2d-b92c-44b0-ab2e-ed8ad851eaf3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:30.794162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.795224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.795664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.796043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] PATH_INFO: `/v3/projects/faa4f90b361c41a29e91f8a033941089/users/ae0d03f00f9846b39098d1dc57e63e23/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.799301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa4f90b361c41a29e91f8a033941089, user_id=ae0d03f00f9846b39098d1dc57e63e23, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.802863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.824596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:30.824596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.824596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.825200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.825458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:30.826643 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:30.826643 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:30.826643 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:30.827534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886e904-61d2-4b62-bbff-7e5dae7abbed tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:30.835966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2698/5383] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:30 2022] PUT /identity/v3/projects/faa4f90b361c41a29e91f8a033941089/users/ae0d03f00f9846b39098d1dc57e63e23/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:30.846989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:30.849039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:30.907578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2686/5384] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:30 2022] POST /identity/v3/services => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:30.914190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:30.914190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:30.915038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:30.968082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] MFA Rules not processed for user `ae0d03f00f9846b39098d1dc57e63e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:30.969392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:31.010320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23e99b-6632-4441-b7c5-b011e38ef4d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:31.034478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:31.035315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:31.035510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:31.035802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] PATH_INFO: `/v3/projects/7f29daf24c5246769f01a77605400704` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:31.038886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f29daf24c5246769f01a77605400704)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:31.043219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:31.109063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:31.146465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f29daf24c5246769f01a77605400704', 'request_id': 'req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:31.149124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:31.164413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2687/5385] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3586 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:31.165394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:31.172424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f29daf24c5246769f01a77605400704', 'request_id': 'req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:31.182116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f29daf24c5246769f01a77605400704', 'request_id': 'req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:31.243838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] The token cache is being invalidate because project 7f29daf24c5246769f01a77605400704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:31.244672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:31.246796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:31.259474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2699/5386] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:30 2022] DELETE /identity/v3/projects/7f29daf24c5246769f01a77605400704 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:31.261780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:31.264693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:31.352803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef071db7-ff2e-4c1f-b58a-5fce3e2b6d8f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:31.431265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2eb2b-94f1-4fe8-b3ff-958e5dfc06c5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:31.439175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:31.440340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:31.440766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:31.441277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:31.442094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:31.444751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b19a6-0d46-440a-964f-41c15d18b8ac tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:31.446026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:31.446749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:31.447077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:31.447536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:31.448267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:31.451183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:31.467406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2688/5387] 10.222.0.78 () {60 vars in 1213 bytes} [Tue Oct 18 16:31:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:31.468317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:31.474166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:31.524172 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2700/5388] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:31 2022] POST /identity/v3/projects => generated 350 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:31.526888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:31.532563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:31.534521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:31.595418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:31.601246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:31.788584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f48cb-fd34-4c0a-ae68-930c723b0b89 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:31.861511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:31.875636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2701/5389] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3506 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:31.876594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:31.883550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:32.082042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.082743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.083247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.085294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.088337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:32.108409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:32.114796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.119409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.138887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279dce7-7a7b-4bd1-bc01-bd4c749296dd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.141678 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2689/5390] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:31 2022] GET /identity/v3/auth/tokens => generated 3639 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:32.142559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.146859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.148104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.148623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.149386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.151031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.153690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240733f7-1a8f-43e5-9c81-6c4cd6803a27 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.188803 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2702/5391] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:31 2022] POST /identity/v3/services => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:32.196097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.196755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.197099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.246985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:32.248914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:32.294613 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2703/5392] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3640 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:32.295832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.310298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8367-b4b6-49b6-a449-8bf025d0093d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.326281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdbe0b-dc10-42aa-9d60-f668c037db5c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.332216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.336072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.336646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.337178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3f20fba295fb4a9d8d5ae8a732dbaa2f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.338132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=3f20fba295fb4a9d8d5ae8a732dbaa2f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.339981 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:32.339981 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:32.339981 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:32.341741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.360378 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2704/5393] 10.222.0.78 () {60 vars in 1313 bytes} [Tue Oct 18 16:31:32 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/3f20fba295fb4a9d8d5ae8a732dbaa2f => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:32.361943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.388262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.390148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.390843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.391587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.392102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e8f71-cbe2-4c52-804b-49c02d660b42 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.393789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.414520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.422871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.426741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.427297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.429416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.431838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:32.433969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.442015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.491740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2705/5394] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:32.496858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.541036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2690/5395] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:32 2022] POST /identity/v3/projects => generated 351 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:32.543801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.567992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19556f3c-dfc8-4439-9267-9c4fe17c8f76 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.717781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ab9b-b33a-49cf-a61d-5d16c6c270ad tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.726662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.727683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.728183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.728555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.729434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.732207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.778729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.779386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.779668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.779928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services/fbda605f99604f498790655a80f5f212` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.780759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fbda605f99604f498790655a80f5f212)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:32.781859 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:32.781859 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:32.781859 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:32.782802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:32.783808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2691/5396] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:32 2022] POST /identity/v3/projects => generated 359 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:32.787397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.822804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:32.832510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2706/5397] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:32 2022] DELETE /identity/v3/services/fbda605f99604f498790655a80f5f212 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:32.833523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:32.836252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:32.968152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9638750d-8e97-495d-bc52-6fd3dd538b1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:32.993744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:32.995101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:32.995460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:32.996564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/users/0b58f6fba7964b09979de5482ef56da3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:32.997456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:get_user(user_id=0b58f6fba7964b09979de5482ef56da3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.001513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.004227 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2692/5398] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:31:32 2022] GET /identity/v3/users/0b58f6fba7964b09979de5482ef56da3 => generated 288 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:33.005279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.104173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56ccec-ec45-43b9-8dbe-735fa5e0d447 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.147258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:33.199825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41df71-581f-43d0-80a9-b0dfed2a8c8e tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.225208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.230386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.234656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.234656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.241485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.246092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.284559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.285248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.285532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.285807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.294957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:33.313441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2693/5399] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:33 2022] POST /identity/v3/users => generated 280 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:33.320935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.327463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.328963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.370524 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2707/5400] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3506 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:33.371527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.404608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180ebe-1723-4495-905b-81d6d571906a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.420273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.421709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.422008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.422285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.425216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.427030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.469613 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2708/5401] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 18 16:31:33 2022] POST /identity/v3/credentials => generated 428 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:33.470113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.495595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29b415-2c99-47e5-bf24-3efaba80436b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.502467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3341b-67d8-4747-83c0-af4169659e65 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.510172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.510907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.511204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.511508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.512166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.513989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.529382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.531495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.532136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.532726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3f20fba295fb4a9d8d5ae8a732dbaa2f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.534963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3f20fba295fb4a9d8d5ae8a732dbaa2f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.539459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.555954 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2709/5402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:33.556878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.567233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2694/5403] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:31:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3f20fba295fb4a9d8d5ae8a732dbaa2f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:33.569833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.582665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ca63b-a00c-4483-b831-b948543cb5f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.592279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594809d-e4fb-4803-80dc-8dcb7d4674cd tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.594052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.594702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.594998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.595252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.597753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.599519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.602690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.602905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.604326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.605511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.606181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.606808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.609235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.616658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.635199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2710/5404] 10.222.0.78 () {60 vars in 1358 bytes} [Tue Oct 18 16:31:33 2022] PATCH /identity/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f => generated 436 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:33.636470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.642810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:33.660804 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2695/5405] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:33.663482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.673535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6294aa2-16aa-4036-b283-f0eaa1a79d72 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.696628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab2c1-b294-4a6e-93fe-03372ce70da4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.713563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.715558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.716197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.716570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.717248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.717445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.717609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.717888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services/9bc75f95ac7c4fda96752ff8b4c656a0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.718487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9bc75f95ac7c4fda96752ff8b4c656a0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.720750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.732010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.742920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.762782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2696/5406] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Oct 18 16:31:33 2022] GET /identity/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f => generated 436 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:33.765384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.774793 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2711/5407] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:33 2022] DELETE /identity/v3/services/9bc75f95ac7c4fda96752ff8b4c656a0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:33.775937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.816275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65248-fb13-4007-a02c-b4c449255b67 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.827524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8eddf-9229-4fa5-b947-b9c71d66e45c tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.835554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.836636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.837193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.837814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.840504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.843097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.869470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.870345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.870733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.871026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] PATH_INFO: `/v3/projects/9395f39c0a0145cf83e4fef8bfa01f3b/users/a737a6d36f964d3a892057d08e4fa088/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.873076 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2712/5408] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 18 16:31:33 2022] DELETE /identity/v3/credentials/4902ec47372bcfe697443bae607c1a9d31caaf3a529566810a136e88976fe56f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:33.873999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.900667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16459-99aa-4807-a74c-14299d696ce4 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.906444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:33.907406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:33.907770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:33.908055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/057926fe01d5419f8cdb9cb9d298f46f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:33.908809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=057926fe01d5419f8cdb9cb9d298f46f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.909990 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:33.909990 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:33.909990 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:33.911046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.917481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9395f39c0a0145cf83e4fef8bfa01f3b, user_id=a737a6d36f964d3a892057d08e4fa088, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:33.923983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:33.933525 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2713/5409] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:31:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/057926fe01d5419f8cdb9cb9d298f46f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:33.935723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:33.972266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143f95e-4415-4280-9639-03a09bce35c0 tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:33.994132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2697/5410] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:33 2022] PUT /identity/v3/projects/9395f39c0a0145cf83e4fef8bfa01f3b/users/a737a6d36f964d3a892057d08e4fa088/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:33.994132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:34.114311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f420f-c5b9-4a96-a68b-1bbd35f29ae9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:34.126863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'def6ddefc95249fa8c6a99ebd802d032', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24de6707babe4758a7757e99d99785d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:34.128339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.129627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.130006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] PATH_INFO: `/v3/services/be063b5dc6144222a0bad802876b9ff3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.131612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorizing `identity:delete_service(service_id=be063b5dc6144222a0bad802876b9ff3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:34.133576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7fbf2-1367-4768-a1cf-ea60ee66967a tempest-EndPointGroupsTest-30598591 tempest-EndPointGroupsTest-30598591-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:34.143102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:34.145335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.145335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.145840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.147053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:34.151868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:34.186029 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2698/5411] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:33 2022] DELETE /identity/v3/services/be063b5dc6144222a0bad802876b9ff3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:34.187702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.188044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.188512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.190139 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2714/5412] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 18 16:31:33 2022] POST /identity/v3/credentials => generated 430 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:34.195489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:34.212812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:34.244884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] MFA Rules not processed for user `a737a6d36f964d3a892057d08e4fa088`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:34.247180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:34.264390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:34.434987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625d14-a6a2-43cc-826b-9ea540c5396c tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:34.462834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2699/5413] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:34.463763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:34.482210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:34.482897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.483241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.483546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] PATH_INFO: `/v3/users/e7300d1107ac4d25919b3a3324d573fd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.489355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7300d1107ac4d25919b3a3324d573fd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:34.493833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:34.553315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4099-741e-45ea-b485-2cb2bb640027 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:34.562534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:34.563215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.563486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.563771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.564482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:34.567267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:34.617935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2700/5414] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Oct 18 16:31:34 2022] POST /identity/v3/credentials => generated 429 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:34.622375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:34.632981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7300d1107ac4d25919b3a3324d573fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.639875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd0703-a22a-45ce-be73-74721962b814 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:34.646733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:34.647846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.648477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.649387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] PATH_INFO: `/v3/users/a737a6d36f964d3a892057d08e4fa088` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.651392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7300d1107ac4d25919b3a3324d573fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.652068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a737a6d36f964d3a892057d08e4fa088)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:34.652842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7300d1107ac4d25919b3a3324d573fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.655318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:34.666141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:34.680771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7300d1107ac4d25919b3a3324d573fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.681565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7300d1107ac4d25919b3a3324d573fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.729866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2715/5415] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:34 2022] DELETE /identity/v3/users/e7300d1107ac4d25919b3a3324d573fd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:34.730952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:34.733775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:34.774711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a737a6d36f964d3a892057d08e4fa088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.776930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a737a6d36f964d3a892057d08e4fa088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.792560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a737a6d36f964d3a892057d08e4fa088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.794288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a737a6d36f964d3a892057d08e4fa088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.806465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-007ef17f-9967-4e72-a483-3fc4658229e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a737a6d36f964d3a892057d08e4fa088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:34.888810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2701/5416] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:34 2022] DELETE /identity/v3/users/a737a6d36f964d3a892057d08e4fa088 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:34.900905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7f60-15c4-481d-89b7-3b772eff4fca None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:34.901947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7f60-15c4-481d-89b7-3b772eff4fca None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:34.902392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7f60-15c4-481d-89b7-3b772eff4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:34.926567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ae7-e1b0-4454-bb66-19f840510d57 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:34.970652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e07e7f60-15c4-481d-89b7-3b772eff4fca None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:34.972291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e07e7f60-15c4-481d-89b7-3b772eff4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.030848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:35.076158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2702/5417] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:35.076158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.076566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.076566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.095711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.097450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.098528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.099179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.101154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.103917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.118989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.123454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.129616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.132486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.136555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:35.138352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2716/5418] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Oct 18 16:31:34 2022] GET /identity/v3/credentials => generated 944 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:35.140174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.140632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.142456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.156544 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2703/5419] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:35.156544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.156544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.178508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c718f-b4be-40ad-b0c4-8ad2dc63eae1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.186340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.187121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.187824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.188003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials/f96f98fd2fff21b7551608b91c8d38da6d38c1a14ade45ef414f391962b4c50a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.190679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f96f98fd2fff21b7551608b91c8d38da6d38c1a14ade45ef414f391962b4c50a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.194485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.233128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2704/5420] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 18 16:31:35 2022] DELETE /identity/v3/credentials/f96f98fd2fff21b7551608b91c8d38da6d38c1a14ade45ef414f391962b4c50a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:35.237342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.263228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76221ab0-1035-4ee0-8fc4-759cf9a5b82b tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.265302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bfb2f-c8f8-4bca-9090-07385ac38bb9 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.278080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.278783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.279162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.279543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/credentials/921def9986d90dc78374d8b370fb35073dd04906a6eacfbf4ee645f2245a7db5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.282146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=921def9986d90dc78374d8b370fb35073dd04906a6eacfbf4ee645f2245a7db5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.282506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.283598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.283809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.284235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.284712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.311803 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2705/5421] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Oct 18 16:31:35 2022] DELETE /identity/v3/credentials/921def9986d90dc78374d8b370fb35073dd04906a6eacfbf4ee645f2245a7db5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:35.316496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.322340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.323233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.326123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.358204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2ed04-72be-4c58-a54f-2931ee0b3277 tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.368348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.374269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.374559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.374833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.387124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2717/5422] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:35.387822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.411631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.421110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.436029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744218-0049-42b5-9ab8-25ae245d797d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.457387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.459409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.459842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.459969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/projects/f9593907fc2e4f029e17aa6d3603a2cf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.464128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9593907fc2e4f029e17aa6d3603a2cf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.468324 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2706/5423] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:35.470335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.606813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9593907fc2e4f029e17aa6d3603a2cf', 'request_id': 'req-87709885-76ac-4b8c-a406-a12c3677a8df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.624135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9593907fc2e4f029e17aa6d3603a2cf', 'request_id': 'req-87709885-76ac-4b8c-a406-a12c3677a8df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.633274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9593907fc2e4f029e17aa6d3603a2cf', 'request_id': 'req-87709885-76ac-4b8c-a406-a12c3677a8df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.657235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] The token cache is being invalidate because project f9593907fc2e4f029e17aa6d3603a2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:35.658334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.659273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.661360 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2718/5424] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:35 2022] DELETE /identity/v3/projects/f9593907fc2e4f029e17aa6d3603a2cf => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:35.666546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.686589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a366-f6b5-4d3c-a283-b469b5deabe2 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:35.751605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:35.804829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae0d03f00f9846b39098d1dc57e63e23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'faa4f90b361c41a29e91f8a033941089', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:35.805546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:35.805911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:35.806071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] PATH_INFO: `/v3/projects/cf43336ec6344c9a92dbc3bf8d88603e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:35.807395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf43336ec6344c9a92dbc3bf8d88603e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:35.809362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:35.885999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf43336ec6344c9a92dbc3bf8d88603e', 'request_id': 'req-e3de63aa-7246-405b-a20b-755bcf1a7fbf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.911492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf43336ec6344c9a92dbc3bf8d88603e', 'request_id': 'req-e3de63aa-7246-405b-a20b-755bcf1a7fbf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.920155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf43336ec6344c9a92dbc3bf8d88603e', 'request_id': 'req-e3de63aa-7246-405b-a20b-755bcf1a7fbf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.947045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] The token cache is being invalidate because project cf43336ec6344c9a92dbc3bf8d88603e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:35.947731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.950196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:35.952821 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2707/5425] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:35 2022] DELETE /identity/v3/projects/cf43336ec6344c9a92dbc3bf8d88603e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:35.956947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.958276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:35.962166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:35.964429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.071392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:36.101974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87709885-76ac-4b8c-a406-a12c3677a8df tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:36.104351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de63aa-7246-405b-a20b-755bcf1a7fbf tempest-CredentialsTestJSON-1792815238 tempest-CredentialsTestJSON-1792815238-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:36.113873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:36.115041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.117427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.118091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.121636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.210619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:36.211719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.212047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.212397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] PATH_INFO: `/v3/users/0b58f6fba7964b09979de5482ef56da3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.214476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b58f6fba7964b09979de5482ef56da3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:36.217084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:36.218889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910fcf8-e88b-4e5a-8acf-d40146115bb3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:36.219441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:36.256089 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2708/5426] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:36.295157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b58f6fba7964b09979de5482ef56da3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:36.305931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b58f6fba7964b09979de5482ef56da3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:36.307000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b58f6fba7964b09979de5482ef56da3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:36.317570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b58f6fba7964b09979de5482ef56da3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:36.319197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b58f6fba7964b09979de5482ef56da3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:36.366598 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2719/5427] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:35 2022] DELETE /identity/v3/users/0b58f6fba7964b09979de5482ef56da3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:36.369060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.370500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.371268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.420873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:36.449755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:36.453832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.605115 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2709/5428] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:36.631373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:36.635716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.766335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:36.769849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.786098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6fffb-7570-4e64-95a8-0a810ea49c2d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:36.792452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:36.794763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.795154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.795410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.813163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c5da-fef0-4490-bbf8-7f854fe16cb6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:36.814412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:36.819035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:36.835058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:36.836656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.837255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.837819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] PATH_INFO: `/v3/projects/2cc1fe651af948d1bd5208d3d10c854b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.838850 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2720/5429] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:36.840026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc1fe651af948d1bd5208d3d10c854b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:36.844213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:36.852440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:36.855287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:36.880123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc3da-5f47-4bf3-aaf0-284ec0cb60d8 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:36.893181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:36.895812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:36.898256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:36.898256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] PATH_INFO: `/v3/projects/9395f39c0a0145cf83e4fef8bfa01f3b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:36.901096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9395f39c0a0145cf83e4fef8bfa01f3b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:36.904892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:36.945537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:36.992446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc1fe651af948d1bd5208d3d10c854b', 'request_id': 'req-f9212133-1eba-4364-9005-c80bfffb8721'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.004374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc1fe651af948d1bd5208d3d10c854b', 'request_id': 'req-f9212133-1eba-4364-9005-c80bfffb8721'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.013297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc1fe651af948d1bd5208d3d10c854b', 'request_id': 'req-f9212133-1eba-4364-9005-c80bfffb8721'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.029465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9395f39c0a0145cf83e4fef8bfa01f3b', 'request_id': 'req-5dec1ff6-c71f-4bff-8170-193d8445d8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.035482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] The token cache is being invalidate because project 2cc1fe651af948d1bd5208d3d10c854b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:37.035790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.036855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9395f39c0a0145cf83e4fef8bfa01f3b', 'request_id': 'req-5dec1ff6-c71f-4bff-8170-193d8445d8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.037166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.040714 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2710/5430] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:36 2022] DELETE /identity/v3/projects/2cc1fe651af948d1bd5208d3d10c854b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:37.045551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.049640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:37.051355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9395f39c0a0145cf83e4fef8bfa01f3b', 'request_id': 'req-5dec1ff6-c71f-4bff-8170-193d8445d8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.079977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] The token cache is being invalidate because project 9395f39c0a0145cf83e4fef8bfa01f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:37.080267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.089224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5dec1ff6-c71f-4bff-8170-193d8445d8c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.092345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2721/5431] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:36 2022] DELETE /identity/v3/projects/9395f39c0a0145cf83e4fef8bfa01f3b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:37.104461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab863c-89bf-41a5-8432-559ea0107411 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.104645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab863c-89bf-41a5-8432-559ea0107411 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.104856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab863c-89bf-41a5-8432-559ea0107411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.151863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c6ab863c-89bf-41a5-8432-559ea0107411 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:37.153213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c6ab863c-89bf-41a5-8432-559ea0107411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:37.221386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9212133-1eba-4364-9005-c80bfffb8721 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.281045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2722/5432] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:37.289104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.289754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.290348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.291669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:37.326673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:37.330427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:37.338450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.339094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.339372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.339639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] PATH_INFO: `/v3/users/def6ddefc95249fa8c6a99ebd802d032` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.342014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] RBAC: Authorizing `identity:delete_user(user_id=def6ddefc95249fa8c6a99ebd802d032)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.343968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.344262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2723/5433] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:37.349397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.363483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b578a-9b5c-457b-8ac0-b1f480250cb8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.371640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.372647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.372765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.373705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.374450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:37.375443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.377097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.399755 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2724/5434] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:31:37.400774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.419946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fa56d-7bfe-4f4c-a2f8-6308157f49c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.430194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.431246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.431246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.431468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.432030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.434875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.441343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def6ddefc95249fa8c6a99ebd802d032'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.444199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def6ddefc95249fa8c6a99ebd802d032'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.462354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def6ddefc95249fa8c6a99ebd802d032'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.464128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def6ddefc95249fa8c6a99ebd802d032'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.475095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def6ddefc95249fa8c6a99ebd802d032'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:37.492093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2725/5435] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:37 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:37.493416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.496138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:37.524166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2711/5436] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:37 2022] DELETE /identity/v3/users/def6ddefc95249fa8c6a99ebd802d032 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:37.625506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:37.630770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288234e-ed17-4914-a70e-3b26db2d42fe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.734678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.735823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.736223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.736488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.737586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.740483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.778849 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2726/5437] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:37 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:37.782527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.800802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcdfe-9a37-4689-8930-e6e901e4949b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.816758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.817426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.817693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.818774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.819694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.821666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.835815 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2712/5438] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:31:37.839565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.859383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270ecd-b91d-44c5-b5c7-ddd13eced4f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.871363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.872728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.873255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.873914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.874924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.877250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a9fd1-f992-4bd2-93d5-c6c68d0ebf33 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.903212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2727/5439] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:31:37.907134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:37.921768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e7379-d3f7-42a9-8f2e-e64f5c9bc451 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:37.939482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:37.939482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:37.939772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:37.940046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] PATH_INFO: `/v3/projects/17727477238a4fcb8bb59a58c8822974/users/c79d7ae8b5874ef485e636313e6ce769/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:37.967862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17727477238a4fcb8bb59a58c8822974, user_id=c79d7ae8b5874ef485e636313e6ce769, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:37.971028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:37.990099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2713/5440] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:37 2022] PUT /identity/v3/projects/17727477238a4fcb8bb59a58c8822974/users/c79d7ae8b5874ef485e636313e6ce769/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:38.003731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:38.004030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:38.004888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:38.046470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:38.047870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.082416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] MFA Rules not processed for user `c79d7ae8b5874ef485e636313e6ce769`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:38.086527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.198067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6841e-9915-4549-8652-9708a43a723c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:38.207343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:38.208012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:38.208402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:38.208710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] PATH_INFO: `/v3/users/0bc007edec544fb3a076fec131137d4a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:38.212306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc007edec544fb3a076fec131137d4a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:38.214378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:38.285808 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2728/5441] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:38.288179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:38.300554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:38.308186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.385358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc007edec544fb3a076fec131137d4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.386961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc007edec544fb3a076fec131137d4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.408975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc007edec544fb3a076fec131137d4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.410101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc007edec544fb3a076fec131137d4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.438031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc007edec544fb3a076fec131137d4a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.492535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab0b30-c03f-4bad-9303-731baaa920e9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:38.496834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:38.497678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:38.498054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:38.498448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:38.501297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.507391 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2714/5442] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:38 2022] DELETE /identity/v3/users/0bc007edec544fb3a076fec131137d4a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:38.508539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:38.516093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.519581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:38.520752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:38.524505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559046a-779a-4995-9ee6-58967af9a917 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:38.575032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2729/5443] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:38.578449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:38.578884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:38.579160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:38.648890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:38.650908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.762772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec38194-f03f-45ef-b245-98c01cc4a5a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:38.771999 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2730/5444] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:38.775881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:38.777179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:38.777659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:38.778140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] PATH_INFO: `/v3/projects/208c8e45649947bca67d44d5403d5b29` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:38.780259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=208c8e45649947bca67d44d5403d5b29)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:38.780491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:38.782225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:38.783698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:38.914658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208c8e45649947bca67d44d5403d5b29', 'request_id': 'req-8793d07e-ef71-4dbe-bec8-6c43a79772fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.948118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208c8e45649947bca67d44d5403d5b29', 'request_id': 'req-8793d07e-ef71-4dbe-bec8-6c43a79772fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.973515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208c8e45649947bca67d44d5403d5b29', 'request_id': 'req-8793d07e-ef71-4dbe-bec8-6c43a79772fe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:38.997583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a728e-f5fb-49ac-aea3-454809286f2e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:39.023810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] The token cache is being invalidate because project 208c8e45649947bca67d44d5403d5b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:39.024232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.025726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.027458 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2715/5445] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:38 2022] DELETE /identity/v3/projects/208c8e45649947bca67d44d5403d5b29 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:39.032313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:39.033783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:39.101629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:39.128793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:39.129820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:39.130308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:39.144141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:39.150715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:39.185731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d07e-ef71-4dbe-bec8-6c43a79772fe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:39.212484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:39.214119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:39.218513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:39.220545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:39.220870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:39.221929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] PATH_INFO: `/v3/users/ae0d03f00f9846b39098d1dc57e63e23` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:39.224449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0d03f00f9846b39098d1dc57e63e23)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:39.232135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:39.252446 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2731/5446] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:31:39.426668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0d03f00f9846b39098d1dc57e63e23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.432223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0d03f00f9846b39098d1dc57e63e23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.448288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0d03f00f9846b39098d1dc57e63e23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.449332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0d03f00f9846b39098d1dc57e63e23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.461189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62dc95ec-bc52-4fa3-af42-17b5f1a02fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0d03f00f9846b39098d1dc57e63e23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.491221 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2716/5447] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:39 2022] DELETE /identity/v3/users/ae0d03f00f9846b39098d1dc57e63e23 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:39.549395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:39.552128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:39.583256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178b39a-d53d-4ba2-8c8b-e60a89557175 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:39.732182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:39.743425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:39.745037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:39.745472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:39.745892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] PATH_INFO: `/v3/projects/24de6707babe4758a7757e99d99785d5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:39.747485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24de6707babe4758a7757e99d99785d5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:39.749953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:39.855391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24de6707babe4758a7757e99d99785d5', 'request_id': 'req-5291bbf0-795b-49bd-80e3-daa78903e75e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.866613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24de6707babe4758a7757e99d99785d5', 'request_id': 'req-5291bbf0-795b-49bd-80e3-daa78903e75e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.877008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24de6707babe4758a7757e99d99785d5', 'request_id': 'req-5291bbf0-795b-49bd-80e3-daa78903e75e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.904541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] The token cache is being invalidate because project 24de6707babe4758a7757e99d99785d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:39.905342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.906273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5291bbf0-795b-49bd-80e3-daa78903e75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:39.908607 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2732/5448] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:39 2022] DELETE /identity/v3/projects/24de6707babe4758a7757e99d99785d5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:39.914063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:39.915029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:39.915029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:39.968185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:39.969913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.060627 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2717/5449] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:40.069113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.069675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.070168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.094684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:40.096973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.109369 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2733/5450] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:40.116376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:40.135030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09def2e-c074-42e2-a257-7e6883564a94 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:40.150847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:40.151499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.151828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.152051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.152794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:40.153116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:40.155175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:40.201711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2718/5451] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:40.203283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:40.233427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edfa22-16d6-4278-ae96-9af1a43b29e2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:40.250446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:40.253104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.254410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.255909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.256849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:40.268137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:40.341519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:40.343779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.373328 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2734/5452] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:40.377328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:40.386840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532a14-5fda-469e-b314-9e0f9b6d8c58 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:40.494469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:40.534006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:40.534772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.535264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.535769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] PATH_INFO: `/v3/projects/cd1cacf40ecb43db80bd38a6da3496d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.537843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1cacf40ecb43db80bd38a6da3496d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:40.540213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:40.605677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bbe5-3c9e-4df1-ab5c-f2c3596a959a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:40.611211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1cacf40ecb43db80bd38a6da3496d1', 'request_id': 'req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:40.622895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1cacf40ecb43db80bd38a6da3496d1', 'request_id': 'req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:40.633454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1cacf40ecb43db80bd38a6da3496d1', 'request_id': 'req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:40.659694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] The token cache is being invalidate because project cd1cacf40ecb43db80bd38a6da3496d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:40.660099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:40.660852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9b3e240b-d6d1-4081-b47a-98c70d9a88a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:40.667620 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2719/5453] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:40 2022] DELETE /identity/v3/projects/cd1cacf40ecb43db80bd38a6da3496d1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:40.669468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e453d3-957f-4f8b-b4b1-bbf924b0a212 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.669734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e453d3-957f-4f8b-b4b1-bbf924b0a212 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.670006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e453d3-957f-4f8b-b4b1-bbf924b0a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.699694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-86e453d3-957f-4f8b-b4b1-bbf924b0a212 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:40.701347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-86e453d3-957f-4f8b-b4b1-bbf924b0a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.806255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:40.807024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.807604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.808163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.809289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:40.813318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:40.848544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:40.879435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2735/5454] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:40 2022] POST /identity/v3/users => generated 287 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:40.885420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:40.897994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.906229 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2720/5455] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:40.914321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.915281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.915281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.966983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7bd0a-2396-4712-8f29-e95cabc2d30f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:40.985356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:40.985798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:40.986152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:40.986484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:40.986746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:40.986876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:40.987458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:40.999401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.012672 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2721/5456] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:31:41.016851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.033065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be79f-ac1b-4339-8679-6316c2066365 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.035568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2736/5457] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:41.041345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.047999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.048636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.048915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.049236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.050048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:41.050958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.056171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.068621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205115-d25b-41eb-b8c4-157db201bc69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.087262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2722/5458] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:31:41.091859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.098973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.100278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.100594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.100802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.101494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.103118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.132484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1063e3-71b6-4e12-86ec-5f1c0d55a92f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.144067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2737/5459] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:41.145640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.151214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.151845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.152124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.152396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.153071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.158895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.180953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9cf0c-80bf-405a-a51c-55025abc0ab2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.198895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.199584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.199879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.200140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] PATH_INFO: `/v3/projects/8edb12451e1f418281aaeeba678121d7/users/9c2bd6d456554cdba912a42b33543efc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.225227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edb12451e1f418281aaeeba678121d7, user_id=9c2bd6d456554cdba912a42b33543efc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.228732 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2723/5460] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:41 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:41.232405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.232780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380eb97-cbc6-44e3-9f41-55654d0509d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.273979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2738/5461] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:41 2022] PUT /identity/v3/projects/8edb12451e1f418281aaeeba678121d7/users/9c2bd6d456554cdba912a42b33543efc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:41.284962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.285475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.285660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.330029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] MFA Rules not processed for user `9c2bd6d456554cdba912a42b33543efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:41.331013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:41.336347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:41.433035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d953-6737-4fca-b792-0863783359e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.574343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.575447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.575924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.576409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.577992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.581222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.604138 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2739/5462] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:41.606283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.610486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:41.615179 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2724/5463] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:41 2022] POST /identity/v3/users => generated 287 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:41.616449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.635704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f124-5a00-45ea-808f-d5717736e296 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.642518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.643530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.644082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.644584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.645964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.648822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.677809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bedc66-f725-4a2a-b335-f2f1cd9faf90 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:41.699036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:41.699612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:41.700511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:41.700511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] PATH_INFO: `/v3/projects/faa4f90b361c41a29e91f8a033941089` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:41.701643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa4f90b361c41a29e91f8a033941089)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:41.703599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:41.763151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2725/5464] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:41 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:41.764153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.845801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa4f90b361c41a29e91f8a033941089', 'request_id': 'req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:41.869744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa4f90b361c41a29e91f8a033941089', 'request_id': 'req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:41.889265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa4f90b361c41a29e91f8a033941089', 'request_id': 'req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:41.917611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] The token cache is being invalidate because project faa4f90b361c41a29e91f8a033941089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:41.917951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:41.919308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:41.927790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2740/5465] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:41 2022] DELETE /identity/v3/projects/faa4f90b361c41a29e91f8a033941089 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:41.933849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:41.938024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:42.000711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92496-32c3-475f-85b0-e42b72dd476b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.057240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:42.170892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:42.181110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1dbac-b7c3-453b-9803-1461e4c0c5fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.187216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.187861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.188241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.188526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.189608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.192061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ee1bd-ce5a-478e-aa90-17569d016b6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.233766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.242769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.243953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.244419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.249228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.256421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.257712 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2741/5466] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:41 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:42.263733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.264096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.264406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.301612 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2726/5467] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:42.303996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:42.340075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:42.342916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:42.348816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2973a9-afd7-487c-a756-49316a4819d6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.368861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2742/5468] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:42.370009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:42.371652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:42.376258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.378873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.379715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.381380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.383756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.389023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b196ad-31a3-4419-bafd-4f3de30c4281 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.390646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b00c2-e1cb-44d2-8e26-9bcfbdaa0a4f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.404787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.408329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.410893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.412337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.414731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.425558 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2727/5469] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:42.429792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.430730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.431513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.463600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.529493 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2743/5470] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:42.533532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:42.546249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:42.548104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:42.580246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2728/5471] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:42.581189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:42.612206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4436e4b-57bf-41bc-8461-c3b02c014444 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.613049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aec93-2bc8-4b80-b1dd-6ce91d0a044c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.626218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.628687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.629247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.632215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] PATH_INFO: `/v3/projects/20397a84caf44c0ea12819dd94b0cfdc/users/e854934ad7a14e75a2845ccf391d4252/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.640602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:42.646698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.646911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.647245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] PATH_INFO: `/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552/users/b4afae07148b4191bd0277d025a52143/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.678915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20397a84caf44c0ea12819dd94b0cfdc, user_id=e854934ad7a14e75a2845ccf391d4252, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.687432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.708078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83c474e0d6d4e4a9edf023fdc4da552, user_id=b4afae07148b4191bd0277d025a52143, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:42.714447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701813d-935d-4f75-b07b-3ff00982a846 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:42.721306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2729/5472] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:42 2022] PUT /identity/v3/projects/20397a84caf44c0ea12819dd94b0cfdc/users/e854934ad7a14e75a2845ccf391d4252/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:42.722530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:42.801574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2744/5473] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:42 2022] PUT /identity/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552/users/b4afae07148b4191bd0277d025a52143/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:42.810588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:42.811252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:42.812004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:42.913031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d7b3-4af5-4858-9701-01bd05ba1679 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:42.937203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] MFA Rules not processed for user `e854934ad7a14e75a2845ccf391d4252`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:42.940012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:43.114641 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2745/5474] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:43.116141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.153880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.157679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.159354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.160005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.163119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:43.163749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.167227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:43.199119 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2730/5475] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:43.201328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.233270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0106-814d-4b43-b1bc-68a230eb5e76 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:43.245973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.246925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.247414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.247887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.248739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.254592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:43.321512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2731/5476] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:43 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:43.323690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.346352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:43.355743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01c587-49a8-4068-8037-f3e8089e9c4f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:43.431956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:43.550417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.551058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.551337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.551611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.552330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.554069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:43.568199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2746/5477] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:43.572615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.591889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c827ebd-239f-413c-8a5f-b4732dd5bd9a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:43.603750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f4d4-7992-47cf-8a96-d76facffacc8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:43.610999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.613220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.619091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.621507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.623547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.628599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:43.629147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.629936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.636150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.636622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.639461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.648657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:43.737574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2747/5478] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:43 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:43.741678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.747432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:43.754548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2732/5479] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:43 2022] POST /identity/v3/projects => generated 367 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:43.757476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:43.947204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54e9f-3d99-49c5-a485-5d3110b237f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:43.969559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:43.972161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:43.972693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:43.973232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] PATH_INFO: `/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552/users/b4afae07148b4191bd0277d025a52143/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:43.983684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83c474e0d6d4e4a9edf023fdc4da552, user_id=b4afae07148b4191bd0277d025a52143, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:43.987057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.018225 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2733/5480] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:43 2022] PUT /identity/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552/users/b4afae07148b4191bd0277d025a52143/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:44.020138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.121166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758eac-c959-4662-9924-434d0d540c54 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.251467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed24d9-b8bc-4eca-a8e6-18475ceaab4e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.274744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.275400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.275678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.275947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.276600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.278241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.294827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.296415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.297318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.297921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.304716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:44.305523 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2734/5481] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:44.306473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.333026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a02f0-7e68-4656-ad32-85c8fb46e02a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.344630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.344824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.345894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.345894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.345894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.346529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.348439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.349596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd2fe-701f-4503-a961-4618ee02f5e7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.368060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:44.384083 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2748/5482] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:44.399689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2735/5483] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:44 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:44.399868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.400026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.400189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.400189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.418622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e3e6-f949-4703-ad5e-1581c427542d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.438721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.439362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.439639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.439909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] PATH_INFO: `/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506/users/1c6d7a624a09431180f2b8404e2ba056/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.454890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] MFA Rules not processed for user `b4afae07148b4191bd0277d025a52143`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:44.456144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:44.470842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dc339d4de04b818f4dfc3f4e14a506, user_id=1c6d7a624a09431180f2b8404e2ba056, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.484596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.489635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:44.509052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2736/5484] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:44 2022] PUT /identity/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506/users/1c6d7a624a09431180f2b8404e2ba056/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:44.510137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.685572 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2749/5485] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:44.686510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.702569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656281-0455-453b-8a08-0f3d1ac04fcf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.719441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.720689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.721494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.722105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.723037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.726968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.743556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397a036-8867-405d-a4db-dd2539ebd1fb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.759920 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2737/5486] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:44.762282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.777188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.777868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.780178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.780522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.781769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.785725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.814440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2750/5487] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:44.816494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.857754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c33b3-0b6a-4cc2-905c-2727c0c23630 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.873987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.874856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.881418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.881946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.883109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.888881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.949049 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2751/5488] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:44.951238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:44.952794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cbc7d-2cf2-4c98-a6c7-ee38431e0557 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.966581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2d22-f963-4aff-9c17-281060408a86 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:44.968776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.969548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.970031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.970468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.971301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.971996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:44.972746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:44.974099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:44.974099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] PATH_INFO: `/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506/users/1c6d7a624a09431180f2b8404e2ba056/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:44.974417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464d4e-7b0b-4124-b3bf-d5607b1c4ca2 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.977439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dc339d4de04b818f4dfc3f4e14a506, user_id=1c6d7a624a09431180f2b8404e2ba056, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:44.980562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:44.996532 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2752/5489] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:44 2022] PUT /identity/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506/users/1c6d7a624a09431180f2b8404e2ba056/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:44.997544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:45.047165 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2738/5490] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:31:44 2022] POST /identity/v3/domains => generated 277 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:45.053038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:45.053332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:45.053609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:45.172956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] MFA Rules not processed for user `1c6d7a624a09431180f2b8404e2ba056`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:45.174271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:45.262962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f304-a7d6-4dcd-81d4-1c7697f770ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:45.403961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:45.424484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:45.425288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2739/5491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:45.428351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:45.430674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:45.430966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:45.431245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] PATH_INFO: `/v3/projects/4c48f7f9d366492899672e4af1f8e667/users/bb4ed5a00f0e4a108ae2bf71422b5e0b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:45.464938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:45.468858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c48f7f9d366492899672e4af1f8e667, user_id=bb4ed5a00f0e4a108ae2bf71422b5e0b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:45.471984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:45.506517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2753/5492] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:44 2022] PUT /identity/v3/projects/4c48f7f9d366492899672e4af1f8e667/users/bb4ed5a00f0e4a108ae2bf71422b5e0b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:45.507501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:45.522046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:45.615141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f567-2f66-43e1-8fa2-96537981140a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:45.775097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c906fc4-92e7-4892-bf3c-1ea6eb21acac admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:45.789973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:45.790617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:45.794402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:45.796050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:45.799218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:45.799848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:45.800128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:45.800400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:45.801129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:45.803515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9338a29-1754-44de-8228-6e03b3033b8f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:45.936801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2740/5493] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:45 2022] POST /identity/v3/projects => generated 402 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:45.942441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:45.942762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:45.943193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:45.998614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.000520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.019868 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2754/5494] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:46.020727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.033619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6f22e-eca6-4e69-b4ba-488d88473152 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.183479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.185139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.185659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.185954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.187423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.192725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.197089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] MFA Rules not processed for user `bb4ed5a00f0e4a108ae2bf71422b5e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:46.200534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:46.230132 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2755/5495] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:31:46 2022] POST /identity/v3/groups => generated 301 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:46.235240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.267630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd044234-3693-490b-b96d-b7f987bea778 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.287207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.287997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.289146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.289486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.290248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.294551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.345781 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2756/5496] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:46 2022] POST /identity/v3/users => generated 442 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:46.347435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.363246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:46.414725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2741/5497] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:46.416471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.439408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f2d25-51f5-4931-9e11-87269f042eac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.449936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.450955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.451441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.452090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.453210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.455030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.482112 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2742/5498] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:46 2022] POST /identity/v3/roles => generated 239 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:46.483581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.503588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736cb69-7b71-4704-a6a4-ab196a642d75 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.517552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.518306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.518583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.519025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.541629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:46.652592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bdb46-989d-491c-8cdd-8ea298192e27 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.663815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.665312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.665714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.666144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.669124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.671532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.672978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.673305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.700729 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2757/5499] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:46.701689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.727137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12733c1-433c-4b81-99cd-0180feb5e884 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:46.738840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:46.739681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:46.740185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:46.740614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:46.747026 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2743/5500] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:46 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:46.752721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:46.756351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c6b6385d793d40ee869e6780865648c6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=853ceebecaf340b5b0b35f29a8088bb2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:46.764289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:46.793923 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2758/5501] 10.222.0.78 () {60 vars in 1585 bytes} [Tue Oct 18 16:31:46 2022] PUT /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:46.803779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:47.001752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e4b0e-a3db-4ec7-bb35-56dd99ba752d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:47.058036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c24e1b-0db9-4725-95c1-b90457ef879e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:47.081744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:47.082960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:47.083528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:47.084200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:47.088459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c6b6385d793d40ee869e6780865648c6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=853ceebecaf340b5b0b35f29a8088bb2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:47.089994 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:47.089994 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:47.089994 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:47.096231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:47.106673 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2759/5502] 10.222.0.78 () {58 vars in 1567 bytes} [Tue Oct 18 16:31:46 2022] HEAD /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:47.124631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:47.143387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76d8d-83f4-4a81-b869-0999ef2f4975 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:47.153335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:47.155062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:47.155414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:47.155942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:47.160466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c6b6385d793d40ee869e6780865648c6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=853ceebecaf340b5b0b35f29a8088bb2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:47.162530 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:47.162530 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:47.162530 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:47.167942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:47.187945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:47.188901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:47.189441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:47.189914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:47.191002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:47.193969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:47.206458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 853ceebecaf340b5b0b35f29a8088bb2 was removed from group e998dfc86e4f49b3814636d0866678a9 on project c6b6385d793d40ee869e6780865648c6. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:47.209585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:47.213822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:47.292577 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2760/5503] 10.222.0.78 () {58 vars in 1569 bytes} [Tue Oct 18 16:31:47 2022] DELETE /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/groups/e998dfc86e4f49b3814636d0866678a9/roles/853ceebecaf340b5b0b35f29a8088bb2/inherited_to_projects => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:47.304397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:47.315275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:47.321896 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2744/5504] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:46 2022] POST /identity/v3/users => generated 292 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:47.326278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:47.333872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:47.395253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285634-6ebc-46f3-97c7-1a5f574a494e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:47.474762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:47.644184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:47.827045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9cf7f-8a23-43c9-b86e-038b41c61866 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:47.865919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:47.873123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:47.873557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:47.877294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/853ceebecaf340b5b0b35f29a8088bb2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:47.904905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:47.906021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:47.906513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:47.910940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=853ceebecaf340b5b0b35f29a8088bb2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:47.935332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:47.937118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:47.941461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:47.954287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.025258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2745/5505] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:47 2022] GET /identity/v3/roles => generated 1650 bytes in 698 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:48.027283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.113730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371768da-31d1-4528-a27e-893a2fb7ae99 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.129914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.133203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.133528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.134470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] PATH_INFO: `/v3/projects/e6421f76db274579bff28254b7a3cab8/users/5e2d77633ac34890bdb26008e058aa54/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.138824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 853ceebecaf340b5b0b35f29a8088bb2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:48.139122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.140427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.148317 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2761/5506] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:47 2022] DELETE /identity/v3/roles/853ceebecaf340b5b0b35f29a8088bb2 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:48.149386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.160721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:48.173355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6421f76db274579bff28254b7a3cab8, user_id=5e2d77633ac34890bdb26008e058aa54, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.178888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.210892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2746/5507] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:48 2022] PUT /identity/v3/projects/e6421f76db274579bff28254b7a3cab8/users/5e2d77633ac34890bdb26008e058aa54/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:48.232291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.236423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:48.363872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1bc6-e8e9-4ced-8c23-352dbf42766c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.434944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc1fa-3d8e-4063-b280-22116aa478c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.448767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.450153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.450593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.451185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.452873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.455983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.466602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.467413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.467768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.468168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.470363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.472758 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:48.472758 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:48.472758 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:48.475300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.488274 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2747/5508] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:48.490100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.495874 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2762/5509] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:48 2022] POST /identity/v3/roles => generated 240 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:48.501180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.515174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195542f-6b19-4667-8615-abcb88ec5df7 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.524422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.525212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ff98-4401-4700-87f8-0a38bcba776a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.525515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.525897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.526397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.539831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.541309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.541746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.542216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] PATH_INFO: `/v3/projects/e6421f76db274579bff28254b7a3cab8/users/5e2d77633ac34890bdb26008e058aa54/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.547873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6421f76db274579bff28254b7a3cab8, user_id=5e2d77633ac34890bdb26008e058aa54, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.559220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c6b6385d793d40ee869e6780865648c6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=eb419e0a107d4637a260fd9eeaf87793)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.563939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.567307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.587851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2763/5510] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 18 16:31:48 2022] PUT /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:48.592282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.613170 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2748/5511] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:48 2022] PUT /identity/v3/projects/e6421f76db274579bff28254b7a3cab8/users/5e2d77633ac34890bdb26008e058aa54/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:48.613170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:48.616876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:48.622908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:48.728560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479efec-e735-4c30-b7a3-5f6137841f11 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.747320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a06bd0-c513-4ff1-ae37-1aff686a5e79 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:48.752386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.753145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.753493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.753883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] PATH_INFO: `/v3/users/a51c470236904eb0a85bfee1703d3c71` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.756144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51c470236904eb0a85bfee1703d3c71)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.758836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.848090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:48.886920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51c470236904eb0a85bfee1703d3c71'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.888429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51c470236904eb0a85bfee1703d3c71'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.910167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51c470236904eb0a85bfee1703d3c71'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.911575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51c470236904eb0a85bfee1703d3c71'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.914939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:48.916377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.917271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.917993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:48.925422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51c470236904eb0a85bfee1703d3c71'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:48.925812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c6b6385d793d40ee869e6780865648c6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=eb419e0a107d4637a260fd9eeaf87793)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:48.934873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32821908-bb7c-4ef2-812c-8956e3fa9704 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:48.956389 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2764/5512] 10.222.0.78 () {58 vars in 1564 bytes} [Tue Oct 18 16:31:48 2022] HEAD /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:48.967326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:48.967806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:48.968262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.022929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2749/5513] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:48 2022] DELETE /identity/v3/users/a51c470236904eb0a85bfee1703d3c71 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:49.034255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.043167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] MFA Rules not processed for user `5e2d77633ac34890bdb26008e058aa54`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:49.045529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.048332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.199964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44ca44-c9be-469f-8da1-bc0b2d31bd7e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:49.207825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:49.209243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:49.209587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:49.209900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.212754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c6b6385d793d40ee869e6780865648c6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=eb419e0a107d4637a260fd9eeaf87793)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:49.214161 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:49.214161 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:49.214161 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:49.216632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:49.242024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role eb419e0a107d4637a260fd9eeaf87793 was removed from user cc3945442a424720a1e20d4a65ae926c on project c6b6385d793d40ee869e6780865648c6. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:49.242392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:49.244228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:49.265345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2765/5514] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:49.267325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2750/5515] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 18 16:31:49 2022] DELETE /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/eb419e0a107d4637a260fd9eeaf87793/inherited_to_projects => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:49.270420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.274530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.279135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.286081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100d540-0526-457c-8ef7-747c289b7734 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:49.400164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:49.409121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced02d6-d540-4d6b-b145-f3b6968dfab5 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:49.426106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:49.429196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:49.430068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:49.431420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/eb419e0a107d4637a260fd9eeaf87793` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.443826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb419e0a107d4637a260fd9eeaf87793)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:49.445961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:49.462763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:49.464395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:49.465782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:49.466626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.468137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:49.472258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:49.510435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2766/5516] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:49 2022] POST /identity/v3/services => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:49.515229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.517597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.542934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role eb419e0a107d4637a260fd9eeaf87793 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:49.543568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:49.546241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:49.551210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2751/5517] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:49 2022] DELETE /identity/v3/roles/eb419e0a107d4637a260fd9eeaf87793 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:49.561401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.564729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.583789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:49.589959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa465e-ecee-4eb6-9101-cf70a165d585 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:49.734174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:49.735477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:49.735996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:49.736503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.738345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:49.745818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:49.765193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f990ae5-4340-406f-9a5c-0935a07f95ba tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:49.791682 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1959540100. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:49.791682 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:49.791682 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:49.868601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:49.869382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:49.869697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2767/5518] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:49 2022] POST /identity/v3/endpoints => generated 361 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:49.872731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.874326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:49.874600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:49.875312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:49.877687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:49.878289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.938949 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2752/5519] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:49 2022] POST /identity/v3/roles => generated 240 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:31:49.940068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:49.943986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:49.982462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be0b3-8917-4c7f-94f8-ec8e42b2419d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.030203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.031976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.031976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.031976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1959540100` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.031976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1959540100)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.033124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.037085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2753/5520] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:31:49 2022] GET /identity/v3/regions/tempest-region-1959540100 => generated 180 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:50.041569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.102340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509c068-0d4b-412d-8a01-5417684c73ae tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.109651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.110769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.111125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.111405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.116828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb342384-fbc2-48b6-b4a7-91c5a8375d16 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.128031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.129124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.129468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.129759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] PATH_INFO: `/v3/projects/f7edbad9c1fb4c1a823575d5b5c6cd08` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.130890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=e50f54c01fff41ad8cc7b891327be871)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.133199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7edbad9c1fb4c1a823575d5b5c6cd08)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.135357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.139462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.201036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2754/5521] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 18 16:31:50 2022] PUT /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:50.201036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.213580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:50.306846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'request_id': 'req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:50.346259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'request_id': 'req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:50.374696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7edbad9c1fb4c1a823575d5b5c6cd08', 'request_id': 'req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:50.436727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] The token cache is being invalidate because project f7edbad9c1fb4c1a823575d5b5c6cd08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:50.438774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:50.445562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:50.455047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2768/5522] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:49 2022] DELETE /identity/v3/projects/f7edbad9c1fb4c1a823575d5b5c6cd08 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:50.460770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.464326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:50.484281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8579bf1-04c4-46dc-b0b7-b031cde008a9 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.633658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa809d9-d960-43a7-ae37-7ce7d9a43ab6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.648204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.649038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.649765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.650047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.651287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.652741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ef058-87ce-450d-9344-404434cd1be1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.654292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.655982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.656279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.656663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.657358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:50.659006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f384ea4d00394ae8a45b36ea29275fd6, group_id=e998dfc86e4f49b3814636d0866678a9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.660658 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:50.660658 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:50.660658 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:50.667560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.683602 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2755/5523] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:50 2022] POST /identity/v3/services => generated 288 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:50.685286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.685861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.686180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.700014 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2769/5524] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 18 16:31:50 2022] GET /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/inherited_to_projects => generated 448 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:50.700014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.700014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:50.725162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:50.725487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec668d-246b-4cba-91d7-4c36a415bf85 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.726193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:50.757032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.758111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.758690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.759372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.761359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.766493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.806984 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-181340201. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:50.806984 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:50.806984 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:50.865759 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2770/5525] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:50 2022] POST /identity/v3/endpoints => generated 360 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:50.865759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.879056 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2756/5526] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3869 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:50.881878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:50.884813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:50.923553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e066507-27c9-4231-a5e9-ff62a45360a7 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:50.953605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:50.954806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:50.955603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:50.956091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:50.961246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=e50f54c01fff41ad8cc7b891327be871)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:50.964498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:50.995384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2771/5527] 10.222.0.78 () {58 vars in 1564 bytes} [Tue Oct 18 16:31:50 2022] HEAD /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:50.995384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.027047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6827ea-b4da-4911-9b41-955c1a77625d tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.032432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.033090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.033370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.033640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-181340201` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.034224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-181340201)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.035434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb94a-699e-4213-bd7a-f2cd0cc2b3b8 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.044270 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2772/5528] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:31:50 2022] GET /identity/v3/regions/tempest-region-181340201 => generated 178 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:51.044270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.044270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.044270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.066628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:51.068159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.085934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6486a2-ed5f-4901-9ba9-4b85acbbb40a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.090586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2773/5529] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3869 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:51.091504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.109024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ad7a-d519-4d29-bf3e-d50b48e93f48 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.114043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.115503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.116085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.116431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.119241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, group_id=e998dfc86e4f49b3814636d0866678a9, role_id=e50f54c01fff41ad8cc7b891327be871)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.122259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.124811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.125752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:51.125898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.126206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.127813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.130619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role e50f54c01fff41ad8cc7b891327be871 was removed from group e998dfc86e4f49b3814636d0866678a9 on domain f384ea4d00394ae8a45b36ea29275fd6. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:51.131412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:51.132032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.132671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:51.156850 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2774/5530] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 18 16:31:51 2022] DELETE /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/groups/e998dfc86e4f49b3814636d0866678a9/roles/e50f54c01fff41ad8cc7b891327be871/inherited_to_projects => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:51.156850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.158918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.160044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.163436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.183961 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2757/5531] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:50 2022] GET /identity/v3/auth/tokens => generated 3938 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:51.185144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.197364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83cb44-e49d-4d7d-9bff-b6b898ee27c4 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.289746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:51.300703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.302827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.303616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.307944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.309023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:51.309529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.311641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.324513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd357e-7607-495e-b60e-c328bff4be88 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.329883 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2758/5532] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:51.333988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.333988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.334462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.335527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.336039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.336468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.337443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.343908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.368291 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1747274795. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:51.368291 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:51.368291 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:51.407471 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2775/5533] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:51 2022] POST /identity/v3/endpoints => generated 361 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:51.407471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.409418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.451158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eae4dc-b54c-42e9-98f1-fcc899704913 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.457555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.459619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.459914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.460323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.461129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.463382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.517525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5d90-3756-4582-a0f9-c7c370240a02 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.520314 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2776/5534] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:51 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:51.521857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.672218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.674725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.675833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.677743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/e50f54c01fff41ad8cc7b891327be871` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.680765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e50f54c01fff41ad8cc7b891327be871)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.687271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.728607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ecc10-77a0-45dd-b860-539f4d6a296b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.749415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.750181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.750533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.750880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1747274795` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:51.752228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1747274795)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:51.753629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:51.756793 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2777/5535] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:31:51 2022] GET /identity/v3/regions/tempest-region-1747274795 => generated 180 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:51.757593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.810878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role e50f54c01fff41ad8cc7b891327be871 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:51.811173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:51.811864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:51.815499 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2759/5536] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:51 2022] DELETE /identity/v3/roles/e50f54c01fff41ad8cc7b891327be871 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:51.816447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:51.824508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:51.834049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:51.935311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abae84-3c5c-4e51-a72f-71ab44b3d8bd tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.969921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:51.975308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f5966-869f-4d50-9689-90db2a272956 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:51.995281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:51.996008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:51.996314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:51.996642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.000321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.001950 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:52.001950 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:52.001950 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:52.003107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.061667 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2760/5537] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:31:51 2022] GET /identity/v3/endpoints => generated 4396 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:52.067107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.069614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.070795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.071290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.071768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.072659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.075495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.078023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:52.117739 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2778/5538] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:31:51 2022] POST /identity/v3/users => generated 287 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:52.120076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.166998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4584f-f39d-4de0-900f-edea628b6ccb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.183071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.184058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.184452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.184873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.199537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=2b08357975c740f6a83e2c72391bd2cb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.200409 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:52.200409 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:52.200409 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:52.201573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.207911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2779/5539] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:52 2022] GET /identity/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb => generated 361 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:52.210884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.218937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:52.246306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1629cc-aaf5-473f-a3a9-9e9426cde262 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.258178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.259099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.259445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.259726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.260508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.262279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.275716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c28b-a306-4f05-b66e-9f3cb3465cb5 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.276147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2780/5540] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:52.277272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.286969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.287850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.288327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.288893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.290524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.290926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fa585-398e-4821-b00c-0e6053f597fc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.296795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.297869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.298892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.299369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.299764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.301522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2b08357975c740f6a83e2c72391bd2cb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.304231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.319515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2b08357975c740f6a83e2c72391bd2cb', 'request_id': 'req-f4242884-f915-47b4-95e0-322290f1ca3c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:52.334660 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2761/5541] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:52 2022] POST /identity/v3/roles => generated 240 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:52.340767 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2781/5542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:52 2022] DELETE /identity/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:52.341900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.350283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.370641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242884-f915-47b4-95e0-322290f1ca3c tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.382182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.383972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.385161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.385511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.386604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.391975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.394744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08458b-d1bc-4dc9-8c76-7c6fbeb2cb5c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.432886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.433596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.433877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.434299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.439945 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2782/5543] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:31:52 2022] GET /identity/v3/roles => generated 1651 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:52.439945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.441975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=807e0cefaab24dfb9d723a1deacd2ab2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.445425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.473794 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2762/5544] 10.222.0.78 () {60 vars in 1579 bytes} [Tue Oct 18 16:31:52 2022] PUT /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:52.475049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.495932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915df84-4df0-4d2a-bfa6-7716cfe49b76 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.608793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:52.651954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.653133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.653611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764c2b4-c0c9-49ca-8965-9f7f4f2636d8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.654287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.654843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.656151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.658275 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:52.658275 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:52.658275 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:52.660081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.664792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.665524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.665806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.667374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] PATH_INFO: `/v3/projects/9524ceb4490746e8ba976b45e79db945/users/bf177ca69f8144ef9ee819b92559445e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.690691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2783/5545] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:31:52 2022] GET /identity/v3/endpoints => generated 4048 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:52.692160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.702758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9524ceb4490746e8ba976b45e79db945, user_id=bf177ca69f8144ef9ee819b92559445e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:52.706174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:52.735448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2763/5546] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:31:52 2022] PUT /identity/v3/projects/9524ceb4490746e8ba976b45e79db945/users/bf177ca69f8144ef9ee819b92559445e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:52.745209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:52.825862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62671e9-2193-4cf4-bc69-e6c27da49807 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.864136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:52.904579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f48e-b0aa-4f58-8f28-e7bb4c78d9a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:52.923525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:52.924315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.924695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.925204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:52.938511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e1f3b1b3-e1dc-4f43-b7d7-ee901926a577 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Could not find endpoint: 2b08357975c740f6a83e2c72391bd2cb.: keystone.exception.EndpointNotFound: Could not find endpoint: 2b08357975c740f6a83e2c72391bd2cb. Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:31:52.967410 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 2b08357975c740f6a83e2c72391bd2cb. Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:31:52.968662 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:31:52.969870 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 2b08357975c740f6a83e2c72391bd2cb. Oct 18 16:31:52.971343 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:31:52.977240 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2764/5547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:52 2022] DELETE /identity/v3/endpoints/2b08357975c740f6a83e2c72391bd2cb => generated 114 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:31:52.979004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:52.979442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:52.979913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.010079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.011296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.011889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.012359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.022578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.028802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.062957 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2784/5548] 10.222.0.78 () {58 vars in 1461 bytes} [Tue Oct 18 16:31:52 2022] GET /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/inherited_to_projects => generated 447 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:53.064160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.086850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe138f-0ece-46e5-adc2-5b297013300a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.094696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] MFA Rules not processed for user `bf177ca69f8144ef9ee819b92559445e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:53.098055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.103993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.104718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.105036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.105323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1747274795` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.106104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1747274795)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.109054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.151038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2785/5549] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:31:53 2022] DELETE /identity/v3/regions/tempest-region-1747274795 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:53.152152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.211159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59521-cd20-479a-8919-0ea959b7b41e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.216659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.217566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.217847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.218123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.220342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=807e0cefaab24dfb9d723a1deacd2ab2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.224009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.231883 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2786/5550] 10.222.0.78 () {58 vars in 1561 bytes} [Tue Oct 18 16:31:53 2022] HEAD /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:53.232415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.253558 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2765/5551] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3880 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:53.254722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.275418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cafa6-a5d6-4515-896c-b80f6c3bc484 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.276244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3e65e-4914-4e7e-929d-2810c98883ea tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.283165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.284557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.284970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.285423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.285876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.286806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.287019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.287418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.288714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.290950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.291276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=807e0cefaab24dfb9d723a1deacd2ab2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.295179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.303565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 807e0cefaab24dfb9d723a1deacd2ab2 was removed from user cc3945442a424720a1e20d4a65ae926c on domain f384ea4d00394ae8a45b36ea29275fd6. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:53.303565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:53.303935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:53.319652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2787/5552] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Oct 18 16:31:53 2022] GET /identity/v3/endpoints => generated 4048 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:53.320924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.324838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.343222 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2766/5553] 10.222.0.78 () {58 vars in 1563 bytes} [Tue Oct 18 16:31:53 2022] DELETE /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/807e0cefaab24dfb9d723a1deacd2ab2/inherited_to_projects => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:53.346232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.352510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.393948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:53.519903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0962ea-c60f-4bf9-8aab-de9d28f9dce6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.563238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78538bb-442b-4444-9bba-602bd9a8f30a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.578023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.578674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.578956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.579231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.580210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Adding query filter params (service_id=358b9e77179a45849d3054f5bb8207ef) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:53.580523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.582519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.619332 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2767/5554] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:31:53 2022] GET /identity/v3/endpoints?service_id=358b9e77179a45849d3054f5bb8207ef => generated 503 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:53.620573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.624100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.788146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.790055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.790354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.790629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.796266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.812299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:53.825177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9138-040c-410a-bd4e-d4b0cf3897b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:53.834344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:53.835124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:53.835477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:53.835819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/807e0cefaab24dfb9d723a1deacd2ab2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:53.837790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=807e0cefaab24dfb9d723a1deacd2ab2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.840263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:53.927200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 807e0cefaab24dfb9d723a1deacd2ab2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:53.956267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:53.968328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:53.973600 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2768/5555] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:53 2022] DELETE /identity/v3/roles/807e0cefaab24dfb9d723a1deacd2ab2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:53.978255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:53.980445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:53.997405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:53.999041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.020048 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2788/5556] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3880 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:54.021082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.050305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea672fbf-920f-4cfa-961a-ffa7526e0e82 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.158272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d28ecc-cc4c-4363-b2cc-f0b55e623028 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.165588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.166724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.167107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.167482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.168245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Adding query filter params (service_id=773b3cfa746547c3a79d05d1b1986331) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:54.168652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.170503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.191142 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2769/5557] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:31:53 2022] GET /identity/v3/endpoints?service_id=773b3cfa746547c3a79d05d1b1986331 => generated 502 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:54.212029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.263556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a095a-5461-408c-8b72-9979a1c28267 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.278700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.279367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.279641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.279918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.283450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.285147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.292906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:54.300878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.302529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.303023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.304403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.306294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:54.306852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.324446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.344504 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2789/5558] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:54 2022] POST /identity/v3/roles => generated 238 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:54.352415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.355157 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2770/5559] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Oct 18 16:31:54 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:31:54.355774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:54.356495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.376256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46fe7f-8127-4c83-bb03-81c71d1e8c0d tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.382743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.383437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.383771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.384072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.384890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:54.385271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.387504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.418485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2771/5560] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Oct 18 16:31:54 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:54.420034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.447831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d8c3e-7b6c-4db0-b765-5e3f354f2768 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.459499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be81b65-da3c-49ad-ae12-139f68f89c59 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.470860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.471862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.472329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.472818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.475358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.476318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.479166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.479582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.479798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.481570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.484053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.490165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.531797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2772/5561] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:54 2022] POST /identity/v3/services => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:54.533519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.612156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6babfb-6fd9-46de-9b22-d29bd86948bc tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.636038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.636038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.636038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.639738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.639738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.640305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.640442 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2790/5562] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:54 2022] POST /identity/v3/projects => generated 409 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:54.650213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.738487 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-674711102. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:54.738487 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:54.738487 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:54.840889 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2773/5563] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Oct 18 16:31:54 2022] POST /identity/v3/endpoints => generated 358 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:31:54.846332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:54.855669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:54.890533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e28a8-13bf-42fd-88f6-1c548386dcfb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:54.942114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:54.944186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:54.945561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:54.946205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/6f3b93528b2345a3b8f0afbbcd092703/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:54.958911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=6f3b93528b2345a3b8f0afbbcd092703)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:54.969479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:54.998512 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2791/5564] 10.222.0.78 () {60 vars in 1579 bytes} [Tue Oct 18 16:31:54 2022] PUT /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/6f3b93528b2345a3b8f0afbbcd092703/inherited_to_projects => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:54.999518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:55.035512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:55.083547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d9bc-8601-42b7-b8a9-fe0ed75b1b9f tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:55.346921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:55.350984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:55.351623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ca174-ea66-49b4-a401-0b08d37a3a49 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:55.352593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:55.353119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] PATH_INFO: `/v3/users/bf177ca69f8144ef9ee819b92559445e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:55.360364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:55.363443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:55.364519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:55.365106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-674711102` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:55.366321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-674711102)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:55.367427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:55.367831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf177ca69f8144ef9ee819b92559445e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:55.371220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2792/5565] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:31:54 2022] GET /identity/v3/regions/tempest-region-674711102 => generated 178 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:55.377615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:55.382618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:55.531754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:55.538181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf177ca69f8144ef9ee819b92559445e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:55.539664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf177ca69f8144ef9ee819b92559445e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:55.563064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf177ca69f8144ef9ee819b92559445e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:55.564654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf177ca69f8144ef9ee819b92559445e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:55.579521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf177ca69f8144ef9ee819b92559445e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:55.587097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb9722-b465-446f-8361-addc003effa9 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:55.599162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:55.603665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:55.605159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:55.605460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:55.609979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=c6b6385d793d40ee869e6780865648c6, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:55.613307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:55.614996 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:55.614996 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:31:55.614996 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:31:55.616296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3415d-1194-45eb-aac7-2cc181b7553f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:55.620166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2774/5566] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:54 2022] DELETE /identity/v3/users/bf177ca69f8144ef9ee819b92559445e => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:55.620166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:55.622025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:55.738096 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2793/5567] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:31:55 2022] GET /identity/v3/role_assignments?scope.project.id=c6b6385d793d40ee869e6780865648c6&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 648 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:55.741122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:55.741499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:55.741841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:55.800164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:55.805744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:55.842121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda82db-fbdc-40a1-b79c-27cae4c716f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:55.859068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:55.860278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:55.860639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:55.861067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/8d52c32f81c24eb180021fa05acd9441` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:55.887181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8d52c32f81c24eb180021fa05acd9441)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:55.888935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:55.894018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:55.939839 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1483317771. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:55.939839 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:55.939839 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:56.031796 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2775/5568] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Oct 18 16:31:55 2022] PATCH /identity/v3/endpoints/8d52c32f81c24eb180021fa05acd9441 => generated 364 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:56.031796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.041088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:56.088133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2794/5569] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:55 2022] POST /identity/v3/auth/tokens => generated 4002 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:56.088133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.164138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b7450-11e2-41b4-9094-69c9730fef10 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.205534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:56.206262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.206501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.206741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1483317771` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.207348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1483317771)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:56.209140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:56.225215 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2795/5570] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:31:56 2022] GET /identity/v3/regions/tempest-region-1483317771 => generated 180 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:56.228565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.236253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:56.312954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b27d-a353-4a72-aab2-63587433501e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.328930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:56.329604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.330018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.330292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.334013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=5d04bb4ee366421e8e5e5463d778a8ae, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:56.334495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:56.339429 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:31:56.339429 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:31:56.339429 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:56.341853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:56.415572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574cfb-809b-454c-8115-0df83df99cfb tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.425362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:56.425998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.426278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.427463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.467090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:56.474526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07de8f9-3876-4785-9319-a83bc8159640 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:56.522481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2776/5571] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:31:56 2022] GET /identity/v3/role_assignments?scope.project.id=5d04bb4ee366421e8e5e5463d778a8ae&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 648 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:56.527450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.548513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:56.559338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40798-f706-4dec-b69e-23cd7a974cff tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.570829 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2796/5572] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:31:56 2022] GET /identity/v3/auth/tokens => generated 4002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:31:56.573134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.573619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.574067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.574536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:56.575779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.576430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.576430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/8d52c32f81c24eb180021fa05acd9441` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.590896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8d52c32f81c24eb180021fa05acd9441)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:56.594645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:56.628293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8d52c32f81c24eb180021fa05acd9441', 'request_id': 'req-64308373-5086-4866-95bd-c0b9e4d78ce3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:56.642174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] MFA Rules not processed for user `ed5f927857d54bba9371256669c262f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:56.643967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:56.652059 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2777/5573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:56 2022] DELETE /identity/v3/endpoints/8d52c32f81c24eb180021fa05acd9441 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:56.653014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.715988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64308373-5086-4866-95bd-c0b9e4d78ce3 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.729562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:56.731304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:56.731304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:56.731515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/6f3b93528b2345a3b8f0afbbcd092703/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:56.738345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f384ea4d00394ae8a45b36ea29275fd6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=6f3b93528b2345a3b8f0afbbcd092703)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:56.746058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:56.759824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 6f3b93528b2345a3b8f0afbbcd092703 was removed from user cc3945442a424720a1e20d4a65ae926c on domain f384ea4d00394ae8a45b36ea29275fd6. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:56.760159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:56.763880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:56.803327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2778/5574] 10.222.0.78 () {58 vars in 1563 bytes} [Tue Oct 18 16:31:56 2022] DELETE /identity/v3/OS-INHERIT/domains/f384ea4d00394ae8a45b36ea29275fd6/users/cc3945442a424720a1e20d4a65ae926c/roles/6f3b93528b2345a3b8f0afbbcd092703/inherited_to_projects => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:56.807055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.814736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:56.854952 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2797/5575] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:56 2022] POST /identity/v3/auth/tokens => generated 4013 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:56.856064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:56.862120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:56.902692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee2cb4-68c9-4c7f-968c-fc5595acacdf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:56.919869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:57.173954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bcdd7-6637-4db6-9679-08e7bf30b35c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.199564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.200618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.201170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.201722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1483317771` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.202196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.203486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.203952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.204244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1483317771)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.204432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.205737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=c6b6385d793d40ee869e6780865648c6, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:57.208787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.215563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.222791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.259004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2779/5576] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:31:56 2022] DELETE /identity/v3/regions/tempest-region-1483317771 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:57.264884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.342023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b95ad1-a85b-42f6-9c4f-66ec4f943ade tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.354329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.354990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.355268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.355533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-674711102` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.356127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-674711102)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.357819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.393491 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2780/5577] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/regions/tempest-region-674711102 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:57.400279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.413512 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2798/5578] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:31:56 2022] GET /identity/v3/role_assignments?scope.project.id=c6b6385d793d40ee869e6780865648c6&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 228 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:57.415448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.445971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11065-7114-4746-bcd3-49b8630e911a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.472618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a2607-5c51-4c67-8b6a-0f16c06cc1c1 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.498139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.498797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.499073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.499453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services/3cf0c7bb3bc9489881314738c0896e3e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.500052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3cf0c7bb3bc9489881314738c0896e3e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.501690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.502568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.503598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.504083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.504600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.511733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=5d04bb4ee366421e8e5e5463d778a8ae, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:31:57.512409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.515661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.584578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2781/5579] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/services/3cf0c7bb3bc9489881314738c0896e3e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:57.592036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.657174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a320ce-9219-4beb-bd3e-2d3f0ce0259e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.671689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.672390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.672677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.673855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/49ca37eb049840e68fb22fa87c160e8b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.684833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:57.699420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=49ca37eb049840e68fb22fa87c160e8b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.700052 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2799/5580] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:31:57 2022] GET /identity/v3/role_assignments?scope.project.id=5d04bb4ee366421e8e5e5463d778a8ae&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 228 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:31:57.701177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.701608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.719827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '49ca37eb049840e68fb22fa87c160e8b', 'request_id': 'req-692cc5de-cbc3-4191-862b-6651d41af5b6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:57.726754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f747ebf-759c-4189-9f17-86395e14bb0a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.758110 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2782/5581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/endpoints/49ca37eb049840e68fb22fa87c160e8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:57.758110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.819591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.820322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.820607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.820896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects/5d04bb4ee366421e8e5e5463d778a8ae` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.822098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d04bb4ee366421e8e5e5463d778a8ae)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.824111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.833048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc5de-cbc3-4191-862b-6651d41af5b6 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:57.856394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:57.857089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:57.857463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:57.857634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-181340201` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:57.859373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-181340201)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:57.863365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:57.910607 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-181340201. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:31:57.910607 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:31:57.910607 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:31:57.945275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2783/5582] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/regions/tempest-region-181340201 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:57.950219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:57.952343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d04bb4ee366421e8e5e5463d778a8ae', 'request_id': 'req-741cd0d1-5d31-4cd5-9281-efb01835dea8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:57.966406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d04bb4ee366421e8e5e5463d778a8ae', 'request_id': 'req-741cd0d1-5d31-4cd5-9281-efb01835dea8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:57.980774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d04bb4ee366421e8e5e5463d778a8ae', 'request_id': 'req-741cd0d1-5d31-4cd5-9281-efb01835dea8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.000770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b897c-cab6-4185-bdd8-1850a6da61b4 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:58.019231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] The token cache is being invalidate because project 5d04bb4ee366421e8e5e5463d778a8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:58.019502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.020242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.025322 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2800/5583] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/projects/5d04bb4ee366421e8e5e5463d778a8ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:58.026244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:58.029495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:58.032616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:58.154380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:58.155559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:58.156351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:58.159134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services/773b3cfa746547c3a79d05d1b1986331` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:58.162512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_service(service_id=773b3cfa746547c3a79d05d1b1986331)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:58.165780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:58.203737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cd0d1-5d31-4cd5-9281-efb01835dea8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:58.229129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2784/5584] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:57 2022] DELETE /identity/v3/services/773b3cfa746547c3a79d05d1b1986331 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:58.233552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:58.237250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:58.258290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:58.259883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:58.259883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:58.259883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/6f3b93528b2345a3b8f0afbbcd092703` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:58.266285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6f3b93528b2345a3b8f0afbbcd092703)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:58.268002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:58.344691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ba323-f255-43c5-8528-a0505e5fbf89 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:58.388492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 6f3b93528b2345a3b8f0afbbcd092703 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:58.388791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.393410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.394158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:58.397382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:58.403193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2801/5585] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:58 2022] DELETE /identity/v3/roles/6f3b93528b2345a3b8f0afbbcd092703 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:58.406430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:58.411592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:58.412082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/endpoints/1b29dec42cf34c3b9e6fa562b4840f79` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:58.414337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:58.435760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1b29dec42cf34c3b9e6fa562b4840f79)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:58.445576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:58.468188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1b29dec42cf34c3b9e6fa562b4840f79', 'request_id': 'req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:58.511161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2785/5586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:31:58 2022] DELETE /identity/v3/endpoints/1b29dec42cf34c3b9e6fa562b4840f79 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:31:58.513610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:58.525940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:58.584024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:58.764844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107c59-26c5-4268-8c56-04226d318e4e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:58.780114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c9ad3-d216-4f18-b8c6-b8fc6c7b240b tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:58.830962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:58.832087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:58.832460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:58.833540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:58.842348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:58.845813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:58.895205 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2802/5587] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:31:58 2022] POST /identity/v3/roles => generated 239 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:31:58.897740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:58.907104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:58.950359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:58.951299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:58.951573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:58.951837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] PATH_INFO: `/v3/projects/9524ceb4490746e8ba976b45e79db945` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:58.954563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9524ceb4490746e8ba976b45e79db945)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:58.959443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:58.986966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:59.162740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9524ceb4490746e8ba976b45e79db945', 'request_id': 'req-a2079f0e-6a66-4496-a882-b3f934ca0acb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:59.169677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0b775-21b5-4ecb-a923-500f6d843721 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:59.182764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9524ceb4490746e8ba976b45e79db945', 'request_id': 'req-a2079f0e-6a66-4496-a882-b3f934ca0acb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:59.212692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9524ceb4490746e8ba976b45e79db945', 'request_id': 'req-a2079f0e-6a66-4496-a882-b3f934ca0acb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:59.278660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] The token cache is being invalidate because project 9524ceb4490746e8ba976b45e79db945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:31:59.279287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:59.283641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:31:59.290923 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2786/5588] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:58 2022] DELETE /identity/v3/projects/9524ceb4490746e8ba976b45e79db945 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:59.294671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:59.298919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:59.328632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:59.328886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.329042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.329373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/regions/tempest-region-1959540100` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.329855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1959540100)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:59.331567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8ef40-394e-4f8b-858c-b9713de7922e tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:59.376970 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2803/5589] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:31:58 2022] DELETE /identity/v3/regions/tempest-region-1959540100 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:59.378794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.379223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.381491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.426926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:59.431873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:59.537871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:31:59.706827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2804/5590] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:59.708913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:59.714996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:59.721599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2079f0e-6a66-4496-a882-b3f934ca0acb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:59.767954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa08dd-34da-4dc9-9b66-2557a0e3d47c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:59.778102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e2d77633ac34890bdb26008e058aa54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6421f76db274579bff28254b7a3cab8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:59.779195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.781270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.781902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] PATH_INFO: `/v3/services/358b9e77179a45849d3054f5bb8207ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.782733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorizing `identity:delete_service(service_id=358b9e77179a45849d3054f5bb8207ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:59.784899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4775-6c5e-40d2-9cbc-99db02e7a863 tempest-EndPointsTestJSON-1491021871 tempest-EndPointsTestJSON-1491021871-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:59.822735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:59.827696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.828313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.828794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.834025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:59.839233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2805/5591] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:31:59 2022] DELETE /identity/v3/services/358b9e77179a45849d3054f5bb8207ef => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:31:59.842861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.844161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.844696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.848284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:31:59.874275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:31:59.876158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:59.915329 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2806/5592] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:31:59.917196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:31:59.921816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:31:59.965285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2acb2-5815-44a5-a255-b94d77eb4d0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:31:59.976883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:31:59.977719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:31:59.978143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:31:59.978528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] PATH_INFO: `/v3/users/bb4ed5a00f0e4a108ae2bf71422b5e0b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:31:59.980894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4ed5a00f0e4a108ae2bf71422b5e0b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:31:59.982100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:00.037911 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2787/5593] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:31:59 2022] POST /identity/v3/projects => generated 409 bytes in 746 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:00.039349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:00.045296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:00.159350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4ed5a00f0e4a108ae2bf71422b5e0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:00.190851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4ed5a00f0e4a108ae2bf71422b5e0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:00.192034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4ed5a00f0e4a108ae2bf71422b5e0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:00.211910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4ed5a00f0e4a108ae2bf71422b5e0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:00.213643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4ed5a00f0e4a108ae2bf71422b5e0b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:00.260276 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2807/5594] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:31:59 2022] DELETE /identity/v3/users/bb4ed5a00f0e4a108ae2bf71422b5e0b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:00.260276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:00.263817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:00.427674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.460353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e702b0-4ae6-4f91-a461-2a611779bb15 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:00.467702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ab6ea-7ef8-430f-8282-312a7f5e840e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:00.483875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:00.485264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:00.485920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:00.486402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:00.487654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:00.488201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:00.491246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:00.501764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:00.561438 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2808/5595] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:00.566068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:00.578878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:00.726353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:00.726982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:00.727262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:00.727531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:00.730193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:00.876067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2564-e335-40a7-a96f-3cfc47994ce6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:00.912314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:00.912846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:00.913240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:00.913908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/1a464a7c6f18426ebf98274c12674ec7/inherited_to_projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:00.920555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c6b6385d793d40ee869e6780865648c6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=1a464a7c6f18426ebf98274c12674ec7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:00.924529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdde61-ab90-4e3b-b6b3-b486544ed6ed tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:00.958486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2809/5596] 10.222.0.78 () {60 vars in 1582 bytes} [Tue Oct 18 16:32:00 2022] PUT /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/1a464a7c6f18426ebf98274c12674ec7/inherited_to_projects => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:00.961403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:00.961688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:00.962030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:00.971213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:00.978637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:01.009290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:01.010553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:01.075982 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2788/5597] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 1038 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:01.080846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:01.143586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ad29a-2818-44d5-80aa-04930a1a8a7c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:01.212138 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2810/5598] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:01.230727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:01.334917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:01.335675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:01.336079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:01.342185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:01.343464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:01.347450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:01.484135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2789/5599] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:01.488947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:01.497701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:01.504729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c8ea-919c-4fa7-b578-c260b0187864 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:01.550202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:01.631601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:01.633627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:01.635114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:01.635472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:01.636447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=89cc6e2a49df40469dfed3bf42587c3e, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:01.636893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:01.640291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:01.686978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:01.715696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c9f7f-3b17-49cc-abbd-1dd4bb8ae173 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:01.730618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:01.731645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:01.732099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:01.732561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:01.809336 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2811/5600] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:32:01 2022] GET /identity/v3/role_assignments?scope.project.id=89cc6e2a49df40469dfed3bf42587c3e&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 649 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:01.810639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.034236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.041757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.078647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2790/5601] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:02.081062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.117176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf9520-55c8-4fa7-b9bb-925ce7a3c214 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.127388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.127660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019b6e-ad93-4128-8043-3e016ecf90eb tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.131568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.132555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.133294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/1a464a7c6f18426ebf98274c12674ec7/inherited_to_projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.141790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c6b6385d793d40ee869e6780865648c6, user_id=cc3945442a424720a1e20d4a65ae926c, role_id=1a464a7c6f18426ebf98274c12674ec7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.143169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.150091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.150726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.152590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.155789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.159551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.172278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.195351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 1a464a7c6f18426ebf98274c12674ec7 was removed from user cc3945442a424720a1e20d4a65ae926c on project c6b6385d793d40ee869e6780865648c6. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:02.195734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:02.198398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:02.235787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2812/5602] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:01 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:02.241628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.249603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:02.266428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2791/5603] 10.222.0.78 () {58 vars in 1566 bytes} [Tue Oct 18 16:32:02 2022] DELETE /identity/v3/OS-INHERIT/projects/c6b6385d793d40ee869e6780865648c6/users/cc3945442a424720a1e20d4a65ae926c/roles/1a464a7c6f18426ebf98274c12674ec7/inherited_to_projects => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:02.276736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.288507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:02.311066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b41b1-90cb-4c47-9a7c-e1b01f5cb0d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.493890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.494781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.495288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.495570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.496301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.502811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.517498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:02.548567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2813/5604] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:02 2022] GET /identity/v3/roles => generated 1650 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:02.553500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.571993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356221a-e932-46f4-b274-69f2f56a700a tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.592893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499129b-b2a3-43d7-9c52-0527aeb5e291 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.595757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.599488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.599771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.602774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.604963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Adding query filter params (scope.project.id=89cc6e2a49df40469dfed3bf42587c3e, user.id=cc3945442a424720a1e20d4a65ae926c) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:02.605303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.611623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.612887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.613530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.619059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.619548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.620276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.623132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.732000 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2814/5605] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:02 2022] GET /identity/v3/roles => generated 1650 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:02.738624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.802706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2792/5606] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:32:02 2022] GET /identity/v3/role_assignments?scope.project.id=89cc6e2a49df40469dfed3bf42587c3e&user.id=cc3945442a424720a1e20d4a65ae926c&effective => generated 228 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:02.807629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:02.809378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cddc62-7034-4e25-ac8f-26df2163ad4a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.822814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa119e24-f0a2-4bd2-845e-d0ee4a55860b tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:02.827119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.828426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:02.829713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.830228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.830752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects/89cc6e2a49df40469dfed3bf42587c3e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.833243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:02.833598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:02.833905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] PATH_INFO: `/v3/projects/68e00a5b437f4413b0e447e71c20a908/users/a7d2e496e38648ae8d90c27c7e47b5db/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:02.834325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89cc6e2a49df40469dfed3bf42587c3e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.838725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.888869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:02.912328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e00a5b437f4413b0e447e71c20a908, user_id=a7d2e496e38648ae8d90c27c7e47b5db, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:02.930303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:02.950159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cc6e2a49df40469dfed3bf42587c3e', 'request_id': 'req-8043ab48-95c3-42ab-8ae5-3397057d00ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:02.980254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cc6e2a49df40469dfed3bf42587c3e', 'request_id': 'req-8043ab48-95c3-42ab-8ae5-3397057d00ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:02.991558 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2815/5607] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:02 2022] PUT /identity/v3/projects/68e00a5b437f4413b0e447e71c20a908/users/a7d2e496e38648ae8d90c27c7e47b5db/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:02.994131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:03.007566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:03.034906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cc6e2a49df40469dfed3bf42587c3e', 'request_id': 'req-8043ab48-95c3-42ab-8ae5-3397057d00ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.068192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] The token cache is being invalidate because project 89cc6e2a49df40469dfed3bf42587c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:03.068858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.071878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8043ab48-95c3-42ab-8ae5-3397057d00ac tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.077641 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2793/5608] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:02 2022] DELETE /identity/v3/projects/89cc6e2a49df40469dfed3bf42587c3e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:03.081981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:03.085080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:03.085531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:03.214973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] MFA Rules not processed for user `a7d2e496e38648ae8d90c27c7e47b5db`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:03.221101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:03.250686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d7b47-96f7-4ed5-9671-e5f64a95f249 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:03.296089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:03.296764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:03.297097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:03.300122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] PATH_INFO: `/v3/projects/4c48f7f9d366492899672e4af1f8e667` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:03.305309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c48f7f9d366492899672e4af1f8e667)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:03.309045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:03.434858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c48f7f9d366492899672e4af1f8e667', 'request_id': 'req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.462909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c48f7f9d366492899672e4af1f8e667', 'request_id': 'req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.489097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c48f7f9d366492899672e4af1f8e667', 'request_id': 'req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.538471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] The token cache is being invalidate because project 4c48f7f9d366492899672e4af1f8e667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:03.538968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.542812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:03.570690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2816/5609] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:02 2022] DELETE /identity/v3/projects/4c48f7f9d366492899672e4af1f8e667 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:03.572971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:03.588806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:03.650899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2794/5610] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:03.652330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:03.662140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:03.722771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2c24-e860-4637-80d5-5ca6cec1de4c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:03.849492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:03.884180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b89f8f-1e0f-4003-a3e3-5351e4b3c68e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:03.896051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:03.896756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:03.897055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:03.897326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/roles/1a464a7c6f18426ebf98274c12674ec7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:03.900143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1a464a7c6f18426ebf98274c12674ec7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:03.903477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:03.936141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:03.937320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:03.937777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:03.938203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] PATH_INFO: `/v3/users/5e2d77633ac34890bdb26008e058aa54` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:03.940366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2d77633ac34890bdb26008e058aa54)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:03.942807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:04.010421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invalidating the token cache because role 1a464a7c6f18426ebf98274c12674ec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:04.010777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.011567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.018665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:04.029940 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2817/5611] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:03 2022] DELETE /identity/v3/roles/1a464a7c6f18426ebf98274c12674ec7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:04.031012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:04.036258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:04.049782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2d77633ac34890bdb26008e058aa54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.050793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2d77633ac34890bdb26008e058aa54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.077686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2d77633ac34890bdb26008e058aa54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.078486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2d77633ac34890bdb26008e058aa54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.092983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2d77633ac34890bdb26008e058aa54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.190760 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2795/5612] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:03 2022] DELETE /identity/v3/users/5e2d77633ac34890bdb26008e058aa54 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:04.190760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:04.202958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:04.221395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd22558-4804-4653-9371-0d8db4723a1e tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:04.395517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec574e94-67cd-455d-9b80-30664f633bc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:04.430066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:04.434763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:04.435127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:04.435412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/users/cc3945442a424720a1e20d4a65ae926c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:04.441955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cc3945442a424720a1e20d4a65ae926c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:04.449724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:04.450740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:04.452141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:04.469361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:04.469848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:04.470698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:04.478741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:04.560574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2818/5613] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:04.570218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:04.572357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:04.672239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3945442a424720a1e20d4a65ae926c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.674322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3945442a424720a1e20d4a65ae926c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.700910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:04.714888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3945442a424720a1e20d4a65ae926c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.716590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3945442a424720a1e20d4a65ae926c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.728985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906df5a6-758b-46f4-95df-e54ba04d8b32 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:04.737233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3945442a424720a1e20d4a65ae926c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:04.741802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:04.742439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:04.742715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:04.743026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:04.743823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:04.745936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:04.790373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2796/5614] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:04 2022] DELETE /identity/v3/users/cc3945442a424720a1e20d4a65ae926c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:04.793841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:04.796531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:04.797816 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2819/5615] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:04 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:04.802979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:04.806523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:04.840638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82939891-628a-4f68-bcb3-014999273109 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:04.970892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:05.038188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:05.042345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.042770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.045228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.046277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:05.048931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:05.075903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2820/5616] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:32:05.079546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:05.083333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:05.089986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f461-d743-4334-82ec-171fca955a3f tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:05.113244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064db9-d49f-4f65-945e-448c8f2fc1f8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:05.119903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:05.120951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.121371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.121729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] PATH_INFO: `/v3/projects/e6421f76db274579bff28254b7a3cab8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.123219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6421f76db274579bff28254b7a3cab8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:05.124095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:05.125107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.126634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.127205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:05.127405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/groups/e998dfc86e4f49b3814636d0866678a9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.134985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e998dfc86e4f49b3814636d0866678a9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:05.138457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:05.259789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2797/5617] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:04 2022] DELETE /identity/v3/groups/e998dfc86e4f49b3814636d0866678a9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:05.260921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:05.273604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6421f76db274579bff28254b7a3cab8', 'request_id': 'req-335b0e37-264e-4cde-b5db-e46c0f918125'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.293586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6421f76db274579bff28254b7a3cab8', 'request_id': 'req-335b0e37-264e-4cde-b5db-e46c0f918125'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.304799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6421f76db274579bff28254b7a3cab8', 'request_id': 'req-335b0e37-264e-4cde-b5db-e46c0f918125'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.331095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] The token cache is being invalidate because project e6421f76db274579bff28254b7a3cab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:05.331538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.333576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.341352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2821/5618] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:05 2022] DELETE /identity/v3/projects/e6421f76db274579bff28254b7a3cab8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:05.342828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:05.345158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:05.462974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd59f21-3674-4eca-9f08-49447afb589c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:05.477364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:05.478438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.479034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.479485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] PATH_INFO: `/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b/users/ff38053f715c40cdabe1a85eba7543f4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.507220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0e37-264e-4cde-b5db-e46c0f918125 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:05.512687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5445c67dc7db4db598e6cb8f500c7a0b, user_id=ff38053f715c40cdabe1a85eba7543f4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:05.518553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42be1e-3e2b-4f19-be6c-6e5cac67e497 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:05.520044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:05.579011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2798/5619] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:05 2022] PUT /identity/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b/users/ff38053f715c40cdabe1a85eba7543f4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:05.583799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.583799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.583799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.703117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:05.705186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:05.798163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:05.799499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.800851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.801612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/projects/c6b6385d793d40ee869e6780865648c6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:05.804207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c6b6385d793d40ee869e6780865648c6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:05.808532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:05.909027 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2799/5620] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:05.909522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:05.909954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b6385d793d40ee869e6780865648c6', 'request_id': 'req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.916985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:05.922163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b6385d793d40ee869e6780865648c6', 'request_id': 'req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.936752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b6385d793d40ee869e6780865648c6', 'request_id': 'req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.964482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] The token cache is being invalidate because project c6b6385d793d40ee869e6780865648c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:05.964482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.966470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b81a5c0-3c82-48c9-a19a-8ee874ca8de8 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:05.968891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6e3d-1111-4d21-9863-9381a40a889e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:05.970921 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2822/5621] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:05 2022] DELETE /identity/v3/projects/c6b6385d793d40ee869e6780865648c6 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:05.974314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:05.977185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:05.977492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:06.035262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:06.060359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:06.061674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:06.250177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:06.257250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:06.258226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:06.260535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:06.262752 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2823/5622] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:06.267655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:06.267655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:06.272124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:06.281621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:06.365860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2800/5623] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:06.388921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:06.485858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209d372-fad1-42b2-92d0-9b0d39812107 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:06.512788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:06.513831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:06.515564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:06.517195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:06.519278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:06.519709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:06.524111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:06.525475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:06.627129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2801/5624] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:06.637185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:06.656634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:06.657521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8459fa-0ef1-4ff0-b78c-0859e2e7c692 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:06.684472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:06.685285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:06.686114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:06.686389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/domains/f384ea4d00394ae8a45b36ea29275fd6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:06.693964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f384ea4d00394ae8a45b36ea29275fd6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:06.703693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:06.744585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb34037-8527-490f-8d63-bee99692b92c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:06.794120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:06.794809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:06.795190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:06.795470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] PATH_INFO: `/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b/users/ff38053f715c40cdabe1a85eba7543f4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:06.808626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5445c67dc7db4db598e6cb8f500c7a0b, user_id=ff38053f715c40cdabe1a85eba7543f4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:06.829359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:06.835437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:06.839195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:06.929459 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2802/5625] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:06 2022] PUT /identity/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b/users/ff38053f715c40cdabe1a85eba7543f4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:06.930457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:06.939335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:06.981966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:06.983895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4fae99b-989c-4e0c-b7a9-f5467ce08285 tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:06.993863 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2824/5626] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:06 2022] PATCH /identity/v3/domains/f384ea4d00394ae8a45b36ea29275fd6 => generated 278 bytes in 730 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:06.995185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:06.995472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:06.995729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:07.120438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] MFA Rules not processed for user `ff38053f715c40cdabe1a85eba7543f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:07.127086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:07.190208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19797-2b52-49d3-8afe-a0244768d296 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:07.207407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:07.209962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:07.210260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:07.210536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:07.211185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:07.216462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:07.366334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2803/5627] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:06 2022] POST /identity/v3/projects => generated 367 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:07.372758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:07.377391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:07.625634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2825/5628] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:07.631144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:07.636115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:07.685185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411e187-7775-470b-8da0-da622530b0be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:07.693353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8ae15-0c21-4c95-84d7-deb1c777033e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:07.704455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4afae07148b4191bd0277d025a52143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83c474e0d6d4e4a9edf023fdc4da552', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:07.705341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:07.705622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:07.705898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] PATH_INFO: `/v3/domains/f384ea4d00394ae8a45b36ea29275fd6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:07.768508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f384ea4d00394ae8a45b36ea29275fd6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:07.779080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:07.789918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:07.835560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:07.840503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.010720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.028914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:08.032598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:08.033115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:08.035080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:08.036289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.037957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:08.047769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:08.096550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.127527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] The token cache is being invalidate because project f384ea4d00394ae8a45b36ea29275fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:08.128203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.129504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.146403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.147924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.155787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f384ea4d00394ae8a45b36ea29275fd6', 'request_id': 'req-6f01cfe7-53b2-44fe-b702-6c713e423c2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.165817 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2826/5629] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:07 2022] POST /identity/v3/users => generated 284 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:08.169088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:08.170921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2804/5630] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:07 2022] DELETE /identity/v3/domains/f384ea4d00394ae8a45b36ea29275fd6 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:08.172237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:08.178497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:08.178745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:08.271418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:08.499253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa5067-8aa4-4f06-90d1-bf026c4704af admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:08.508893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01cfe7-53b2-44fe-b702-6c713e423c2c tempest-InheritsV3TestJSON-1896174020 tempest-InheritsV3TestJSON-1896174020-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:08.523852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:08.526447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:08.526928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:08.527585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:08.532174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:08.536972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:08.575053 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2805/5631] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:08.576590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:08.601264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:08.654201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e349c3e-b44c-4a57-8304-7373f0dbe778 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:08.665594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:08.666883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:08.669109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:08.670499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] PATH_INFO: `/v3/users/9c2bd6d456554cdba912a42b33543efc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:08.680286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2bd6d456554cdba912a42b33543efc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:08.690541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:08.843489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:08.845070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:08.845383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:08.845642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:08.846338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:08.854693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:08.870961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:08.904191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2bd6d456554cdba912a42b33543efc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.907068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2bd6d456554cdba912a42b33543efc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.956676 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2827/5632] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:08 2022] POST /identity/v3/domains => generated 246 bytes in 790 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:08.957949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:08.970425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2bd6d456554cdba912a42b33543efc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:08.971814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2bd6d456554cdba912a42b33543efc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:09.037890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2bd6d456554cdba912a42b33543efc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:09.167273 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2806/5633] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:08 2022] DELETE /identity/v3/users/9c2bd6d456554cdba912a42b33543efc => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:09.173568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:09.184441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:09.217892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cfb9d-6cb9-4d95-b107-9a181fbb4f5f tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:09.482333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:09.482972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:09.483251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:09.483530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:09.484187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:09.486091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71cb7-42dc-43e8-9448-72d909c221a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:09.534686 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2828/5634] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:09.534686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:09.536430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:09.536430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:09.557736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396c424-84ac-4adc-881f-8861ffab82d0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:09.563968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:09.584785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:09.585890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:09.586709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:09.594738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:09.596022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:09.613339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:09.613643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:09.615102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:09.654785 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2829/5635] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:09.654785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:09.669915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:09.736336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64667f-6bf9-44ff-bc4d-63e8271e578a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:09.752755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:09.753630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:09.754036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:09.754424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] PATH_INFO: `/v3/users/c79d7ae8b5874ef485e636313e6ce769` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:09.772403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79d7ae8b5874ef485e636313e6ce769)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:09.775115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:09.876689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2807/5636] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:09 2022] POST /identity/v3/projects => generated 409 bytes in 709 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:09.878235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:09.891032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:10.018266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79d7ae8b5874ef485e636313e6ce769'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:10.035430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79d7ae8b5874ef485e636313e6ce769'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:10.063418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79d7ae8b5874ef485e636313e6ce769'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:10.098645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79d7ae8b5874ef485e636313e6ce769'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:10.110759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79d7ae8b5874ef485e636313e6ce769'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:10.193434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd9fd-1c1f-4ef8-8b69-b6130a2cef74 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:10.217973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:10.221531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:10.221531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:10.221531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] PATH_INFO: `/v3/projects/eb077040dfd646f492582b37259967bb/users/062b00750d7b4ce7b06cef80ccd5130f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:10.234446 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2830/5637] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:09 2022] DELETE /identity/v3/users/c79d7ae8b5874ef485e636313e6ce769 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:10.235835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:10.246997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:10.283148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb077040dfd646f492582b37259967bb, user_id=062b00750d7b4ce7b06cef80ccd5130f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:10.304351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:10.338216 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2808/5638] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:09 2022] PUT /identity/v3/projects/eb077040dfd646f492582b37259967bb/users/062b00750d7b4ce7b06cef80ccd5130f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:10.350288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:10.364967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:10.451504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:10.539930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602cf88-982f-4271-b2f6-38fc41cb84ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:10.682204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc4f7a-948b-4e6a-97ae-b994d8ab5cee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:10.695048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:10.696586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:10.698904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:10.699660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:10.699846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:10.701858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70281cb-280b-460c-9f99-04b4e5a28a77 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:10.757859 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2809/5639] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:10 2022] POST /identity/v3/users => generated 348 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:10.775116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef429-3ee3-4ee1-af34-c5d9bf127b94 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:10.775934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef429-3ee3-4ee1-af34-c5d9bf127b94 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:10.775934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef429-3ee3-4ee1-af34-c5d9bf127b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:10.784555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:10.785228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:10.786105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:10.786504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:10.793320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:10.870287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c7bef429-3ee3-4ee1-af34-c5d9bf127b94 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:10.871551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7bef429-3ee3-4ee1-af34-c5d9bf127b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:10.989231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:11.114971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:11.136147 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2810/5640] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:11.140651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.140965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.141263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.156472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:11.205649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2831/5641] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 970 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:11.206391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:11.230197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c979d-8854-4a1a-be3a-50d7ef7c0832 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:11.254749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:11.255492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.256196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.257015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.257612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:11.259569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:11.304071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2832/5642] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:11.308506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:11.322930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42045-1b08-4359-886d-370e16009649 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:11.328098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:11.329210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.329776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.330284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.369412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:11.371929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:11.431187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] MFA Rules not processed for user `062b00750d7b4ce7b06cef80ccd5130f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:11.436062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:11.461161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2833/5643] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:11.466466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:11.544310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddafc1-0378-470b-8ddf-dfe7f178c0ff service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:11.579915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:11.580601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.580890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.581194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/projects/4bb94c5ad1af4e29b9e0d19045326368/users/7688f164f34c4b8e93c7aedde71f5f3e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.685330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2811/5644] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:11.688247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:11.690627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:11.702157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4bb94c5ad1af4e29b9e0d19045326368, user_id=7688f164f34c4b8e93c7aedde71f5f3e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:11.705377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267b278-8a94-45d3-8daf-5ceda0690a2d tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:11.734143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca9a84-5544-400c-b5de-c4ceaac6a0b7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:11.752753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:11.756230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.756542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.756855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.757861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:11.764460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:11.782657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2834/5645] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:11 2022] PUT /identity/v3/projects/4bb94c5ad1af4e29b9e0d19045326368/users/7688f164f34c4b8e93c7aedde71f5f3e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:11.789631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804476f3-a22f-49ef-bb58-422bd331c673 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:11.789900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804476f3-a22f-49ef-bb58-422bd331c673 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:11.790264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804476f3-a22f-49ef-bb58-422bd331c673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:11.857780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2812/5646] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:11 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:11.864572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:11.947026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:12.164935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34427d34-1141-4622-916c-51881565dae5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.167701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-804476f3-a22f-49ef-bb58-422bd331c673 None None] MFA Rules not processed for user `7688f164f34c4b8e93c7aedde71f5f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:12.169299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-804476f3-a22f-49ef-bb58-422bd331c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:12.180612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.181666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.182087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.182533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.183569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.186735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:12.211019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2835/5647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:12.227251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.227515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.227795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.262079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2813/5648] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:11 2022] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:12.263184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:12.284119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] MFA Rules not processed for user `7688f164f34c4b8e93c7aedde71f5f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:12.286105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:12.288486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567c58a-b601-444d-a12a-85661af1d1f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.322012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.322989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.323278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.323551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.324342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.330801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2836/5649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:12.331768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:12.332775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:12.371053 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2814/5650] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:12.372613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:12.394066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3592e-814f-4597-ab12-ab1f2c4be8e9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.420577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7688f164f34c4b8e93c7aedde71f5f3e', 'user_domain_id': '5797c4e282bf4dcbaee65de4e789f7cf', 'system_scope': None, 'project_id': '4bb94c5ad1af4e29b9e0d19045326368', 'project_domain_id': '5797c4e282bf4dcbaee65de4e789f7cf', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.428584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.433913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.434783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.439956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c6384-65e5-4464-b3fe-89da544755b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.469427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.471471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:12.490059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.492323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.493795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.495409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] PATH_INFO: `/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.516563 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2837/5651] 10.222.0.78 () {56 vars in 1284 bytes} [Tue Oct 18 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:12.519797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:12.598267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c934f4e4620a44f08f07ba35a6d29f3a, user_id=884d28cfdd1f4bf2ad0bc2b40c29e6b6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.616049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:12.625471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:12.678884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9d546-3a2d-4f2a-9ed7-2159f9fec63a tempest-test_project-264360158 tempest-user-1588634133] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.685936 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2815/5652] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:12 2022] PUT /identity/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:12.690068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:12.852430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.854126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.855167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.856983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/users/7688f164f34c4b8e93c7aedde71f5f3e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.857796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7688f164f34c4b8e93c7aedde71f5f3e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.870155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:12.936521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f097a8e-dc51-41be-99f6-f126a3d0bacc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:12.967958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:12.968583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:12.971278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:12.973546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:12.978024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:12.986682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:13.024893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2816/5653] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:13.031507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:13.041197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7688f164f34c4b8e93c7aedde71f5f3e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.074068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7688f164f34c4b8e93c7aedde71f5f3e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.074852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7688f164f34c4b8e93c7aedde71f5f3e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.080954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a090b2-3d56-4bfb-ad4c-94b1cc2f485d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:13.115924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:13.117508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7688f164f34c4b8e93c7aedde71f5f3e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.120268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:13.120829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3d938baa-467a-41b7-9c5a-38cd1b201ff0 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7688f164f34c4b8e93c7aedde71f5f3e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.121909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:13.123290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] PATH_INFO: `/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:13.128376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c934f4e4620a44f08f07ba35a6d29f3a, user_id=884d28cfdd1f4bf2ad0bc2b40c29e6b6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:13.137649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:13.192339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2817/5654] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:13 2022] PUT /identity/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:13.194089 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2838/5655] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:12 2022] DELETE /identity/v3/users/7688f164f34c4b8e93c7aedde71f5f3e => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:13.198641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:13.203823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:13.212711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:13.213613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:13.213990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:13.328386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] MFA Rules not processed for user `884d28cfdd1f4bf2ad0bc2b40c29e6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:13.331131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:13.469962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:13.513601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b5a1-effd-4a66-a512-00eb7383d22c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:13.615991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:13.666324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:13.667660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:13.668214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:13.675029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/projects/4bb94c5ad1af4e29b9e0d19045326368` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:13.681043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bb94c5ad1af4e29b9e0d19045326368)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:13.683543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:13.717604 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2839/5656] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:32:13.720050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:13.756685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7fa18-7a95-4033-a215-065951dd485b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:13.782894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:13.784393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:13.785123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:13.785814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:13.789779 n-d-858383-14 devstack@keystone.service[81776]: WARNING oslo_log.versionutils [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:13.792153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:13.794363 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:13.794363 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:13.794363 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:13.797527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:13.866056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb94c5ad1af4e29b9e0d19045326368', 'request_id': 'req-25fe8394-39f0-4cea-b36b-bdd017fc97ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.889475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb94c5ad1af4e29b9e0d19045326368', 'request_id': 'req-25fe8394-39f0-4cea-b36b-bdd017fc97ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.896229 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2840/5657] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:32:13 2022] POST /identity/v3/policies => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:13.911317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb94c5ad1af4e29b9e0d19045326368', 'request_id': 'req-25fe8394-39f0-4cea-b36b-bdd017fc97ed'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.912817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:13.945060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2cac2-1aba-48b3-840d-c418726e5bf4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:13.965653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] The token cache is being invalidate because project 4bb94c5ad1af4e29b9e0d19045326368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:13.965940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:13.969626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.008079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2818/5658] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:13 2022] DELETE /identity/v3/projects/4bb94c5ad1af4e29b9e0d19045326368 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:14.011173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:14.019127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:14.221309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:14.222310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:14.223286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:14.230119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/cfec4452071c4f059b763875d8b4bae0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:14.232021 n-d-858383-14 devstack@keystone.service[81776]: WARNING oslo_log.versionutils [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:14.233119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=cfec4452071c4f059b763875d8b4bae0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:14.239308 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:14.239308 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:14.239308 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:14.241208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe8394-39f0-4cea-b36b-bdd017fc97ed tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:14.247744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:14.248646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:14.249066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:14.249297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:14.250056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/domains/5797c4e282bf4dcbaee65de4e789f7cf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:14.251339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5797c4e282bf4dcbaee65de4e789f7cf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:14.253289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:14.282600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.283352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.308616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:14.326927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.327679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.336096 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2819/5659] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:14 2022] PATCH /identity/v3/domains/5797c4e282bf4dcbaee65de4e789f7cf => generated 247 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:14.337453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:14.340266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:14.347066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2841/5660] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:32:13 2022] PATCH /identity/v3/policies/cfec4452071c4f059b763875d8b4bae0 => generated 235 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:14.350488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:14.365063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:14.427005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b6e16-3142-4295-b576-a9a26adb7771 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:14.471821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b50df-9c0c-496d-bc29-04ad579f35e9 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:14.480405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff38053f715c40cdabe1a85eba7543f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5445c67dc7db4db598e6cb8f500c7a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:14.481485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:14.482068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:14.482808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] PATH_INFO: `/v3/domains/5797c4e282bf4dcbaee65de4e789f7cf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:14.514113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5797c4e282bf4dcbaee65de4e789f7cf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:14.515979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:14.546761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.552220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.659278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:14.661632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:14.662065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:14.662335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/cfec4452071c4f059b763875d8b4bae0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:14.663199 n-d-858383-14 devstack@keystone.service[81776]: WARNING oslo_log.versionutils [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:14.663705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=cfec4452071c4f059b763875d8b4bae0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:14.684458 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:14.684458 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:14.684458 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:14.686152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:14.699635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.726771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.748715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2842/5661] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:14 2022] GET /identity/v3/policies/cfec4452071c4f059b763875d8b4bae0 => generated 235 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:14.752783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.755127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:14.793171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916ca06-309b-4822-b7d6-91c4857c58fb tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:14.809693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] The token cache is being invalidate because project 5797c4e282bf4dcbaee65de4e789f7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:14.809908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.810690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.848904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.850050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.861584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5797c4e282bf4dcbaee65de4e789f7cf', 'request_id': 'req-bb92b660-dcbd-40d5-b38b-ac187ccad102'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:14.874153 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2820/5662] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:14 2022] DELETE /identity/v3/domains/5797c4e282bf4dcbaee65de4e789f7cf => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:14.882678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:14.884354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.016641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.016911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:15.017049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.017506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.017628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/cfec4452071c4f059b763875d8b4bae0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.018839 n-d-858383-14 devstack@keystone.service[81776]: WARNING oslo_log.versionutils [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:15.019622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=cfec4452071c4f059b763875d8b4bae0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.020944 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:15.020944 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:15.020944 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:15.022288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.041317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:15.063927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2843/5663] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:14 2022] DELETE /identity/v3/policies/cfec4452071c4f059b763875d8b4bae0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:15.070621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:15.078692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.148181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a58ab-f81e-4438-ba74-33b528d1d773 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:15.169262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.170165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.170771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.171397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.185755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.190655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.203897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92b660-dcbd-40d5-b38b-ac187ccad102 tempest-TestDefaultProjectId-320020220 tempest-TestDefaultProjectId-320020220-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:15.246356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.250395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.251002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.251566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] PATH_INFO: `/v3/users/a7d2e496e38648ae8d90c27c7e47b5db` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.258747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d2e496e38648ae8d90c27c7e47b5db)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.270650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.281041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2844/5664] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:32:15 2022] POST /identity/v3/policies => generated 230 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:15.282983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:15.297159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.358223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e636672-cbc9-4f0e-8436-efb50be141bf tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:15.384270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.385600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.389593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.389593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] PATH_INFO: `/v3/projects/8edb12451e1f418281aaeeba678121d7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.391791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edb12451e1f418281aaeeba678121d7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.399235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.438138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d2e496e38648ae8d90c27c7e47b5db'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.440368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d2e496e38648ae8d90c27c7e47b5db'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.470392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d2e496e38648ae8d90c27c7e47b5db'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.476195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d2e496e38648ae8d90c27c7e47b5db'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.490335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d2e496e38648ae8d90c27c7e47b5db'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.510489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edb12451e1f418281aaeeba678121d7', 'request_id': 'req-7fd95daf-d7df-4bbd-8406-95bd3858fa49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.522793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edb12451e1f418281aaeeba678121d7', 'request_id': 'req-7fd95daf-d7df-4bbd-8406-95bd3858fa49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.529244 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2821/5665] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:14 2022] DELETE /identity/v3/users/a7d2e496e38648ae8d90c27c7e47b5db => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:15.534754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:15.539558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.540143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edb12451e1f418281aaeeba678121d7', 'request_id': 'req-7fd95daf-d7df-4bbd-8406-95bd3858fa49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.570872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] The token cache is being invalidate because project 8edb12451e1f418281aaeeba678121d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:15.571101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.571779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.573757 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2845/5666] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:15 2022] DELETE /identity/v3/projects/8edb12451e1f418281aaeeba678121d7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:15.575080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:15.576698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.684549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd95daf-d7df-4bbd-8406-95bd3858fa49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:15.739548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a1dc-5eda-4dd3-8318-874f7258a4e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:15.746772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.747495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.747977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.748471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] PATH_INFO: `/v3/projects/17727477238a4fcb8bb59a58c8822974` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.750877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17727477238a4fcb8bb59a58c8822974)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.753481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.777891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:15.778550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.778975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.779253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.780431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:15.782467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118820b-d36f-4ddd-b468-ff32903f0391 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:15.828093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2846/5667] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:32:15 2022] POST /identity/v3/policies => generated 230 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:15.832041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:15.833535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:15.834171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:15.884484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:15.903298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:15.905093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:15.917052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17727477238a4fcb8bb59a58c8822974', 'request_id': 'req-9f7bc5f1-23aa-4586-85a2-3a266460701c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.932440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:15.947848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17727477238a4fcb8bb59a58c8822974', 'request_id': 'req-9f7bc5f1-23aa-4586-85a2-3a266460701c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.964877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17727477238a4fcb8bb59a58c8822974', 'request_id': 'req-9f7bc5f1-23aa-4586-85a2-3a266460701c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.992531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] The token cache is being invalidate because project 17727477238a4fcb8bb59a58c8822974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:15.993189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:15.994861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.002894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2822/5668] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:15 2022] DELETE /identity/v3/projects/17727477238a4fcb8bb59a58c8822974 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:16.004737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:16.009605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.125570 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2847/5669] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:16.126239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:16.132979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.245552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bc5f1-23aa-4586-85a2-3a266460701c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:16.252504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:16.254843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.256741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.256741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] PATH_INFO: `/v3/users/b4afae07148b4191bd0277d025a52143` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.269017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4afae07148b4191bd0277d025a52143)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:16.269017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:16.285130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348862ea-c94b-450c-9e5e-cec63b36e7b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:16.292055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:16.293095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.293591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.294052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.296066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:16.300484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22956f79-a7be-413d-b3d5-f75efe486c66 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:16.341490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2848/5670] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:32:16 2022] POST /identity/v3/policies => generated 228 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:16.344757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.346523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.348348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.404451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:16.408225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.432041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4afae07148b4191bd0277d025a52143'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.434072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4afae07148b4191bd0277d025a52143'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.447538 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2849/5671] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:16.448939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:16.453314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.466634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4afae07148b4191bd0277d025a52143'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.467968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4afae07148b4191bd0277d025a52143'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.482781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4afae07148b4191bd0277d025a52143'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:16.516032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2823/5672] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:16 2022] DELETE /identity/v3/users/b4afae07148b4191bd0277d025a52143 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:16.518630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:16.521715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.611345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c0d1d-3629-4ec8-a62b-78e7031572bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:16.708121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf49d2-5045-40e9-9761-a0135a2cac25 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:16.719084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:16.722331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.723491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.724293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.725834 n-d-858383-14 devstack@keystone.service[81775]: WARNING oslo_log.versionutils [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:16.726724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:16.730296 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:16.730296 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:16.730296 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:16.733862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd119d-d89b-4714-8dcb-65f310cfa92d tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:16.739847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:16.740531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.741087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.741497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.744900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.753106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:16.764419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:16.787506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2824/5673] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:32:16 2022] GET /identity/v3/policies => generated 764 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:16.789946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:16.790440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:16.791207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:16.827930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:16.831128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.924617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:16.927427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:16.967052 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2850/5674] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:16.968696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:16.972146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:16.994791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68cb5-951d-47cf-8c14-fecb8adff7ad service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.000352 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2825/5675] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:17.001322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.007083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.007958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.008371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.008770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.011255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:17.022397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8320f0a-48c3-482f-8453-3dfa97aad78a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.027372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.030985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.036690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.037372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.037666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.037905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/78019ad5de9143449ed415f75b18bdce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.038706 n-d-858383-14 devstack@keystone.service[81775]: WARNING oslo_log.versionutils [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 18 16:32:17.039269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=78019ad5de9143449ed415f75b18bdce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.040509 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:17.040509 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:17.040509 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:17.041424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.058487 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2851/5676] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:17.061927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.076825 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2826/5677] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:17 2022] DELETE /identity/v3/policies/78019ad5de9143449ed415f75b18bdce => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:17.079162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.102303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695a244-0aae-4436-8ecf-b2d560aeb790 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.106072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e916cf-c37b-47bb-96b9-9911b7c09827 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.114111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.114526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.115143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.115418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.115681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.116347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:17.116622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.116919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.117577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.118221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/d8eaf50d069b437081aec46d5e3ce861` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.118457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.120162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d8eaf50d069b437081aec46d5e3ce861)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.123674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.139365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2852/5678] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:17.145449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.161573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2827/5679] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:17 2022] DELETE /identity/v3/policies/d8eaf50d069b437081aec46d5e3ce861 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:17.170635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.184390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f245c-77a1-4ec0-bf70-934197491274 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.231260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.233429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.234018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739c442-7c09-4dde-bb50-8634901242a4 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.235178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.245224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.259782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.271520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.292910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '884d28cfdd1f4bf2ad0bc2b40c29e6b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c934f4e4620a44f08f07ba35a6d29f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.299069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.306122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.310621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] PATH_INFO: `/v3/policies/6865302033244542ad8788d72f12e6bf` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.323176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6865302033244542ad8788d72f12e6bf)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.327745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.420142 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2828/5680] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:17 2022] DELETE /identity/v3/policies/6865302033244542ad8788d72f12e6bf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:17.427046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.434341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:17.495874 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2853/5681] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:17 2022] POST /identity/v3/projects => generated 389 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:17.495874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.527754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b14e9-24a7-4ae3-88a3-2306a6bd74b1 tempest-PoliciesTestJSON-317036049 tempest-PoliciesTestJSON-317036049-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.655716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e113b-2c42-4db9-b0ae-f130203b7f3c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.661695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.662371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.662646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.662922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.663925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.666287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.687950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.688761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.689192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.689581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] PATH_INFO: `/v3/users/062b00750d7b4ce7b06cef80ccd5130f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.692282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=062b00750d7b4ce7b06cef80ccd5130f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.697175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.709218 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2854/5682] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:17 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:17.714595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.756538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c07391-0c5e-48df-b030-6547c2549a87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.772171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.773738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.774127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.774408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.775080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.776730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.807835 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2855/5683] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:17.809450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.813304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062b00750d7b4ce7b06cef80ccd5130f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:17.817875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062b00750d7b4ce7b06cef80ccd5130f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:17.829099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f505-e767-4c27-9247-3f2277f1c0f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:17.835078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062b00750d7b4ce7b06cef80ccd5130f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:17.836749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062b00750d7b4ce7b06cef80ccd5130f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:17.839746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:17.842552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:17.843285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.845791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.846776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.849898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:17.856964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:17.864022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-94ef87c4-4764-4c96-ad4b-0af47247d4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062b00750d7b4ce7b06cef80ccd5130f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:17.899332 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2856/5684] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:17.909206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:17.916009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:17.934057 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2829/5685] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:17 2022] DELETE /identity/v3/users/062b00750d7b4ce7b06cef80ccd5130f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:17.938587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:17.941030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:17.941434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:17.963193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272ec39-efca-480a-b688-192c22fb27be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:18.013347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:18.018003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:18.033256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:18.217150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:18.218897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:18.219968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:18.220666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] PATH_INFO: `/v3/projects/12fe7cb08a1f42ce8295228e2390635f/users/583979c8fd1446b6ad97a6438681de68/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:18.250052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fe7cb08a1f42ce8295228e2390635f, user_id=583979c8fd1446b6ad97a6438681de68, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:18.255764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5e271-4aee-4e8d-bb93-506a13641e5b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:18.264904 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2830/5686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:18.269989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:18.275664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:18.281378 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2857/5687] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:17 2022] PUT /identity/v3/projects/12fe7cb08a1f42ce8295228e2390635f/users/583979c8fd1446b6ad97a6438681de68/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:18.311265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149e8c7-0a81-4a5f-b38f-b83716aa0022 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:18.321252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:18.323012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:18.325025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:18.423359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] MFA Rules not processed for user `583979c8fd1446b6ad97a6438681de68`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:18.428668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:18.506142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:18.507004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:18.507290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:18.507567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] PATH_INFO: `/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:18.512650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83c474e0d6d4e4a9edf023fdc4da552)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:18.514661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:18.647944 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2858/5688] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:18.649410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:18.652321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:18.705274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83c474e0d6d4e4a9edf023fdc4da552', 'request_id': 'req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:18.746821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83c474e0d6d4e4a9edf023fdc4da552', 'request_id': 'req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:18.761191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83c474e0d6d4e4a9edf023fdc4da552', 'request_id': 'req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:18.798015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] The token cache is being invalidate because project d83c474e0d6d4e4a9edf023fdc4da552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:18.798503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:18.801957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:18.806079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2831/5689] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:18 2022] DELETE /identity/v3/projects/d83c474e0d6d4e4a9edf023fdc4da552 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:18.806944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:18.812148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:18.823986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:18.842439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebca96b-2707-4d79-8f94-3341b6d3b4a7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:18.938072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:18.950585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d0c94-e732-4b9e-b5df-c5ba9f5a4af2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:18.961853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:18.963150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:18.964006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:18.964423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:18.964788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:18.964955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:18.966109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:18.968383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:18.969184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b459eec-2d48-4bb4-9ad3-2f15cd4028a1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:18.969877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:18.978306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.008192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.011951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.022516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2832/5690] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:18 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:19.023652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.024173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.025509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.038774 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2859/5691] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:19.040657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.052647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:19.054192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.061307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09c9b6-ad14-4a97-a039-b9d5b7ed7e0f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.211944 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2833/5692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:19.211944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.212622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.213568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.217175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.217839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.219913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.221149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.228549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f1c6-0505-4ac7-914a-aab57a613336 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.243131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18433-cf37-499a-a595-f2624f7d4b28 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.266952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.267591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.267873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.268145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] PATH_INFO: `/v3/projects/68e00a5b437f4413b0e447e71c20a908` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.282052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e00a5b437f4413b0e447e71c20a908)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.284163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.292952 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2860/5693] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:19 2022] POST /identity/v3/users => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:19.299721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.300063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.300338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.396191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:19.397550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.429222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e00a5b437f4413b0e447e71c20a908', 'request_id': 'req-52912605-050a-40e2-a889-579b5c566af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.450415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e00a5b437f4413b0e447e71c20a908', 'request_id': 'req-52912605-050a-40e2-a889-579b5c566af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.467740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e00a5b437f4413b0e447e71c20a908', 'request_id': 'req-52912605-050a-40e2-a889-579b5c566af2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.495862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] The token cache is being invalidate because project 68e00a5b437f4413b0e447e71c20a908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:19.499430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.500939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.504522 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2834/5694] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:19 2022] DELETE /identity/v3/projects/68e00a5b437f4413b0e447e71c20a908 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:19.505833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.515065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.545079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:19.551885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2861/5695] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:19.553002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.558742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.584349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11544b-4f08-405d-98e6-c3a65319ab79 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.590394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.591245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.591620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.592022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] PATH_INFO: `/v3/users/ff38053f715c40cdabe1a85eba7543f4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.594234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff38053f715c40cdabe1a85eba7543f4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.596767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.659840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912605-050a-40e2-a889-579b5c566af2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.676843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.677755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.678682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.680340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.681629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.690797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.702216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff38053f715c40cdabe1a85eba7543f4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.720914 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2835/5696] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:19.721904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.728784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff38053f715c40cdabe1a85eba7543f4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.729703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff38053f715c40cdabe1a85eba7543f4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.742448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff38053f715c40cdabe1a85eba7543f4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.744334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff38053f715c40cdabe1a85eba7543f4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:19.752600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13070c9d-275a-4076-8a68-96abb909e7e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.757977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:19.770930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.772002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.772286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.772575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.773240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:19.774326 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2862/5697] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:19 2022] DELETE /identity/v3/users/ff38053f715c40cdabe1a85eba7543f4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:19.775309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.777615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.781789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.783515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.826123 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2836/5698] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:19.827155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.831215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:19.869411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978af4e-ab56-4447-a3d2-7a267982279d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.873660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ed13d-f865-45be-bcf5-ae9a4c1ea9f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:19.883371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.884195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.884576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.885171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] PATH_INFO: `/v3/projects/eb077040dfd646f492582b37259967bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.887561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb077040dfd646f492582b37259967bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.891569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:19.892751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:19.893263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:19.893445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.893768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] PATH_INFO: `/v3/projects/42b7844e716941879d55a8f6e48c4ed2/users/a9b0f864ce1b4808b5b00208e0f91683/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:19.927429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b7844e716941879d55a8f6e48c4ed2, user_id=a9b0f864ce1b4808b5b00208e0f91683, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:19.943985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:19.980435 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2837/5699] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:19 2022] PUT /identity/v3/projects/42b7844e716941879d55a8f6e48c4ed2/users/a9b0f864ce1b4808b5b00208e0f91683/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:19.981342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:19.985803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:20.009167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb077040dfd646f492582b37259967bb', 'request_id': 'req-26d7659f-789b-496e-afe7-39908dd56040'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.016739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb077040dfd646f492582b37259967bb', 'request_id': 'req-26d7659f-789b-496e-afe7-39908dd56040'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.038067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb077040dfd646f492582b37259967bb', 'request_id': 'req-26d7659f-789b-496e-afe7-39908dd56040'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.069805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] The token cache is being invalidate because project eb077040dfd646f492582b37259967bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:20.070127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.071676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.076971 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2863/5700] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:19 2022] DELETE /identity/v3/projects/eb077040dfd646f492582b37259967bb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:20.081514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:20.085443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:20.154393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c246613-c975-4141-9b38-502e77871b90 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.325024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7659f-789b-496e-afe7-39908dd56040 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.325024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.325024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.325024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.325623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.325623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.325623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.367738 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2864/5701] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:20.367738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:20.382848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:20.393037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.393837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.394361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.394938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.395720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.398052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.415529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e5629-97d3-444b-b16f-05980015a8d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.432512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.433203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.433480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.433750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] PATH_INFO: `/v3/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.435005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884d28cfdd1f4bf2ad0bc2b40c29e6b6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.436925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.458693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2838/5702] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:19 2022] POST /identity/v3/projects => generated 387 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:20.464322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:20.476083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:20.480797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:20.585202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884d28cfdd1f4bf2ad0bc2b40c29e6b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.605813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884d28cfdd1f4bf2ad0bc2b40c29e6b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.607068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884d28cfdd1f4bf2ad0bc2b40c29e6b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.627886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884d28cfdd1f4bf2ad0bc2b40c29e6b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.629331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884d28cfdd1f4bf2ad0bc2b40c29e6b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:20.637357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe36b7-0414-4a11-8f58-503cb26fa7bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.649026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.650749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.651310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.651740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] PATH_INFO: `/v3/projects/42b7844e716941879d55a8f6e48c4ed2/users/a9b0f864ce1b4808b5b00208e0f91683/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.656573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b7844e716941879d55a8f6e48c4ed2, user_id=a9b0f864ce1b4808b5b00208e0f91683, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.662661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.697100 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2865/5704] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:20 2022] DELETE /identity/v3/users/884d28cfdd1f4bf2ad0bc2b40c29e6b6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:20.698690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:20.703999 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2839/5704] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:20 2022] PUT /identity/v3/projects/42b7844e716941879d55a8f6e48c4ed2/users/a9b0f864ce1b4808b5b00208e0f91683/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:20.705335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:20.707217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:20.714980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:20.795399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11041046-f519-4e07-8a0c-066e79996bb0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.876580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4e83-430e-48e1-bdcc-979db88754c7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:20.883619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.883619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.884048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.884558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.885436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.887520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9587c-27d7-472f-b930-d830bd8c7b54 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.898038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:20.898811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.899096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.899367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] PATH_INFO: `/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:20.900643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5445c67dc7db4db598e6cb8f500c7a0b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:20.902821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:20.943563 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2866/5705] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:20 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:20.949687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fcd61-1403-41f1-9f47-6951baccbba4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:20.950127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fcd61-1403-41f1-9f47-6951baccbba4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:20.951557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fcd61-1403-41f1-9f47-6951baccbba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.044935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:21.047774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f46fcd61-1403-41f1-9f47-6951baccbba4 None None] MFA Rules not processed for user `a9b0f864ce1b4808b5b00208e0f91683`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:21.049661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f46fcd61-1403-41f1-9f47-6951baccbba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:21.054524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5445c67dc7db4db598e6cb8f500c7a0b', 'request_id': 'req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:21.078290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5445c67dc7db4db598e6cb8f500c7a0b', 'request_id': 'req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:21.091231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5445c67dc7db4db598e6cb8f500c7a0b', 'request_id': 'req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:21.117075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] The token cache is being invalidate because project 5445c67dc7db4db598e6cb8f500c7a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:21.117792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:21.118747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:21.124637 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2840/5706] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:20 2022] DELETE /identity/v3/projects/5445c67dc7db4db598e6cb8f500c7a0b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:21.126034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.128117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:21.215783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2867/5707] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:21.218655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.219732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.220220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.260542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:21.273101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:21.274771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:21.339660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84b2c-9c68-4be9-bacb-9fa7e3466803 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.350682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:21.351845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.355410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.355994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.358836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:21.361997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:21.410548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2841/5708] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:21.411465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.430049 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2868/5709] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:21.446036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.450376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6489-cda3-42ec-8ebb-5caf389d0d2a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.475299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:21.476804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.478409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.479658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.483048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:21.490737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46faa69-1701-4d09-8332-0248cfec91f8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.491356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab7660-8b57-499d-94b3-7083d0f7bed9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:21.515175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:21.517548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.518575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.519964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.524542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:21.532019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2842/5710] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:21 2022] POST /identity/v3/domains => generated 276 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:21.533672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.534216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:21.535743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.538468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.572711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2869/5711] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:21.574549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.596814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56bf-4980-4642-8aa7-4ae6eb92dbe1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.599346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:21.603635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:21.753278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:21.756668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.757485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.757988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.758990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:21.760329 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:21.760329 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:21.760329 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:21.762479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:21.788269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2843/5712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:21.789212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.819262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135542e2-8621-4249-860b-178c15cdfd43 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.836867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:21.838376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:21.839880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:21.840829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] PATH_INFO: `/v3/projects/7319c627f6264027a82a99e9da28c95f/users/e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:21.878156 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2870/5713] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:32:21 2022] PUT /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config => generated 138 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:21.879984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.884273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:21.887473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7319c627f6264027a82a99e9da28c95f, user_id=e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:21.890295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:21.912254 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2844/5714] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:21 2022] PUT /identity/v3/projects/7319c627f6264027a82a99e9da28c95f/users/e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:21.914029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:21.929402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6cdc3-8053-4df9-8579-6b2e3d12c7a9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:21.985756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:22.062719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e722d-87a6-442f-9bda-5abd5121a73f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.071462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.072104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.072386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.072658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.073351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:22.073654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.075387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:22.110534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.111796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.114222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.119524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] PATH_INFO: `/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.132460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c934f4e4620a44f08f07ba35a6d29f3a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.135287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:22.162190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2845/5715] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:22.165192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:22.179066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:22.283263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c934f4e4620a44f08f07ba35a6d29f3a', 'request_id': 'req-56fa45df-772e-4de5-be98-2c979be37c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:22.305605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c934f4e4620a44f08f07ba35a6d29f3a', 'request_id': 'req-56fa45df-772e-4de5-be98-2c979be37c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:22.316719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c934f4e4620a44f08f07ba35a6d29f3a', 'request_id': 'req-56fa45df-772e-4de5-be98-2c979be37c38'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:22.330613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9331a-f5df-4c95-adf3-a788c8595456 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.342494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] The token cache is being invalidate because project c934f4e4620a44f08f07ba35a6d29f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:22.342792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:22.343692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-56fa45df-772e-4de5-be98-2c979be37c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:22.349536 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2871/5716] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:21 2022] DELETE /identity/v3/projects/c934f4e4620a44f08f07ba35a6d29f3a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:22.351608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbafeea-0e0a-49fd-beed-0a454fd5225f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.351954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbafeea-0e0a-49fd-beed-0a454fd5225f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.360691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbafeea-0e0a-49fd-beed-0a454fd5225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.414191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4cbafeea-0e0a-49fd-beed-0a454fd5225f None None] MFA Rules not processed for user `e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:22.416188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4cbafeea-0e0a-49fd-beed-0a454fd5225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.481646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.483247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.483893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.484434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.486277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13, group=identity)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.487794 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:22.487794 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:22.487794 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:22.489586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:22.501100 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2846/5717] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:32:22 2022] GET /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/identity => generated 45 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:22.503080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:22.505995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.521836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2872/5718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:22.521836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.521836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.521836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.553350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:22.554637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.610854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865f217-6ca5-4480-a48e-c0129a03096a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.619638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.622594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.624647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.625406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.626640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.630681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:22.695908 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2873/5719] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:22.697754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:22.703716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.705136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:22.730793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0357f4-7776-41f5-918f-1c062d51dca3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.740451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2847/5720] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:22.746180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:22.754316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.803935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:22.893811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.895502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.895658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.895844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/identity/driver` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.900835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13, group=identity, option=driver)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.901914 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:22.901914 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:22.901914 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:22.902812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4efbc-ef6c-46b2-9219-92912b90d687 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:22.915186 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2874/5721] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:32:22 2022] GET /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/identity/driver => generated 31 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:22.916854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.917194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.917466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.959804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:22.961654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:22.973615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8a2b7-f815-48c9-b05a-49d4af56251d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.976772 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2875/5722] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:22.977948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:22.991181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:22.992113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:22.992534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:22.993118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:22.993936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:22.994872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba3dbb-8f7a-4ae6-b6a4-86745a063e10 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:22.996498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.001319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.001948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.002232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.002733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.003392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.006666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.048038 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2848/5723] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/projects => generated 387 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:23.048038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.049025 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2876/5724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:22 2022] POST /identity/v3/users => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:23.073096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.131757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4268391-f6be-4146-9518-c795e0197142 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.187920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf59702-952c-49d4-9074-6c96ac721233 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.210218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.210807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.211093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.211370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.218178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13, group=ldap)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.230093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.246527 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2849/5725] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap => generated 106 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:23.246527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.273962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.274746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.275030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.275297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.275996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:23.276295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.278269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.310857 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2877/5726] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:23.312753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.337110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3944d4-1cfc-4fb4-ad32-735022f53ea1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.373453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.374138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.385493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.385944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.387151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.415247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.443230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb923e-8b91-4547-a836-8e0f7feef14c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.449655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.450661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.451123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.451651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.453283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.456074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.456976 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2878/5727] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:23 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:23.458686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.461238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:23.475315 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2850/5728] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:23.476571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.501810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7c491-ee32-43a1-8007-e67f77438331 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.515768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.517063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.517483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.518005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap/url` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.520185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13, group=ldap, option=url)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.522504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.532191 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2851/5729] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap/url => generated 46 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:23.537811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.552794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1757-3fbb-4a6f-a804-17fc956d4a56 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.561931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.562810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.563456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.564018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.566066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.570089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.592107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:23.594564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:23.604065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031488-2ace-4c70-98a4-2f6ae3dd1be6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.613408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.614388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.615538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.615980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.618738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:23.634970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2852/5730] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:23 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:23.636924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.772291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.774272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.807419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90f4e-fa39-4f45-a9d1-10e29a0d0336 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.813878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2879/5731] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:23.815666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.820326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.821086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.821434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.821777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.822500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.824300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.870786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2853/5732] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:23.871990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:23.873136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61be393-dbc4-4191-8ddd-791f5410e1d0 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:23.894211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:23.895524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:23.911481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:23.912143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:23.912868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:23.915257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:23.945450 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2880/5733] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:23.946400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.004186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b769d8e-c1b4-470e-b343-29e565b20302 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.018402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.019403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.019805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.020203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.020929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.038232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3202-7274-4733-a18f-44cafa20c7c6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.045321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.054055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.054842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.055184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.055522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap/user_tree_dn` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.056975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13, group=ldap, option=user_tree_dn)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.058795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.077613 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2854/5734] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Oct 18 16:32:23 2022] GET /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config/ldap/user_tree_dn => generated 63 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:24.078580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.115240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65fcbe-b733-46f8-b7a1-14f475b79d1a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.128951 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2881/5735] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:23 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:24.129350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.129350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.129585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.129679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.129679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] PATH_INFO: `/v3/projects/d44709fd78824cf791d42ec5a7b86afc/users/4cef45e3e0ba427b979555657a04dd66/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.143608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953c53f-7a06-4b98-9b57-8133dfd809aa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.166253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.166971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.167239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.167525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] PATH_INFO: `/v3/projects/7a581a4dd06144efad21fe179f061352/users/dad292d014e345beafc89e8ec6460ec5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.176812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44709fd78824cf791d42ec5a7b86afc, user_id=4cef45e3e0ba427b979555657a04dd66, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.180295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.200181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a581a4dd06144efad21fe179f061352, user_id=dad292d014e345beafc89e8ec6460ec5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.203758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.210492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2855/5736] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:24 2022] PUT /identity/v3/projects/d44709fd78824cf791d42ec5a7b86afc/users/4cef45e3e0ba427b979555657a04dd66/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:24.212493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.242699 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2882/5737] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:24 2022] PUT /identity/v3/projects/7a581a4dd06144efad21fe179f061352/users/dad292d014e345beafc89e8ec6460ec5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:24.244140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.383356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9446be-d00c-438f-b47b-d810a6cad16b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.392639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:24.393095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7185f-10cb-4166-bbb3-4b9c7b35ece7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.403179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.403815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.404906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.405413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.406209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.408847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.489787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2883/5738] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:24.489787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.495992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.496872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.497601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.498634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.499814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=aee00f94d1e9413d86bfefb378a6be13)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.504513 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:24.504513 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:24.504513 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:24.510250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bc84-d701-4d3f-95d4-9787a067292f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.533884 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2856/5739] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:24 2022] DELETE /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13/config => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:24.534116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1d39-55c4-485f-8fba-3be79098034f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.535452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.536263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.538457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.558943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.559544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.559851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.560099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.560834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.562437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.608197 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2884/5740] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:24.612688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.622846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] MFA Rules not processed for user `dad292d014e345beafc89e8ec6460ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:24.625671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:24.646115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f76109-658c-48d9-8d76-81120673eb20 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.677318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.677990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.678245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.678857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.679175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.681095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.718057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2885/5741] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:24.719934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.767058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e1972-3949-43c8-b7bd-77e0b1f97a58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.782964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.783687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.783905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.784181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.791550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aee00f94d1e9413d86bfefb378a6be13)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.793279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.819130 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2857/5742] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:24.820279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.848752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868df7-78f5-410b-be13-91bc876e45e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:24.855800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:24.859133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:24.860144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:24.860426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:24.860744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] PATH_INFO: `/v3/projects/d44709fd78824cf791d42ec5a7b86afc/users/4cef45e3e0ba427b979555657a04dd66/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:24.866649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:24.868347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:24.870855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44709fd78824cf791d42ec5a7b86afc, user_id=4cef45e3e0ba427b979555657a04dd66, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:24.873932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:24.900265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2858/5743] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:24 2022] PUT /identity/v3/projects/d44709fd78824cf791d42ec5a7b86afc/users/4cef45e3e0ba427b979555657a04dd66/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:24.901207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.911785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:24.948049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:24.949906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:24.960161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2886/5744] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:24 2022] PATCH /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13 => generated 277 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:24.962144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:24.964521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:25.088424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d73ebb-fdfe-47a5-b23d-37c937b14b43 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:25.110390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:25.111318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:25.111699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:25.112059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] PATH_INFO: `/v3/projects/9cd424c869de4ad5ade60a2b96fd85a0/users/9965671245ca45988258c031eb628d29/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:25.147491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd424c869de4ad5ade60a2b96fd85a0, user_id=9965671245ca45988258c031eb628d29, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:25.152544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59dbc6-98e1-4386-9e7d-254b80e59ecd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:25.203379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2859/5745] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:24 2022] PUT /identity/v3/projects/9cd424c869de4ad5ade60a2b96fd85a0/users/9965671245ca45988258c031eb628d29/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:25.203379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825f25-a3da-42cf-ab07-2db72addcd3b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:25.203379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825f25-a3da-42cf-ab07-2db72addcd3b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:25.203379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825f25-a3da-42cf-ab07-2db72addcd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:25.213536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:25.264254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53b29d-1ad7-40f9-9429-60cded604cf0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:25.303701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-68825f25-a3da-42cf-ab07-2db72addcd3b None None] MFA Rules not processed for user `4cef45e3e0ba427b979555657a04dd66`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:25.307092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-68825f25-a3da-42cf-ab07-2db72addcd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:25.467085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:25.467906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:25.468276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:25.468639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:25.469409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:25.477288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:25.553029 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2887/5746] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:24 2022] POST /identity/v3/projects => generated 377 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:25.555081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:25.560839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:25.608019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2860/5747] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:25.610105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:25.610387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:25.610659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:25.741642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] MFA Rules not processed for user `9965671245ca45988258c031eb628d29`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:25.743185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b99691-dd62-4ddb-9f00-e68d61058b37 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:25.744761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:25.751332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:25.752765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:25.753333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:25.755565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:25.780506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aee00f94d1e9413d86bfefb378a6be13)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:25.782518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:25.793259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:25.844182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:25.858029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:25.939151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2861/5748] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:25.949788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:25.964262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:25.975254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:25.982809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.011774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] The token cache is being invalidate because project aee00f94d1e9413d86bfefb378a6be13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:26.012076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.012975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.038093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.040027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.041495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aee00f94d1e9413d86bfefb378a6be13', 'request_id': 'req-b2fd8c2a-d45e-417c-b593-07370368ac5d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:26.061114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2888/5749] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:25 2022] DELETE /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:26.065223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:26.068429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:26.131641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8b21c-1211-457a-a36f-5748c652edad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:26.201553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:26.254884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8c2a-d45e-417c-b593-07370368ac5d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:26.266214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:26.267356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:26.268789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:26.269764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:26.271955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:26.275420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:26.291384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:26.292094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:26.292383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:26.292650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:26.293513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:26.297227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:26.345858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2889/5750] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:26 2022] POST /identity/v3/projects => generated 358 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:26.348058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:26.354103 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2862/5751] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:25 2022] POST /identity/v3/users => generated 295 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:26.355001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:26.355661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:26.387866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:26.450312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:26.516266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fb26f-766c-468e-877d-00954b50ef66 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:26.523847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:26.524890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:26.525359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:26.525847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:26.526757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:26.533480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:26.593877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2890/5752] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:26 2022] POST /identity/v3/projects => generated 363 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:26.593877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:26.653466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64573e7-f66d-4b35-81ad-2dd89d40ab6c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:26.802817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:26.803716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:26.804110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:26.804509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:26.805347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:26.810321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:26.862461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056f5d-f805-4589-bd0a-92c4d2899e56 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:26.871100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:26.871835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:26.872193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:26.872391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1484784806` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:26.874265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2863/5753] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:26 2022] POST /identity/v3/domains => generated 276 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:26.874412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=768a367f12a84a4aad558491ddd4d12b, value=tempest-tag-1484784806)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:26.875340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:26.876438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:26.880132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:27.073345 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1484784806. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:32:27.073345 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:32:27.073345 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:27.076599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:27.092047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264e6f7-a389-48fa-b9d9-c3f1e3310cc2 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.092251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2891/5754] 10.222.0.78 () {60 vars in 1333 bytes} [Tue Oct 18 16:32:26 2022] PUT /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1484784806 => generated 0 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 18 16:32:27.092449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.099579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.100205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.100489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.100803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.101486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.103114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:27.132413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2864/5755] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:27.133426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.249084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2a87b-b30f-4b1d-893f-fd66354fe874 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.261436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.262072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.262350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.262625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.266837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.271175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:27.287196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26e755-c589-40d1-a369-cb95627add57 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.297808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.298335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.298616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.298890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.299638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.300637 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:27.300637 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:27.300637 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:27.301571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:27.320974 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2892/5756] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:27 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:27.325077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.344454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:27.395430 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2865/5757] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:32:27 2022] PUT /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 138 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:27.399841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.427310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5445618-d829-4f19-9102-8f6786cb795f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.442607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.445980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.446126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.446446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] PATH_INFO: `/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2/users/460c966730dc47dcabe927c4e0296d8e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.537352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10d5e0526dc4e77a64def7cae5cc0b2, user_id=460c966730dc47dcabe927c4e0296d8e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.573226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:27.599554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e040c5-cbd9-4e17-bc6a-5d5492899687 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.639864 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2866/5758] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:27 2022] PUT /identity/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2/users/460c966730dc47dcabe927c4e0296d8e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:27.640965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.880635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.881686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.881970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.882438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1484784806` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.907017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=768a367f12a84a4aad558491ddd4d12b, value=tempest-tag-1484784806)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.909612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:27.950212 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2893/5759] 10.222.0.78 () {58 vars in 1314 bytes} [Tue Oct 18 16:32:27 2022] GET /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1484784806 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:27.951492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:27.963329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788a53-850c-4efb-b981-ad2deaa48ea8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:27.975560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:27.976423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:27.976778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:27.977797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:27.981638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:27.983480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.014428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2867/5760] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:28.015555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.029807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eadc4e-c2b9-4cf0-874f-5a5f01739b60 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.038824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.039901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.047065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.048531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.049848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.053012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.076607 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2868/5761] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:28.077901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.133418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd866b-5ee1-415c-96a6-adced15ba9f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.159368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.160105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.161185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.161185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.165425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=768a367f12a84a4aad558491ddd4d12b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.170243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.187865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b1eb7-9d35-4322-ade4-d56a0df5ef87 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.207943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.211598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.211929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.212212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.215199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.219198 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:28.219198 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:28.219198 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:28.220370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.261215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:28.282543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2894/5762] 10.222.0.78 () {60 vars in 1271 bytes} [Tue Oct 18 16:32:27 2022] PATCH /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 139 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:28.284336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.319346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf41f50-aa7f-4e19-a4c0-247e3cf9418c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.327609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.328464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.328810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.329241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] PATH_INFO: `/v3/projects/7a530bc1b58443c6a76ac31d341b12d1/users/3d4aff69b24f4919aba047902b698f94/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.348772 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2869/5763] 10.222.0.78 () {60 vars in 1265 bytes} [Tue Oct 18 16:32:28 2022] PUT /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags => generated 140 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:28.350096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.352817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:28.360500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a530bc1b58443c6a76ac31d341b12d1, user_id=3d4aff69b24f4919aba047902b698f94, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.370218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.372253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb03b5-004f-49fa-b469-4c2cbecab378 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.383963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.384628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.385741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.386139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] PATH_INFO: `/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2/users/460c966730dc47dcabe927c4e0296d8e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.388472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10d5e0526dc4e77a64def7cae5cc0b2, user_id=460c966730dc47dcabe927c4e0296d8e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.391635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.414764 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2870/5764] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:28 2022] PUT /identity/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2/users/460c966730dc47dcabe927c4e0296d8e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:28.414764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.415517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2895/5765] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:28 2022] PUT /identity/v3/projects/7a530bc1b58443c6a76ac31d341b12d1/users/3d4aff69b24f4919aba047902b698f94/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:28.415517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.562373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790c9f-aa09-4161-a335-91a14046dd3f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.574712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.575400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.575686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.576096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.577377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.579838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac7ae4-80cd-42de-ade2-866ff603a991 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.595613 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2871/5766] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:28 2022] GET /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 139 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:28.597066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.597949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.598295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.644661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2417a1c-9ab4-4b8e-89f6-03b27ca7994f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.656234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] MFA Rules not processed for user `460c966730dc47dcabe927c4e0296d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:28.660925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:28.825521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.827289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.829649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.829955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.849444 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2872/5767] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:28.849444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.855047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=768a367f12a84a4aad558491ddd4d12b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.859227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.895517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2896/5768] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:32:28 2022] GET /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags => generated 140 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:28.897305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:28.920781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517824bc-6101-4455-8cae-8de5afd19c51 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:28.932248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:28.932927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:28.933221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:28.933501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:28.934098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:28.936316 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:28.936316 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:28.936316 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:28.944107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:28.985799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2897/5769] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:28 2022] DELETE /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:28.987754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.011598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:29.039441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f2e3-fadf-4aac-9f9c-d8575414cdf3 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.040149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52dbb6-2b44-4499-a8df-4ceaaa019a56 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.045592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.046336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.046679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.047016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.047756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.049534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.053869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.055010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.055581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.056129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.057699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.059264 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:29.059264 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:29.059264 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:29.060565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.065219 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2873/5770] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:29.065219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.082803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77542fa6-6e35-40e0-a4c8-6d5373a000a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.088881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.089693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.090158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.098079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1041659352` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.098079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=768a367f12a84a4aad558491ddd4d12b, value=tempest-tag-1041659352)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.098079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.102103 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2898/5771] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 18 16:32:28 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:29.103261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.118892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85deb7-24b2-49bb-9a0b-d229410960f9 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.124203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.125422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.125947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.126455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.127942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.130585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find any options in domain configuration for domain 85b85f2e9e72437388af697ba45a8238.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 85b85f2e9e72437388af697ba45a8238. Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 16:32:29.141986 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 85b85f2e9e72437388af697ba45a8238. Oct 18 16:32:29.143108 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:29.146410 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2899/5772] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:29 2022] GET /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 151 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:29.148243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.174571 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1041659352. To ensure interoperability, identifiers should be a valid uuid. Oct 18 16:32:29.174571 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 18 16:32:29.174571 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:29.174983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c62e2-c85c-4d94-abe4-faf9f1ee321e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.181110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.182072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.182475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.183412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2874/5773] 10.222.0.78 () {58 vars in 1317 bytes} [Tue Oct 18 16:32:29 2022] DELETE /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1041659352 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:29.183881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] PATH_INFO: `/v3/projects/7a530bc1b58443c6a76ac31d341b12d1/users/3d4aff69b24f4919aba047902b698f94/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.184766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.188085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a530bc1b58443c6a76ac31d341b12d1, user_id=3d4aff69b24f4919aba047902b698f94, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.199126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.202519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b39ea-f1e8-4efe-aaa8-c7c95a5042ae tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.210271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.211333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.211759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.212312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b579821d96bd4b3b9403265070ee3045` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.213090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b579821d96bd4b3b9403265070ee3045)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.215191 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:29.215191 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:29.215191 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:29.216639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.235608 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2875/5774] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:29 2022] GET /identity/v3/OS-OAUTH1/consumers/b579821d96bd4b3b9403265070ee3045 => generated 221 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:29.237419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.241206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2900/5775] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:29 2022] PUT /identity/v3/projects/7a530bc1b58443c6a76ac31d341b12d1/users/3d4aff69b24f4919aba047902b698f94/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:29.242473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.262621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0201303-ad2c-42a6-a38a-874022bcf2b8 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.358249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:29.383524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.384317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.386039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.386339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238/config` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.386947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.389747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.403022 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2876/5776] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:29 2022] DELETE /identity/v3/domains/85b85f2e9e72437388af697ba45a8238/config => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:29.403022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.433103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26b8f3-18d8-43de-94b4-a14885fe0fe4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.458818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.459697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.460140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.460765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1041659352` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.507336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=768a367f12a84a4aad558491ddd4d12b, value=tempest-tag-1041659352)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.513514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.551456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bbeef-55b0-4b11-a694-61eaa286fe76 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.569706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.571277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.571798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.572980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b579821d96bd4b3b9403265070ee3045` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.573883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b579821d96bd4b3b9403265070ee3045)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.577530 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:29.577530 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:29.577530 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:29.578952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.579386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer b579821d96bd4b3b9403265070ee3045 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:29.579768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.580759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-59cf5cb3-b26a-449a-96e4-703132a32a48 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Could not find project tag: tempest-tag-1041659352.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1041659352. Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 18 16:32:29.592577 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1041659352. Oct 18 16:32:29.593650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:29.602732 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2901/5777] 10.222.0.78 () {58 vars in 1314 bytes} [Tue Oct 18 16:32:29 2022] GET /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags/tempest-tag-1041659352 => generated 107 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:29.617509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.617800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.618077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.637766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b579821d96bd4b3b9403265070ee3045', 'request_id': 'req-1a7d4ecf-a972-4907-8848-e6c466fbc37e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.674158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2877/5778] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:29 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b579821d96bd4b3b9403265070ee3045 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:29.674389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.676949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:29.715541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d4ecf-a972-4907-8848-e6c466fbc37e tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:29.748224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] MFA Rules not processed for user `3d4aff69b24f4919aba047902b698f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:29.750590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:29.751527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:29.754404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:29.755252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:29.759653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:29.764971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:29.768916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:29.808417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:29.859983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.861420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.927298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.931985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:29.937456 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2878/5779] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:29 2022] PATCH /identity/v3/domains/85b85f2e9e72437388af697ba45a8238 => generated 277 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:29.939908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.946362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:29.960504 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2902/5780] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:29.962422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:29.964042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:29.983959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b88c1b-bb7d-42a4-8fc2-9aa7598ffeb4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.107112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.108252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.108736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.109252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.109380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df543c-0e97-40ab-aace-83e310a13398 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.111155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.113410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.119827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.121220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.121220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.121220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.123642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=768a367f12a84a4aad558491ddd4d12b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.131989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.147447 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2903/5781] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 18 16:32:29 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:30.149072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.151424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.238400 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2879/5782] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:29 2022] DELETE /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:30.240149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.242406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.252182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:30.294278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f9d18-dd98-44ff-b7f7-79613aeaef0d tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.306724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.307397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.307684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.307961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.325289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=85b85f2e9e72437388af697ba45a8238)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.329226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.365191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e874d36-790e-4ffa-94a0-9566c1d8b81e tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.368100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.373620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '85b85f2e9e72437388af697ba45a8238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.386880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.387531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.387845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.388099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.388789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.391356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.420155 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2880/5783] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:30 2022] POST /identity/v3/roles => generated 235 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:30.420155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.423040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.451117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.460304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.471290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.486477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:30.489966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] The token cache is being invalidate because project 85b85f2e9e72437388af697ba45a8238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:30.490487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.492143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.504864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.506118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.508145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '85b85f2e9e72437388af697ba45a8238', 'request_id': 'req-331584c5-df1e-44b3-a370-79fb92cec94d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:30.513791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09995a-aeb3-49e4-87a9-54d9be303242 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.521198 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2904/5784] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:30 2022] DELETE /identity/v3/domains/85b85f2e9e72437388af697ba45a8238 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:30.522425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.526692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.582491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.583202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.583493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.583741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.590391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.620667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331584c5-df1e-44b3-a370-79fb92cec94d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.630230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.631041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.631370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.631621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.632245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bbec73aefecb41b4bdbd370e493517c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.633388 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:30.633388 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:30.633388 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:30.634307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.646840 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2905/5785] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:30 2022] GET /identity/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0 => generated 221 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:30.648697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.651261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.682854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:30.700275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.704684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.722950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2881/5786] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:30.724190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.727600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.789892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ec0c-14ed-4ef7-850a-d11576cfceb3 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.818247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.820028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.822337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.822990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.856901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=768a367f12a84a4aad558491ddd4d12b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.862534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.864365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa2441-e059-43df-965c-5fcccbe49b94 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:30.877685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:30.880638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:30.881760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:30.883622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:30.884548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:30.889248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:30.899092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2906/5787] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:32:30 2022] GET /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b/tags => generated 66 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:30.900571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.904387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:30.962610 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2882/5788] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:30 2022] POST /identity/v3/roles => generated 235 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:30.964117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:30.991481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64582b7-fbcb-4462-b962-760de2122340 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.012793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.013517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.013801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.014076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.014684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bbec73aefecb41b4bdbd370e493517c0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.016527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.016835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer bbec73aefecb41b4bdbd370e493517c0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:31.017181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.019613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.047176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bbec73aefecb41b4bdbd370e493517c0', 'request_id': 'req-224bec17-5eda-48b4-8514-4608e43e2cc4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.074185 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2883/5789] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:30 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:31.074185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.074185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.077460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd88bcf-ec61-482f-aecc-34fbed1975a1 tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.090863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bec17-5eda-48b4-8514-4608e43e2cc4 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.096109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cef45e3e0ba427b979555657a04dd66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd44709fd78824cf791d42ec5a7b86afc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.096908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.097946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.098425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] PATH_INFO: `/v3/projects/768a367f12a84a4aad558491ddd4d12b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.099791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorizing `identity:delete_project(project_id=768a367f12a84a4aad558491ddd4d12b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.100364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.101653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.101859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.102170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.105372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.108387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.110325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.121547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:31.154899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2907/5790] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:30 2022] POST /identity/v3/domains => generated 277 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:31.159369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.162825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.220158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768a367f12a84a4aad558491ddd4d12b', 'request_id': 'req-c9177eae-b8f7-4fa2-87dd-13874d4a724f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.238269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768a367f12a84a4aad558491ddd4d12b', 'request_id': 'req-c9177eae-b8f7-4fa2-87dd-13874d4a724f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.255930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768a367f12a84a4aad558491ddd4d12b', 'request_id': 'req-c9177eae-b8f7-4fa2-87dd-13874d4a724f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.273254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] The token cache is being invalidate because project 768a367f12a84a4aad558491ddd4d12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:31.273555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.274472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2ba1-5a9b-48d6-a826-d4e7e6ae3352 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.274961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.281109 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2884/5791] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:31 2022] DELETE /identity/v3/projects/768a367f12a84a4aad558491ddd4d12b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:31.282441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.287924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.350037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:31.380395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.381095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.381379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.381651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.382603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.391948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.425079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9177eae-b8f7-4fa2-87dd-13874d4a724f tempest-IdentityV3ProjectTagsTest-1249512888 tempest-IdentityV3ProjectTagsTest-1249512888-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.431557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2908/5792] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:31 2022] POST /identity/v3/roles => generated 235 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:31.431557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.433340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.450609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.452393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.457396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.459235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.460154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=bbec73aefecb41b4bdbd370e493517c0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.463282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 18 16:32:31.505232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 18 16:32:31.506218 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:31.506780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2885/5793] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:31 2022] GET /identity/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0 => generated 74 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:32:31.507602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.510030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.601202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbfc7e-a96a-4017-951c-78a334e914c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.615364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.616942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.618218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.619980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.620890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.626638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.657220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a8373-a49b-4afd-9457-af68694759c1 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.665307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.666083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.666213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.666481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] PATH_INFO: `/v3/users/e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.668284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.670501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.725408 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2909/5794] 10.222.0.78 () {60 vars in 1269 bytes} [Tue Oct 18 16:32:31 2022] PUT /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config => generated 138 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:31.728707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.745961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.762366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:31.764716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ec4a-c271-4ce0-ab0c-eb49c6cb9e14 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.770934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:31.771862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:31.772150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:31.772437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:31.773135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:31.774751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:31.789140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.790351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.799522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.801324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.807326 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2910/5795] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:31 2022] POST /identity/v3/domains => generated 277 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:31.807326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.808719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.812676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:31.841047 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2886/5796] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:31 2022] DELETE /identity/v3/users/e6aa35dc6f2a41fcbfdc0e9ba5d4ee3d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:31.845433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:31.847041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:31.947998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06eaa7-61bd-4321-985c-f6974204700d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:31.991377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd366-6319-45ff-904e-0dfa19752ab2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.001713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.002731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.003083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.003435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.005059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.006459 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:32.006459 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:32.006459 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:32.008357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.035078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:32.056522 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2887/5797] 10.222.0.78 () {60 vars in 1297 bytes} [Tue Oct 18 16:32:31 2022] PATCH /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity => generated 176 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:32.058814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.060789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.061513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.062207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.062545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.062829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.063437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bbec73aefecb41b4bdbd370e493517c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.064864 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:32.064864 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:32.064864 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:32.066255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.066601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer bbec73aefecb41b4bdbd370e493517c0 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:32.066915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.067931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-659cad32-c9a4-4d7d-be55-79109c90051c tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 18 16:32:32.099603 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:32.101261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2911/5798] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:31 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bbec73aefecb41b4bdbd370e493517c0 => generated 74 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:32:32.102595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.102877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.103200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.130761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:32.132247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.161674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c9320-cdb5-4fc5-ad87-df0b00442073 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.168722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.169592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.171074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.171557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.172362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.175851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.237046 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2912/5799] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:32.237046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.243863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.251705 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2888/5800] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.253186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.255987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.267080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:32.269607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c66502-03eb-475a-ac9d-82d0c20954dc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.361409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969db9a-5d76-48f8-bd1a-f38431beb986 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.365563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.366798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.367271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.367431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.368093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.368332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.368450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.368895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.369641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.369965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity, option=driver)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.370782 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:32.370782 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:32.370782 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:32.371849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.372446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.394506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2889/5801] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.394506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.396758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.409711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2913/5802] 10.222.0.78 () {60 vars in 1318 bytes} [Tue Oct 18 16:32:32 2022] PATCH /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver => generated 176 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:32.411178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.413730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.473871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1dfa3-2b61-4cd0-82a2-890c29d127bd tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.478794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.479770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.480233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.480812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.514307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8de88b-a3c4-44a1-ba00-1b9553c84124 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.519633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.520887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.521404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.521686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/groups` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.522539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.524460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.529087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:32.557608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2914/5803] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/groups => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.559765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.574528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b781a-e856-4844-8b40-9a3ec7b9dda8 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.584012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.584795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.585133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.586645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.586849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.591789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.597643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.599135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.611760 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2890/5804] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:32.613671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.627587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146432a-4f0c-4e75-9e4f-df1d45ff2990 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.632770 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2915/5805] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.633263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.637954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.638965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.639406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.639874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.640847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity, option=driver)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.642699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.664025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00cbbc-159d-484a-a5cc-539e84152477 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.667341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2891/5806] 10.222.0.78 () {58 vars in 1299 bytes} [Tue Oct 18 16:32:32 2022] DELETE /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:32.668703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.676324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.677185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.677471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.678623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.679400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.694269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.699656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5143599-3196-400c-9ada-36f0183cc722 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.704956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.705810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.706091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.706410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.708159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.709916 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:32.709916 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:32.709916 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:32.711285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.726893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2892/5807] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Oct 18 16:32:32 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:32.730708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.741136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2916/5808] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/roles => generated 235 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.741987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.768569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95177c2-6bb2-4e8f-a4a1-44fea8922e5b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.778136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.778818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.779113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.779375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.787625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity, option=driver)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.789553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.794274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428ea8b-9144-4c42-b2f2-bbe23c2b1f30 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find option driver in group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:32.813868 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:32.815394 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:32.818512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.824406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2893/5809] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Oct 18 16:32:32 2022] GET /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity/driver => generated 171 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:32.824406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.825614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.825827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.826325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0e0228e464914ca1b92f8a1f9389beae` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.828608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0e0228e464914ca1b92f8a1f9389beae)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.831122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.836111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer 0e0228e464914ca1b92f8a1f9389beae has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:32.837880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.845563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.851363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e5e4-22ca-476e-a94a-c3d500ab2d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.864962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.865290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.866953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.871638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.872709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.873216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0e0228e464914ca1b92f8a1f9389beae', 'request_id': 'req-171335fe-c4c9-450c-b8a5-538cb3483107'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.875548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.893132 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2917/5810] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0e0228e464914ca1b92f8a1f9389beae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:32.894282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.896299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.898281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:32.920297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2894/5811] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:32 2022] POST /identity/v3/users => generated 436 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:32.925936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:32.928563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:32.941558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171335fe-c4c9-450c-b8a5-538cb3483107 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.953820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.954490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.954797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.955065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.955691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.957527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.964666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5de1-13ab-4ce8-8310-b8b997179e6d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:32.971403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:32.973938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:32.974221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:32.974495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/5b844eb424cd4b7da6cf69729beb1844` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:32.975189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=5b844eb424cd4b7da6cf69729beb1844)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:32.977242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:32.977521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer 5b844eb424cd4b7da6cf69729beb1844 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:32.977974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:32.978696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.001435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '5b844eb424cd4b7da6cf69729beb1844', 'request_id': 'req-0a6e8eef-705e-4046-bcc5-dafc437ca768'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.008304 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2918/5812] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:32:32 2022] DELETE /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.009512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.011752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.028699 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2895/5813] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:32 2022] DELETE /identity/v3/OS-OAUTH1/consumers/5b844eb424cd4b7da6cf69729beb1844 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.030653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.032973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.033365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6a2a-fb9e-4ea2-a176-a86bcf028b68 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.040407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.042099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.042581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.043010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.044473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.049591 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:33.049591 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:33.049591 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:33.051653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.054056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8eef-705e-4046-bcc5-dafc437ca768 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.059958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.061686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.062007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.062541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.064171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea, group=identity)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.067241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:33.077678 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:33.078697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:33.083280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2896/5814] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Oct 18 16:32:33 2022] GET /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config/identity => generated 154 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:33.083280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.083280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.089569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2919/5815] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:33 2022] POST /identity/v3/roles => generated 269 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:33.090746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.103290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf8ce-ec53-4ed4-8bba-ab12bc5a219c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.110874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.111510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.111786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.112055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.112921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.114675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.131771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ea4-d871-4958-9a4c-cba4ffa88def tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.134449 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2897/5816] 10.222.0.78 () {60 vars in 1185 bytes} [Tue Oct 18 16:32:33 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:33.135418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.138164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.138948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.139246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.139918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea/config` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.140944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2d59b4f814b74303a9631238faf70fea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.146274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.156257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f100d9-17ab-48e6-8c02-7ead45b9eb47 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.162899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.163719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.164109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.164476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/19fb5d52749749ff9e10341064b8c0ec` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.165726 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2920/5817] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:33 2022] DELETE /identity/v3/domains/2d59b4f814b74303a9631238faf70fea/config => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.167186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.187259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512932f4-3d0b-4b0b-a5ca-b7ba23e56732 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.187684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=19fb5d52749749ff9e10341064b8c0ec)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.191727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.195159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.196195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.196641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.197184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.198065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=372dc61fd0a94761bc1eed7973a3d89a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.199654 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:33.199654 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:33.199654 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:33.201051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.215705 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2898/5818] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:33 2022] PUT /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/19fb5d52749749ff9e10341064b8c0ec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.218156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.225803 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2921/5819] 10.222.0.78 () {60 vars in 1285 bytes} [Tue Oct 18 16:32:33 2022] PATCH /identity/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a => generated 220 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:33.226936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.244367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e220f20-d093-4a9b-ae08-132bbf5da901 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.339601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fd52-ba1e-4c1f-924e-6df4ea8b5c89 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.353741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.355149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.355434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.355800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.357221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2d59b4f814b74303a9631238faf70fea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.357912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.358846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.358977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.363320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.363738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.364542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Adding query filter params (scope.project.id=19f2cc74793f4775beb55c8a005e248b, user.id=15e039834f6343f4817ce83216e91964) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:33.364857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.376895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.405691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.409054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.471465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.472854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.478912 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2899/5820] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:33 2022] PATCH /identity/v3/domains/2d59b4f814b74303a9631238faf70fea => generated 278 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:33.481393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.483135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.500551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:33.512885 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2922/5821] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:32:33 2022] GET /identity/v3/role_assignments?scope.project.id=19f2cc74793f4775beb55c8a005e248b&user.id=15e039834f6343f4817ce83216e91964&effective => generated 228 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:33.514825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.518505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.552005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426edd3b-1977-4641-b6ba-3822e71bf695 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.588701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=93,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:33.622415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fb05b-a6e1-4731-ba37-817bd28e2204 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.630038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.631025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.631520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.631992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.632801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=372dc61fd0a94761bc1eed7973a3d89a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.635014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.642108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2900/5822] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:33 2022] GET /identity/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a => generated 220 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:33.645863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.648960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.663350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.664156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.664740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.665145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.702771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2d59b4f814b74303a9631238faf70fea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.704400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.734392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.740782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2d59b4f814b74303a9631238faf70fea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.764944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a6635-e619-43ce-ba7e-e43c840bfc3b tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:33.771323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:33.772084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:33.772464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:33.772805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/19fb5d52749749ff9e10341064b8c0ec` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:33.775642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=19fb5d52749749ff9e10341064b8c0ec)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:33.778925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:33.788770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 19fb5d52749749ff9e10341064b8c0ec was removed from user 15e039834f6343f4817ce83216e91964 on project 19f2cc74793f4775beb55c8a005e248b. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:33.789169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.790470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.808541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.818804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.828983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2901/5823] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:32:33 2022] DELETE /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/19fb5d52749749ff9e10341064b8c0ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.829912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.832211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.876277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.904788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] The token cache is being invalidate because project 2d59b4f814b74303a9631238faf70fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:33.905139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.906689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.925533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.933761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.934639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2d59b4f814b74303a9631238faf70fea', 'request_id': 'req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:33.954284 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2923/5824] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:33 2022] DELETE /identity/v3/domains/2d59b4f814b74303a9631238faf70fea => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:33.954284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:33.955083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:33.992512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c573b-644b-4c3c-b4e1-bd3ff31a8085 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.008328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.008986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.009288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.009564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] PATH_INFO: `/v3/projects/7319c627f6264027a82a99e9da28c95f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.015838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7319c627f6264027a82a99e9da28c95f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.017811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.088224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:34.107390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7319c627f6264027a82a99e9da28c95f', 'request_id': 'req-3804f002-2aad-49d0-990a-34c69fd4464d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.124722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7319c627f6264027a82a99e9da28c95f', 'request_id': 'req-3804f002-2aad-49d0-990a-34c69fd4464d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.145614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7319c627f6264027a82a99e9da28c95f', 'request_id': 'req-3804f002-2aad-49d0-990a-34c69fd4464d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.149944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d42b7-02e6-43f0-8cb1-a58ad6be6b1b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.169621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] The token cache is being invalidate because project 7319c627f6264027a82a99e9da28c95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:34.170212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.171306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.188361 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2902/5825] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:33 2022] DELETE /identity/v3/projects/7319c627f6264027a82a99e9da28c95f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:34.189384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.192288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:34.206731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:34.305134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '460c966730dc47dcabe927c4e0296d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.306008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.306145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.306358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.306961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=372dc61fd0a94761bc1eed7973a3d89a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.308676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.308836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invalidating token cache because consumer 372dc61fd0a94761bc1eed7973a3d89a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:34.309294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.312145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.333711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '372dc61fd0a94761bc1eed7973a3d89a', 'request_id': 'req-602d0a81-c119-4566-a21c-d44b10fdaa16'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.367100 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2924/5826] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:33 2022] DELETE /identity/v3/OS-OAUTH1/consumers/372dc61fd0a94761bc1eed7973a3d89a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:34.367990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.371486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:34.392803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804f002-2aad-49d0-990a-34c69fd4464d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.407524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.410994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.411640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.414785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/19fb5d52749749ff9e10341064b8c0ec` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.417171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=19fb5d52749749ff9e10341064b8c0ec)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.419530 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:34.419530 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:34.419530 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:34.422867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.498211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 19fb5d52749749ff9e10341064b8c0ec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:34.498632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.501822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.512213 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2903/5827] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:34 2022] DELETE /identity/v3/roles/19fb5d52749749ff9e10341064b8c0ec => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:34.513250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.515761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:34.521400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0a81-c119-4566-a21c-d44b10fdaa16 tempest-OAUTHConsumersV3Test-1512894693 tempest-OAUTHConsumersV3Test-1512894693-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.662682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.667049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.667722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.668094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.668854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.670125 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:34.670125 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:34.670125 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:34.684032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.696553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a449d2b-b49a-4288-ad72-9c5461443139 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.700578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2925/5828] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Oct 18 16:32:34 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:34.700578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.712746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:34.718785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.720464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.721731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.724031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] PATH_INFO: `/v3/users/4cef45e3e0ba427b979555657a04dd66` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.725756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cef45e3e0ba427b979555657a04dd66)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.731372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.746317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad7ca-43cc-4804-931b-394ef07e070d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:34.759816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:34.760650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:34.761017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:34.761546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] PATH_INFO: `/v3/users/dad292d014e345beafc89e8ec6460ec5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:34.764050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad292d014e345beafc89e8ec6460ec5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:34.767049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:34.786147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:34.828849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cef45e3e0ba427b979555657a04dd66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.829755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cef45e3e0ba427b979555657a04dd66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.840594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cef45e3e0ba427b979555657a04dd66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.841732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cef45e3e0ba427b979555657a04dd66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.869856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cef45e3e0ba427b979555657a04dd66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.888342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:34.890772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad292d014e345beafc89e8ec6460ec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.908306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad292d014e345beafc89e8ec6460ec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.910089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad292d014e345beafc89e8ec6460ec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.919855 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2904/5829] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:34 2022] DELETE /identity/v3/users/4cef45e3e0ba427b979555657a04dd66 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:34.919855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.920224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:34.926200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad292d014e345beafc89e8ec6460ec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.927092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad292d014e345beafc89e8ec6460ec5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:34.967104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2926/5830] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:34 2022] DELETE /identity/v3/users/dad292d014e345beafc89e8ec6460ec5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:34.968278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:34.970331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:35.036218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e7fa3-b66f-4e2c-a4a8-c6d2a9f92552 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.116612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc35b3-bf3a-4c99-84ec-7005f21e7136 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.126229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.127223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.127961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.128186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.128349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.128495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.128831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.129082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/eb3f2a1b48d34841850b09ac78a6e9bb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.129573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.131318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917db57-17d3-4e43-954d-78bb72329183 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.131795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=eb3f2a1b48d34841850b09ac78a6e9bb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.141557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2927/5831] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 18 16:32:34 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:35.146266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.146583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.146862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.151782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.178777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2905/5832] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:34 2022] PUT /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/eb3f2a1b48d34841850b09ac78a6e9bb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:35.180616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.199196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:35.200552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:35.353815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270d2e-b31d-4903-9e18-73ecde7ae6a7 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.354433 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2928/5833] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:35.356052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.357387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:35.362371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.363340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.363842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.364164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.364800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.366822 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:35.366822 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:35.366822 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:35.369244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.370930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2906/5834] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:35.372535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.375477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:35.419280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:35.464416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:35.490668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a86a-9b33-4fd5-8ce3-78ca42ec9ba7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.502687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.504493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.505170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.506797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.510527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.513312 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:35.513312 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:35.513312 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:35.515902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.519421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10d69-9e73-474d-9d37-cb8ada5dde19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.530364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.530996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.531275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.531549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.567406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.569738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.603317 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2907/5835] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:35.604193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.611922 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2929/5836] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:35 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 521 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:35.615270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.639856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd0d4a-1cb1-46c0-a8e4-a3e65250121a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.766719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.767904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.768438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.769131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.770417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.772880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.775087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2908/5837] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:35.778735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.794258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5621-c4d2-466f-acc7-cb22e3a28a7c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.805758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.806397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.806683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.806972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.807699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Adding query filter params (scope.project.id=19f2cc74793f4775beb55c8a005e248b, user.id=15e039834f6343f4817ce83216e91964) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:35.808006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.812838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.822338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba659-d71e-4c84-8588-18073f2ae741 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.840377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.842220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.842944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.843277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.845967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.851100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.873679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2909/5838] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:35.875050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.892803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d39e1-ead5-4db2-b926-38d0f4e091cd tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:35.904020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:35.904847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:35.905173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:35.905450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:35.906418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:35.907762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:35.914829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2910/5839] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:35.916494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.918317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:35.954558 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2930/5840] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/role_assignments?scope.project.id=19f2cc74793f4775beb55c8a005e248b&user.id=15e039834f6343f4817ce83216e91964&effective => generated 1061 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:32:35.955645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:35.990188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f9d6-c11e-4610-ae66-0b0876403f4f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.005536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.006214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.006497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.006766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.007420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.011481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.013087 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2931/5841] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Oct 18 16:32:35 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:36.015792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.049139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453a57-f9b3-47f1-afdb-ec00a161e5f9 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.061775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.062452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.062733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.063007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.070172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.071407 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:36.071407 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:36.071407 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:36.074726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.080471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa39c-f1ec-408d-8278-45091540e614 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.090300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.091445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.091963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.092574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] PATH_INFO: `/v3/projects/d44709fd78824cf791d42ec5a7b86afc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.095019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44709fd78824cf791d42ec5a7b86afc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.098634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.099163 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2932/5842] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:36 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:36.100071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.208719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44709fd78824cf791d42ec5a7b86afc', 'request_id': 'req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.221775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44709fd78824cf791d42ec5a7b86afc', 'request_id': 'req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.229363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:36.232086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44709fd78824cf791d42ec5a7b86afc', 'request_id': 'req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.257952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:36.263442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbad9f4-70ef-4795-9cf1-9bb3ad451b69 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.268489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] The token cache is being invalidate because project d44709fd78824cf791d42ec5a7b86afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:36.271102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.276214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.278250 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2911/5843] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:35 2022] DELETE /identity/v3/projects/d44709fd78824cf791d42ec5a7b86afc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:36.279347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.281989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.394417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.395320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.395610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.395884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.396708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.401985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef7754-7ebf-4024-950f-3f6a0e1aab38 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.405139 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2933/5844] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Oct 18 16:32:36 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:36.406872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.407159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.407479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.443014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:36.444489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.512489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8a4d8-1b2c-44ca-8181-8e956f9b0e43 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.517475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.518242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.518535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.518942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.520329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Adding query filter params (scope.project.id=19f2cc74793f4775beb55c8a005e248b, user.id=15e039834f6343f4817ce83216e91964) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:36.520660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.523330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.610289 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2934/5845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:36.610289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.610289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.611436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2912/5846] 10.222.0.78 () {58 vars in 1356 bytes} [Tue Oct 18 16:32:36 2022] GET /identity/v3/role_assignments?scope.project.id=19f2cc74793f4775beb55c8a005e248b&user.id=15e039834f6343f4817ce83216e91964&effective => generated 577 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:36.611436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.621753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.653848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb08de9-b196-4f84-b8fc-1dedddb9686b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.657839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95795804-40f6-40d3-b6f9-b616dde9b08f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.661749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.662542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.663011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.664581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] PATH_INFO: `/v3/projects/7a581a4dd06144efad21fe179f061352` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.666161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a581a4dd06144efad21fe179f061352)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.667767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.668362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.668871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.669372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.669838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.670666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.672484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd15fb-1c4a-43e4-9a6d-afbb63b92e31 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.680710 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2935/5847] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:36 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:36.691908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.692523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.693006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.714997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:36.716589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.732080 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2936/5848] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:36.733133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.752005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52430983-ad5c-493c-9402-5a62f2cef565 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.766321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a581a4dd06144efad21fe179f061352', 'request_id': 'req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.792622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a581a4dd06144efad21fe179f061352', 'request_id': 'req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.801871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a581a4dd06144efad21fe179f061352', 'request_id': 'req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.824271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] The token cache is being invalidate because project 7a581a4dd06144efad21fe179f061352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:36.824589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.827349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:36.834258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2913/5849] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:36 2022] DELETE /identity/v3/projects/7a581a4dd06144efad21fe179f061352 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:36.835544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.845239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.878403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:36.890726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:36.891396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:36.891638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:36.895296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:36.898270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:36.923304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1.: keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = query.one() Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:36.925650 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:36.928194 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 18 16:32:36.929166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 16:32:36.929166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 16:32:36.929166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 16:32:36.929166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:36.929166 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:36.934127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2937/5850] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:36 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 137 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:36.934298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:36.939727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:36.966276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a8f0e-15de-43aa-9112-6a34a7461e2c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:36.999023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:37.001201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.002770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.003085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.003891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.007487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.012524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.018448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2914/5851] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:32:36 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:37.021250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.026987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.064774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccd527-6ff3-4c69-bb4a-b0c97eaa232a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.071553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.072649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.073097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.073373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.074037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:37.074332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.076712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.094786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2938/5852] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:37.096870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.099755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.122296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5b83b-6075-4015-a982-5ec90e3a8fd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.127559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.129022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.130837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.131929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/eb3f2a1b48d34841850b09ac78a6e9bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.161178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=eb3f2a1b48d34841850b09ac78a6e9bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.164242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.180837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role eb3f2a1b48d34841850b09ac78a6e9bb was removed from user 15e039834f6343f4817ce83216e91964 on project 19f2cc74793f4775beb55c8a005e248b. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:37.181178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.188066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.193170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286a90-3f1f-48ef-bb16-7796f9b87fb0 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.207218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.208410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.208793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.209386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] PATH_INFO: `/v3/users/460c966730dc47dcabe927c4e0296d8e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.211098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] RBAC: Authorizing `identity:delete_user(user_id=460c966730dc47dcabe927c4e0296d8e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.213369 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2939/5853] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:32:37 2022] DELETE /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/eb3f2a1b48d34841850b09ac78a6e9bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:37.213786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.218810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.222565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.323921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460c966730dc47dcabe927c4e0296d8e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.325354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460c966730dc47dcabe927c4e0296d8e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.346223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460c966730dc47dcabe927c4e0296d8e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.347574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460c966730dc47dcabe927c4e0296d8e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.363251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460c966730dc47dcabe927c4e0296d8e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:37.387029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c8ea-9962-4b5b-85da-50d48799c3ed tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.407407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.410886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.411143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.411383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.412801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.414591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.420392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2915/5854] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:37 2022] DELETE /identity/v3/users/460c966730dc47dcabe927c4e0296d8e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:37.421573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.422718 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2940/5855] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:37 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:37.423891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.426525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.431195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.582607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492b4b0-c76d-41e5-bd55-43e29a1774df admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.602021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.602671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.606044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd06a-3128-4d49-a773-aee40d4a960c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.606219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.606219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.606752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.612340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.630120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:37.682691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2916/5856] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:37 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:37.682691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.684411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:37.755448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:37.780469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.784174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.784540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.785079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.786107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.792737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.836310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2941/5857] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:37 2022] POST /identity/v3/roles => generated 272 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:37.836310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:37.866411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811683-1994-4e68-ae7f-1fd0b0e34d47 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.893323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434764c-d679-43a1-ab84-dafce8076363 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:37.901087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:37.901917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:37.902213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:37.902491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:37.903098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:37.905032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:37.909533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2917/5858] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:37 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:37.912253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.046554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.047262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.047834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.051015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.051968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.056916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.098423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2942/5859] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:37 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:38.099929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.103179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047df40-6642-4893-8b52-ee41e9dc5f62 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.113814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.115274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7793f-7ac7-4375-9676-e8d5c7ccbce2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.121839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.122182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.122468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.122895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.123168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Adding query filter params (domain_id=3e65b30fa269455aa5e5e07d0c443ce0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:38.123459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.123771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.124055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.124446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.124598 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:38.124598 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:38.124598 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:38.125187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.125415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.127038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.132595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2943/5860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:38.132595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.152840 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2918/5861] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 18 16:32:37 2022] GET /identity/v3/roles?domain_id=3e65b30fa269455aa5e5e07d0c443ce0 => generated 409 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:38.152840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.157521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0514-aeb8-4e00-baaf-30a08c08243e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.158233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.164964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.165815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.166156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.166589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.167403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.172779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.186931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65aaf1-8b80-4d9c-a62f-20a55ad623aa tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.192509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.192697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.192910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.193224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] PATH_INFO: `/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.196522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10d5e0526dc4e77a64def7cae5cc0b2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.198491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.203511 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2944/5862] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/roles => generated 2324 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:38.203511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.220811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032abca-c479-4468-b388-a9bb6d3a6a7e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.226312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.227119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.228115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.228519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.229380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.231198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.232400 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2945/5863] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:38.237545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.270697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'request_id': 'req-782035eb-81df-4fdd-9ab3-dc9288f1e831'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.276791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4508-ab3e-4214-b765-3d208a484aa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.281824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'request_id': 'req-782035eb-81df-4fdd-9ab3-dc9288f1e831'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.304204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10d5e0526dc4e77a64def7cae5cc0b2', 'request_id': 'req-782035eb-81df-4fdd-9ab3-dc9288f1e831'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.343561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] The token cache is being invalidate because project c10d5e0526dc4e77a64def7cae5cc0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:38.344460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.346354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.351829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2919/5864] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:38 2022] DELETE /identity/v3/projects/c10d5e0526dc4e77a64def7cae5cc0b2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:38.352699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.354350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.387887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:38.391786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.392614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.392767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.395498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/991df3f2d1d8446a80ba66e61f2ecfdd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.396971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=991df3f2d1d8446a80ba66e61f2ecfdd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.398778 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:38.398778 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:38.398778 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:38.399689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.477719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 991df3f2d1d8446a80ba66e61f2ecfdd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:38.477719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.478727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:38.484508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2946/5865] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:38 2022] DELETE /identity/v3/roles/991df3f2d1d8446a80ba66e61f2ecfdd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:38.486580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.490280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.548617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:38.562732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782035eb-81df-4fdd-9ab3-dc9288f1e831 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.630362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6fa1-1ab2-4253-9922-e8102c86d886 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.646365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.648108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.648398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.648680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.649742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.656020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8805f-246e-43a6-907c-605a6e7cb932 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.666211 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2947/5866] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:38.669111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.669402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.669695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.680687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.681692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.682466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.682880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.684090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.686205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.701554 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2920/5867] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/roles => generated 2324 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:38.702985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.705808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.714755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:38.716275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.733452 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2948/5868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:38.733452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.742862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5989099-0597-4f5d-929e-da6bb8aad417 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.754329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.755742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.756533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.756533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.757065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.758798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.760967 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2949/5869] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:38.762496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.765175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.784666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b8b5c-52fe-4839-a254-dae8c972272f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.793093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.794293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.794293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.794497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] PATH_INFO: `/v3/projects/daa2af3022e64b7888bc201e529c3c61/users/c446b393fffb4cee83d3f23d9fff7890/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.801491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49221a-3525-4a02-bc4b-d14223909cfc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.809929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.810881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.811327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.811763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.812604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Adding query filter params (domain_id=3e65b30fa269455aa5e5e07d0c443ce0) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:38.813254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.816517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa2af3022e64b7888bc201e529c3c61, user_id=c446b393fffb4cee83d3f23d9fff7890, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.817350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeacf3-de6c-4cdb-aa79-0d65daaa5c9b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.819704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.829042 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2921/5870] 10.222.0.78 () {58 vars in 1207 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/roles?domain_id=3e65b30fa269455aa5e5e07d0c443ce0 => generated 148 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:38.830187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc2fa-c741-468a-8708-1f40c3e72012 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.830474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc2fa-c741-468a-8708-1f40c3e72012 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.830729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cc2fa-c741-468a-8708-1f40c3e72012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.836757 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2950/5871] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:38 2022] PUT /identity/v3/projects/daa2af3022e64b7888bc201e529c3c61/users/c446b393fffb4cee83d3f23d9fff7890/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:38.837967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.864229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac8cc2fa-c741-468a-8708-1f40c3e72012 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:38.865498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac8cc2fa-c741-468a-8708-1f40c3e72012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:38.925544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab4d8-cdfe-47cf-808d-16a3a52a6995 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:38.932228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:38.933437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.933881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.934281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:38.937566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:38.939588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:38.945026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2951/5872] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:32:38 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:38.945026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:38.953608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:38.969624 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2922/5873] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:38.970892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:38.971172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:38.971440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.009618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] MFA Rules not processed for user `c446b393fffb4cee83d3f23d9fff7890`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:39.011433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:39.025491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc919-c829-4d02-9c36-2bed4dfe5f58 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.030729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.031376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.032087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.032087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/991df3f2d1d8446a80ba66e61f2ecfdd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.044186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Could not find role: 991df3f2d1d8446a80ba66e61f2ecfdd.: keystone.exception.RoleNotFound: Could not find role: 991df3f2d1d8446a80ba66e61f2ecfdd. Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 18 16:32:39.049138 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:32:39.050787 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 991df3f2d1d8446a80ba66e61f2ecfdd. Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2952/5874] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:38 2022] DELETE /identity/v3/roles/991df3f2d1d8446a80ba66e61f2ecfdd => generated 110 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:39.053638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.069843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8014-a75a-4c33-adbc-00f5dce0c35a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.075668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.076409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.076758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.077167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.078291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.080109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.085242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2953/5875] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:39.085242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.090663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2923/5876] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:39.091307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.094251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb4a0-373a-4ba4-8f60-68626ef4071b tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.100203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.101193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.101539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.101884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.102564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:39.102864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.103174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04814d57-a92f-40f9-99ba-eff14a1f8075 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.104459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.107974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.108627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.108904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.109209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.117379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.120301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2954/5877] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:39.120445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.120942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.134330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe419b7-e061-4dbf-a0e9-ac0d731a3b87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.140437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2924/5878] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:39 2022] PUT /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:39.141519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.149159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.218124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.218819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.219300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.219595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.220196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.222101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.223649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2955/5879] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:39.227546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.251491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a805b2-f7e6-4b89-9b93-d6acdf0bf85d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.258246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.259140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.259540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.259920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.261095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:create_application_credential(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.262249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.301152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d5f7-51aa-457e-8927-b48ff1ccd3a1 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.306592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.307306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.307708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.313476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.317243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.321231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.358234 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2956/5880] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:39.359160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.370517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2925/5881] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:32:39 2022] POST /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials => generated 921 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:39.372157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.381664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.393518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631ce28-1bd6-4fd2-b31d-d83f54e5fdc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.471036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.472981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.473455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.473972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.475607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.477493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.479152 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2926/5882] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:39.480666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.497925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63281-f40d-4377-a7cc-c5c411744090 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.510066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.510844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.511196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.511543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.515784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, group_id=04e24c9c455449098bfb9f4102c4217d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.519388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.554834 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2957/5883] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles => generated 410 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:39.556100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.590642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc00c6-b6c5-4787-a5f0-cd779a8bcb40 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.600984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.602136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.602691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.603045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.603766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.605939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.618304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:39.637594 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2927/5884] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:39 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:39.639329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.657706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201779-cc5b-4222-8ae1-1aafc840ede4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.669581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.670279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.670623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.671204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.672280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.674016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.676881 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2928/5885] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:39.678840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.699736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dba0-cd29-4c84-b081-418ed5ce207e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.701637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9021d-e6db-4b00-8aa9-53562703f868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.707766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.708790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.709109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.709386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/f70f1ecdb32f4407a7b18dc9e10574a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.710637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c446b393fffb4cee83d3f23d9fff7890, access_rule_id=f70f1ecdb32f4407a7b18dc9e10574a4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.711145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.712145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.712804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.713590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.713940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.717266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.718455 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:39.718455 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:39.718455 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:39.720372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.734158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2929/5886] 10.222.0.78 () {58 vars in 1465 bytes} [Tue Oct 18 16:32:39 2022] HEAD /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:39.735249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.748714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719808f-dc05-48f0-906b-0f051d1934ab tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.770251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.771623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.771902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.772174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.772835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.780840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.807130 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2930/5887] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/roles => generated 2324 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:39.807130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.delete(ref) Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application yield resource Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application next(self.gen) Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 16:32:39.808902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise self.value Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application session.commit() Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.session.flush() Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 16:32:39.810309 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application compat.raise_( Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._synchronize( Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise AssertionError( Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 18 16:32:39.812839 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:39.814150 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 18 16:32:39.815376 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:39.821982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2958/5888] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 18 16:32:39 2022] DELETE /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/f70f1ecdb32f4407a7b18dc9e10574a4 => generated 89 bytes in 266 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:32:39.823297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.835477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6576d1a-bbb4-43b9-8366-7916f1ab8978 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.850880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2841-63ad-46cd-b640-d0e4c2c2ba03 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.852981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.853687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.854068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.854303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.854830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.856436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.856695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.857545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.857651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.857919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.862232 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2931/5889] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:39.863801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.865978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.868633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.885057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 21c02b4140604999b6d019ae684d349b was removed from group 04e24c9c455449098bfb9f4102c4217d on domain 3e65b30fa269455aa5e5e07d0c443ce0. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:39.885441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:39.887327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:39.888800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a550b-d2c9-461a-9dca-3de97289b6eb tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:39.901217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:39.901835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:39.902261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:39.902360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:39.911249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:39.916139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:39.918806 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2959/5890] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:32:39 2022] DELETE /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:39.920111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.922151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:39.949834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2932/5891] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/roles => generated 2324 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:39.950714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:39.954893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:39.989229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea5e1-b8d8-48d8-a0ff-b86fd607c6ba admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.043979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b16b63-64e5-4eeb-a350-09cef02b7bdb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.049423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.050884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.051228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.051571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials/092f559ed8ea439f8b0e8713cd842a56` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.064361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c446b393fffb4cee83d3f23d9fff7890, application_credential_id=092f559ed8ea439f8b0e8713cd842a56)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.066067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.077087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:40.091712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.092637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.093496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.094126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.095104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.097529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.101924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2933/5892] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:32:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:40.101924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.103075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:40.105063 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2960/5893] 10.222.0.78 () {58 vars in 1395 bytes} [Tue Oct 18 16:32:39 2022] DELETE /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials/092f559ed8ea439f8b0e8713cd842a56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:40.107976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.111172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:40.222840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7df876-649f-4bc0-ae69-e64e62811868 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.228126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.228808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.229232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.229513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.231985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19f2cc74793f4775beb55c8a005e248b, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.235249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.248481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2989-8aac-4199-b9da-4b2f89ee8bf1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.256716 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2934/5894] 10.222.0.78 () {60 vars in 1486 bytes} [Tue Oct 18 16:32:40 2022] PUT /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:40.258102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.328270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:40.395235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.400564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.400872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.401160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] PATH_INFO: `/v3/projects/506d4e3e832c437f8fe3bcb34c90211f/users/c13735e4c12c41a48a4795a814178579/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.437050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506d4e3e832c437f8fe3bcb34c90211f, user_id=c13735e4c12c41a48a4795a814178579, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.439695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.472588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2961/5895] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:40 2022] PUT /identity/v3/projects/506d4e3e832c437f8fe3bcb34c90211f/users/c13735e4c12c41a48a4795a814178579/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:40.475181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.476707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cea48-b1c6-4f96-8814-fe0753c6a57a tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.634991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.635341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.635618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.635891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.636480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.638658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.642881 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2935/5896] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:32:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:40.642881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.656036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3d95-9dcf-4d31-b6b9-ac65acd77215 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.661586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.662348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.662737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.663114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.664436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:list_access_rules(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.666393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dee8c-0167-4403-b03e-82add23afba5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.679335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2962/5897] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:32:40 2022] GET /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules => generated 369 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:40.680896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.681330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.681794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.711422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:40.747758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] MFA Rules not processed for user `c13735e4c12c41a48a4795a814178579`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:40.748161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16c07-dbc9-47c9-a53c-34e27de5a095 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.749097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:40.759875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.765737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.766814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.769383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.773246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_grants(project_id=19f2cc74793f4775beb55c8a005e248b, group_id=04e24c9c455449098bfb9f4102c4217d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.774930 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:40.774930 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:40.774930 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:40.777213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.796214 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2936/5898] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:32:40 2022] GET /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles => generated 411 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:40.801014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.818508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae1e99-5279-40aa-bab4-9f9a498e729d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.830928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.832511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.833026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.833481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.834509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.836941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.839176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2937/5899] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:40.840702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.864174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1934f0c-99ba-4a96-b215-6e22f3f6e5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.870023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.871294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.872084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.872515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/f70f1ecdb32f4407a7b18dc9e10574a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.874925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c446b393fffb4cee83d3f23d9fff7890, access_rule_id=f70f1ecdb32f4407a7b18dc9e10574a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.876866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.881943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2963/5900] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:40.881943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.904199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf35f-429b-491a-9f7f-433e5a3e16ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.911346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.912125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.913345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.914453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/groups/04e24c9c455449098bfb9f4102c4217d/users/15e039834f6343f4817ce83216e91964` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.922481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2938/5901] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 18 16:32:40 2022] DELETE /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/f70f1ecdb32f4407a7b18dc9e10574a4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:40.922481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:40.924175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=04e24c9c455449098bfb9f4102c4217d, user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.928731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.953877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66943ec-b9db-473d-99c9-aac64faa1ae5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:40.976476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:40.977288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:40.977623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:40.977929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:40.978626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:40.980315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:40.985231 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2939/5902] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:32:40 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:40.985231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.005234 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2964/5903] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:32:40 2022] PUT /identity/v3/groups/04e24c9c455449098bfb9f4102c4217d/users/15e039834f6343f4817ce83216e91964 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:41.005234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.091244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:41.160079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d152a97-df3c-4f8c-99de-07ae74dfc38d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.180223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747e855-78db-430d-a362-2383b20f4266 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.193969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.194719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.195114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.195276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.198918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:list_access_rules(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.200417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.216067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2965/5904] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules => generated 158 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:41.218652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.342214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.342769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.343251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.343528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.346183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.349329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.368851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c27e-c659-4938-ad74-114cd7cd7228 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.379231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.379916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.380199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.380472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.381121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.382740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da055f-e9da-420e-a28c-8952e6d6d5ff tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.383892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2966/5905] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:41.387536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.387820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.388092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.411603 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2940/5906] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:41.411603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.490310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] MFA Rules not processed for user `15e039834f6343f4817ce83216e91964`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:41.491431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:41.512060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:41.544004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f3c-bdb8-4493-8cc7-9db8a0011dea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.556137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.556804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.557143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.557420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.558096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:create_application_credential(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.559266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.651749 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2967/5907] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:41.653766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.697160 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2941/5908] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:32:41 2022] POST /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials => generated 920 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:41.700321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.712538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:41.753815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b66207-e45f-4cbf-92b5-a624f64dcbcb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.760527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.761269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.761548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.761823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.762503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.764521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.765821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2968/5909] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:41.766433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.854947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f32-47cb-4e11-a926-759a328dbcc5 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.870917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.872103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.872455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.872795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.873542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.878482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.879427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3636-9893-4e88-b04c-dbd2223a7230 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.890618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.891651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.893179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.893753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.906250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_grant(project_id=19f2cc74793f4775beb55c8a005e248b, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.915837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.919283 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2942/5910] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:41 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:41.920488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.940576 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2969/5911] 10.222.0.78 () {58 vars in 1468 bytes} [Tue Oct 18 16:32:41 2022] HEAD /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:41.945537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.953076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ac413-cab2-42e3-877e-fb13bb4e12a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.963587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.964518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.964903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.965328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.967316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:list_access_rules(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:41.968922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:41.976687 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2943/5912] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:41.977836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:41.981526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c772f6-bb93-4ba7-a859-abeceaa6d228 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.994579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f3563-cd0a-4105-82fb-a0fa6ca2a96e tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:41.994907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:41.996539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:41.996824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:41.997124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:41.997733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.000605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.001444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.001828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.002378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.003708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.005599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.006142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.007335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2970/5913] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:42.008121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.023191 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2944/5914] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:41 2022] GET /identity/v3/roles => generated 2324 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:42.024390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.033939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7325b-d964-4cd3-a2d5-8c330592cbe6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.040141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef3559-5ab2-428b-9d95-d96943b91e0f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.046757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.048643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.048930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.054807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.055682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:create_application_credential(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.055961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.056757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.056932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.057362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.057865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.060809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=19f2cc74793f4775beb55c8a005e248b, group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.063649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.077062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 21c02b4140604999b6d019ae684d349b was removed from group 04e24c9c455449098bfb9f4102c4217d on project 19f2cc74793f4775beb55c8a005e248b. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:42.077364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:42.079189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:42.098881 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2971/5915] 10.222.0.78 () {58 vars in 1470 bytes} [Tue Oct 18 16:32:42 2022] DELETE /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:42.100638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.103069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:42.128293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:42.178074 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2945/5916] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Oct 18 16:32:42 2022] POST /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/application_credentials => generated 921 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:42.179028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.180974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:42.198003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061ca29-85b0-4670-8fab-a5ca115a4dd1 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.201603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98202d3b-38ec-4716-a2f8-31a5683ad622 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.207636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.208660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.209046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.210664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.211544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.215584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.217213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2972/5917] 10.222.0.78 () {58 vars in 1308 bytes} [Tue Oct 18 16:32:42 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:42.218755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.221274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:42.309907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.310920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.310920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.311630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] PATH_INFO: `/v3/projects/dcc4940a22764c0f83820f5391a3720b/users/6a8e00f9809244db8c845d5049cca142/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.364280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc4940a22764c0f83820f5391a3720b, user_id=6a8e00f9809244db8c845d5049cca142, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.372110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.411504 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2946/5918] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:42 2022] PUT /identity/v3/projects/dcc4940a22764c0f83820f5391a3720b/users/6a8e00f9809244db8c845d5049cca142/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:42.412821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.417580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:42.418387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:42.443548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1a43-ea64-4b30-9242-a08baec3a937 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.545885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb373a-b159-4dca-9d5e-4621108e95ec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.564596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c446b393fffb4cee83d3f23d9fff7890', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa2af3022e64b7888bc201e529c3c61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.565322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.565601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.565893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/a31c15122a0d4958850ffab3f2c1b2dc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.578750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorizing `identity:get_access_rule(user_id=c446b393fffb4cee83d3f23d9fff7890, access_rule_id=a31c15122a0d4958850ffab3f2c1b2dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.580413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.595813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.597305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.597802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.598234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/groups/04e24c9c455449098bfb9f4102c4217d/users/15e039834f6343f4817ce83216e91964` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.600165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=04e24c9c455449098bfb9f4102c4217d, user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.602899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.618107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:42.622005 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2947/5919] 10.222.0.78 () {58 vars in 1359 bytes} [Tue Oct 18 16:32:42 2022] GET /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890/access_rules/a31c15122a0d4958850ffab3f2c1b2dc => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:42.623685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.650552 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2973/5920] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:32:42 2022] DELETE /identity/v3/groups/04e24c9c455449098bfb9f4102c4217d/users/15e039834f6343f4817ce83216e91964 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:42.651691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.795870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662b614-b709-4e6b-94e5-6f29726e80df tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.802685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.803396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.803716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.804123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.804835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.806577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.821707 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2974/5921] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:42 2022] GET /identity/v3/roles => generated 2324 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:42.824093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:42.831830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:42.843495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eb6f3-d04c-4c12-9284-5ce917344b22 tempest-AccessRulesV3Test-1245567871 tempest-AccessRulesV3Test-1245567871-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.852302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:42.873338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f670f1-4b0a-49e4-9095-7c1f72c87841 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:42.880065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:42.881171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:42.881637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:42.882218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] PATH_INFO: `/v3/users/c446b393fffb4cee83d3f23d9fff7890` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:42.883626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c446b393fffb4cee83d3f23d9fff7890)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:42.886562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:42.985756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c446b393fffb4cee83d3f23d9fff7890'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:43.014016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c446b393fffb4cee83d3f23d9fff7890'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:43.015630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c446b393fffb4cee83d3f23d9fff7890'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:43.029305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.030053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.030427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.030809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.031717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.033700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.039408 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2948/5922] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Oct 18 16:32:42 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:43.039589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c446b393fffb4cee83d3f23d9fff7890'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:43.040703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.043017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c446b393fffb4cee83d3f23d9fff7890'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:43.062073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:43.173840 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2975/5923] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:42 2022] DELETE /identity/v3/users/c446b393fffb4cee83d3f23d9fff7890 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:43.174860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.178004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.276679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a274ed-a60f-4a71-8ff2-e3e805081592 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:43.374808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.375485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.375770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.376081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.378663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.379803 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:43.379803 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:43.379803 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:43.380265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ef81-d205-44c7-be8c-3a7d8b830f30 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:43.380857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.394294 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2949/5924] 10.222.0.78 () {60 vars in 1381 bytes} [Tue Oct 18 16:32:43 2022] PUT /identity/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:43.394516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.394997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.395282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.395393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.395575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] PATH_INFO: `/v3/projects/dcc4940a22764c0f83820f5391a3720b/users/6a8e00f9809244db8c845d5049cca142/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.399535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.403023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc4940a22764c0f83820f5391a3720b, user_id=6a8e00f9809244db8c845d5049cca142, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.405719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc84305-6067-47aa-9f62-4efd1bae9d70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.434834 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2976/5925] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:43 2022] PUT /identity/v3/projects/dcc4940a22764c0f83820f5391a3720b/users/6a8e00f9809244db8c845d5049cca142/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:43.436156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.436445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.436715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.477377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:43.478615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.521585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:43.545361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc1f1-6ddf-4f32-92f2-68093148c8c0 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:43.646191 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2977/5926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:43.647276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.652118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.692776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.693725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.693955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.694201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.694879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.702174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18df52-a657-463d-87d7-b411a8f78a28 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.707046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2950/5927] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:43 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:43.708251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.708536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.708803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.772789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] MFA Rules not processed for user `6a8e00f9809244db8c845d5049cca142`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:43.774098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.813679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91901dba-df13-4ab7-b4d5-d0c348a185f7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:43.828278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.829364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.829809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.830240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.834275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=04e24c9c455449098bfb9f4102c4217d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.835303 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:43.835303 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:43.835303 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:43.836188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.852227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:43.868712 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2978/5928] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:43 2022] GET /identity/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles => generated 376 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:43.874243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.879979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.890631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2951/5929] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:43.891835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:43.895055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:43.913532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89ec02-89e1-4e9a-bd0d-c34ab6109c55 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:43.919109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:43.920093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:43.920795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:43.921257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] PATH_INFO: `/v3/users/0674cdb0faa64406a58794e68d5e94a3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:43.922683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0674cdb0faa64406a58794e68d5e94a3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:43.925506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:43.994532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2e820-81c6-4d8e-abba-4f78888f9fb3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.001275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.002052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0674cdb0faa64406a58794e68d5e94a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.002191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.002387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.002663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.003641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0674cdb0faa64406a58794e68d5e94a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.012160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0674cdb0faa64406a58794e68d5e94a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.013918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0674cdb0faa64406a58794e68d5e94a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.016120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.018036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.024374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0674cdb0faa64406a58794e68d5e94a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.051171 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2979/5930] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:44.052299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.053067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2952/5931] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:43 2022] DELETE /identity/v3/users/0674cdb0faa64406a58794e68d5e94a3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:44.054089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.057808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.065023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:44.073640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6efa09-4ee6-41cd-9aab-23c6a9028696 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.178321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9ee81-f814-4455-bde6-4e26965fe15b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.186351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.187028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.187311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.187589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.189419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.190153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.192675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2980/5932] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:44 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:44.193759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.197090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.198425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.200217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.200946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.201671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.205596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.208686 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:44.208686 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:44.208686 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:44.212942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d028f-7ac7-46ba-ad1a-d7afc0f9f89f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.224949 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2953/5933] 10.222.0.78 () {58 vars in 1363 bytes} [Tue Oct 18 16:32:44 2022] HEAD /identity/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:44.224949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.224949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.224949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] PATH_INFO: `/` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.226338 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2954/5934] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:32:44.227148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.229051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.251536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4f23a-f57b-488b-9b4c-6b6b759f96e5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.260332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.260332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.260332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.260734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.260877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.263635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.266154 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2955/5935] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:32:44 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:44.267375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.286907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf1458-c8d6-4f95-832e-22f7ed6e977d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.304368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.306468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.307683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.307833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.310512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=04e24c9c455449098bfb9f4102c4217d, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.311866 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:44.311866 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:44.311866 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:44.312948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65e01a-453b-4748-a0da-2296f75cd6cc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.325504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f922db-0322-4299-9305-49e9d58ece87 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.334717 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2956/5936] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 18 16:32:44 2022] DELETE /identity/v3/system/groups/04e24c9c455449098bfb9f4102c4217d/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:44.336188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.338257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.338557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.345780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8e00f9809244db8c845d5049cca142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc4940a22764c0f83820f5391a3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.349663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.350492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.350894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.351943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.354378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.406352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2981/5937] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:44 2022] POST /identity/v3/projects => generated 359 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:44.407740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.438821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:44.438821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.499756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:44.523284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2957/5938] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:44.524680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.582805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c907-98df-49c7-bf17-52cc6518dc49 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.595763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.596453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.597357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.597619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.598226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.600018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.605478 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2982/5939] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:32:44 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:44.612568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.614577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.634036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8274c1-73bf-4f9a-98bf-00cb1ec40d9c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.646498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.646871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.647203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.647480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.651574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.654315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.687888 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2958/5940] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 18 16:32:44 2022] PUT /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:44.687888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.691629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.711191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:44.759996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62c4b-3ee7-4542-962f-6963ebd7f5ee tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.786698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b54463-0042-4a63-8b74-8c692ae85894 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.792455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c13735e4c12c41a48a4795a814178579', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506d4e3e832c437f8fe3bcb34c90211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.793377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.793715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.793920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] PATH_INFO: `/v3/projects/ba87604dd5cf40279f7f15f981aa3600` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.796801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] RBAC: Authorizing `identity:delete_project(project_id=ba87604dd5cf40279f7f15f981aa3600)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 18 16:32:44.803940 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 18 16:32:44.804969 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:44.808822 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2959/5941] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:44 2022] DELETE /identity/v3/projects/ba87604dd5cf40279f7f15f981aa3600 => generated 136 bytes in 123 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:44.809739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.811405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:44.852734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.855470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.856083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.856623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] PATH_INFO: `/v3/projects/42d3c0e8672c4488b8762c9e522d7245` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.858506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d3c0e8672c4488b8762c9e522d7245)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.860906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.899034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4690d-9b5e-4a24-bc77-175acc31d689 tempest-ProjectsNegativeTestJSON-945226985 tempest-ProjectsNegativeTestJSON-945226985-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:44.904114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:44.906852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:44.907467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:44.908315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:44.917774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:44.919747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:44.932550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2960/5942] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:44.933978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.935209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d3c0e8672c4488b8762c9e522d7245', 'request_id': 'req-6817be57-783a-46a8-b0d2-9900495a0b36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.942255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d3c0e8672c4488b8762c9e522d7245', 'request_id': 'req-6817be57-783a-46a8-b0d2-9900495a0b36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.949786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d3c0e8672c4488b8762c9e522d7245', 'request_id': 'req-6817be57-783a-46a8-b0d2-9900495a0b36'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.979665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] The token cache is being invalidate because project 42d3c0e8672c4488b8762c9e522d7245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:44.980050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.982876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:44.989962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2983/5943] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:44 2022] DELETE /identity/v3/projects/42d3c0e8672c4488b8762c9e522d7245 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:44.989962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:44.989962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.001269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:45.055391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b2da-1868-4f7d-a1c2-d2dc57fcdc22 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.138753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.138994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817be57-783a-46a8-b0d2-9900495a0b36 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.139473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.139760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.140180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.140808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.143836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.148821 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2961/5944] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:44 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:45.149086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.149086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.149086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.149086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] PATH_INFO: `/v3/projects/daa2af3022e64b7888bc201e529c3c61` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.151910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:45.152050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa2af3022e64b7888bc201e529c3c61)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.155785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.156702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.171819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:45.230954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa2af3022e64b7888bc201e529c3c61', 'request_id': 'req-b68e067d-e8b6-4c9b-babc-260cc25b0542'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.241658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa2af3022e64b7888bc201e529c3c61', 'request_id': 'req-b68e067d-e8b6-4c9b-babc-260cc25b0542'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.258349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa2af3022e64b7888bc201e529c3c61', 'request_id': 'req-b68e067d-e8b6-4c9b-babc-260cc25b0542'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.287133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e3061-fe9d-42f2-aa64-38dd151886bc tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.288782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] The token cache is being invalidate because project daa2af3022e64b7888bc201e529c3c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:45.290826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.292030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.299527 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2984/5945] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:44 2022] DELETE /identity/v3/projects/daa2af3022e64b7888bc201e529c3c61 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:45.302445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:45.304914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.454726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e067d-e8b6-4c9b-babc-260cc25b0542 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.462980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8e00f9809244db8c845d5049cca142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcc4940a22764c0f83820f5391a3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.463884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.464345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.464764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] PATH_INFO: `/v3/projects/ba87604dd5cf40279f7f15f981aa3600` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.466266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba87604dd5cf40279f7f15f981aa3600)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.468780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.531817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.534134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.534677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.535242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.538134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.543457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.561223 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2962/5946] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 18 16:32:45 2022] GET /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles => generated 409 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:45.562592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:45.564821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.566923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:45.581887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba87604dd5cf40279f7f15f981aa3600', 'request_id': 'req-cba505a4-abeb-4bbb-8386-4185293ccf58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.594459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba87604dd5cf40279f7f15f981aa3600', 'request_id': 'req-cba505a4-abeb-4bbb-8386-4185293ccf58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.602650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba87604dd5cf40279f7f15f981aa3600', 'request_id': 'req-cba505a4-abeb-4bbb-8386-4185293ccf58'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.621878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] The token cache is being invalidate because project ba87604dd5cf40279f7f15f981aa3600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:45.622109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.622825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:45.624964 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2985/5947] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:45 2022] DELETE /identity/v3/projects/ba87604dd5cf40279f7f15f981aa3600 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:45.626222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:45.629663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.668229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b26f2-0ea5-4259-b00a-76898bf0dc9d tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.712473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba505a4-abeb-4bbb-8386-4185293ccf58 tempest-ProjectsNegativeTestJSON-2026218627 tempest-ProjectsNegativeTestJSON-2026218627-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:45.718242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.718923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.719601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.719922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.720529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.722738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557e0b-73aa-4405-a90c-db35a54bc54e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.727624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2986/5948] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:32:45 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:45.727624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.727624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.727624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.750653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:45.751887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:45.794885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:45.814675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:45.816301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:45.818256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:45.818693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] PATH_INFO: `/v3/users/673efb39562d4fbf8b897c393b40ff3d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:45.822951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673efb39562d4fbf8b897c393b40ff3d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:45.825430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:45.831057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2987/5949] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:45.832228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:45.834295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.013493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673efb39562d4fbf8b897c393b40ff3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.017378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673efb39562d4fbf8b897c393b40ff3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.021850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54354fd-21d4-475a-9f74-ef98cad96227 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.040068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673efb39562d4fbf8b897c393b40ff3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.040068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673efb39562d4fbf8b897c393b40ff3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.042762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.042951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.043225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.043518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.052463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.053312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673efb39562d4fbf8b897c393b40ff3d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.055516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.072781 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2988/5950] 10.222.0.78 () {58 vars in 1462 bytes} [Tue Oct 18 16:32:45 2022] HEAD /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:46.076711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.078627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.100214 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2963/5951] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:45 2022] DELETE /identity/v3/users/673efb39562d4fbf8b897c393b40ff3d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:46.101529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.107663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27d63-ca89-45af-bfc8-bafadc5b5b0b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.117849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.128780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:46.269908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.270733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.271012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.271410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] PATH_INFO: `/v3/users/c13735e4c12c41a48a4795a814178579` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.272680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13735e4c12c41a48a4795a814178579)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.274800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.325272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af971-463e-4f4a-85de-6cc72a9469b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.345106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.346122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.346433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.347237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.348283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.349499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8f3fa-d1af-416d-a4ae-39752d6d3f54 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.352663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2964/5952] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:32:46 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:46.356515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.357944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.358223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.396750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:46.403122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.421461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13735e4c12c41a48a4795a814178579'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.437861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13735e4c12c41a48a4795a814178579'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.438596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13735e4c12c41a48a4795a814178579'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.439377 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2965/5953] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:46.444437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.454344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.456328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13735e4c12c41a48a4795a814178579'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.457242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13735e4c12c41a48a4795a814178579'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.503152 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2989/5954] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:46 2022] DELETE /identity/v3/users/c13735e4c12c41a48a4795a814178579 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:46.504169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.508445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.668016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac091682-8509-4a1c-88eb-aaf009fc7ed7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.672323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a699b-9fb8-426b-99a5-b265a7921614 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.685372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.688543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.689051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.692087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.692923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.702811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.704631 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2990/5955] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:32:46 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:46.710295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.723932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.728861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:46.811037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:46.862322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.863225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.863530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.863889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.870181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3e65b30fa269455aa5e5e07d0c443ce0, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.874601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.883122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 21c02b4140604999b6d019ae684d349b was removed from user 15e039834f6343f4817ce83216e91964 on domain 3e65b30fa269455aa5e5e07d0c443ce0. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:46.883516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.884310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a87f25ea-d129-45a0-bfd6-7ff61d3e6d13 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:46.889614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769b8fb-5d58-4759-8206-0e0f2af7a2af tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:46.897729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:46.898986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.899524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.900266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.901987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:46.903900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:46.907930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:46.918461 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2966/5956] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 18 16:32:46 2022] DELETE /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:46.920340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:46.922654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:46.923144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:46.951118 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2991/5957] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:46.951118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:46.957354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.969724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:46.970875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:46.997228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55e56-e40e-42a3-86d4-1d255e39f553 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.094207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2967/5958] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:47.101999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:47.106742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.148754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0c1e0-ac49-4f94-907d-52bf50b6e46b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.156598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.157700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.158129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.158564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] PATH_INFO: `/v3/projects/9c6eb556a0b24a8784e7da3d3688e600` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.160728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6eb556a0b24a8784e7da3d3688e600)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:47.162967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:47.165262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.167713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.168210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.168564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.170464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:47.177515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:47.184655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2992/5959] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Oct 18 16:32:46 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:47.185568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:47.191756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.263774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6eb556a0b24a8784e7da3d3688e600', 'request_id': 'req-5f2fa710-d8cc-43f1-82a8-01caba7635e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:47.282377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6eb556a0b24a8784e7da3d3688e600', 'request_id': 'req-5f2fa710-d8cc-43f1-82a8-01caba7635e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:47.296483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6eb556a0b24a8784e7da3d3688e600', 'request_id': 'req-5f2fa710-d8cc-43f1-82a8-01caba7635e6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:47.330067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] The token cache is being invalidate because project 9c6eb556a0b24a8784e7da3d3688e600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:47.330394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:47.332375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:47.337632 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2968/5960] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:47 2022] DELETE /identity/v3/projects/9c6eb556a0b24a8784e7da3d3688e600 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:47.340277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:47.344937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.422237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28351c0-5274-4bd3-8a7a-67748bf8c8e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.454482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:47.527467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa710-d8cc-43f1-82a8-01caba7635e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.542865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.544699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.544985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.545298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.545968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:47.550192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:47.585780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.586490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.586771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.587046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.606423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:47.635989 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2969/5961] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:47 2022] POST /identity/v3/projects => generated 379 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:47.637206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:47.640479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.650737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:47.700507 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2993/5962] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:47 2022] PUT /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:47.704022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:47.713616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.762441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18ae3e-3cc7-4cbd-a39c-a7d39ac0f404 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.786493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:47.941669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.942351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.942601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.942839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.944971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:47.970274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbff68-b289-4f7d-9868-d01ec65b7395 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:47.983404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:47.984265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:47.984904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:47.985712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:47.986138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:47.988430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:47.989977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2994/5963] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Oct 18 16:32:47 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:47.990996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.059431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.062392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.077180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b05d-01d5-4f09-9101-46f91b2e1d55 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.084405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.084637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.085088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.085376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.086860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2970/5964] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:48.088408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.091168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:48.094739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.102476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.158932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:48.163861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2995/5965] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:47 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:48.165025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.197272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad818ef5-bfac-4bfb-b176-4395dada0d5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.210796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.211727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.212067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.212413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.213357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.216972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.223048 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2996/5966] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.225752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.250232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac322a-675f-47e4-973e-c90ce1c71651 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.256877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.257710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.258091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.258464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.259258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.261363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.267610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54988-68bd-4611-b517-a2f6d879f468 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.281228 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2997/5967] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/roles => generated 2324 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:48.281228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.284173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.285079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.285344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.286148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.305097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_grants(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.306083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.312202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8062439-ff23-46ac-afa8-8b55077ef1a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.320853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.321919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.322403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.322845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.323763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.329396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.335185 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2998/5968] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.335185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.337616 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2971/5969] 10.222.0.78 () {58 vars in 1365 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles => generated 410 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:48.338557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.349486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10feb28b-e1d6-4dd3-8191-a13044875158 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.355363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.356169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.356485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.356914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.357676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.359297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.363643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1692-ce5a-4830-aaac-71a25015e08b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.377307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.378713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.378894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.379224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.379747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.385543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 2999/5970] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/roles => generated 2324 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:48.385543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.385907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.385907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2972/5971] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.387555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.404784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5c425-d5ca-459e-9b39-aa121cba5203 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.414331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.416035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.416610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.417288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.417972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60dc8f-8e5d-44b9-b098-d2da71842cb7 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.422415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.427550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.434058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.434058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.434058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.434058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] PATH_INFO: `/v3/projects/92fedb8fca514f579c2c2a319d48b3f0/users/e4f3dfdd622847f8a7109a2fc064cf99/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.449997 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3000/5972] 10.222.0.78 () {58 vars in 1465 bytes} [Tue Oct 18 16:32:48 2022] HEAD /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:48.452326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.474968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fedb8fca514f579c2c2a319d48b3f0, user_id=e4f3dfdd622847f8a7109a2fc064cf99, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.479343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195afe01-a0cf-4315-97de-6aa326aef93c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.480202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.501626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.502324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.502988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.503398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.505933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.507599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.516568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3001/5973] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.516860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2973/5974] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:48 2022] PUT /identity/v3/projects/92fedb8fca514f579c2c2a319d48b3f0/users/e4f3dfdd622847f8a7109a2fc064cf99/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:48.517517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.517820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.545311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f38eb-d590-44ec-b9bf-2abb5d4384e6 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.668356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca49b-699e-4f95-b64a-74bcb6363c10 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.675571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.676256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.676947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.676947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.679828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=19f2cc74793f4775beb55c8a005e248b, user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.680677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.681379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.681661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.681934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.682523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.683695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.684096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2508a-076b-45f2-83ca-d6ae150fa91e tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.685652 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2974/5975] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.686629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.686906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.687176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.691730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:48.698404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 21c02b4140604999b6d019ae684d349b was removed from user 15e039834f6343f4817ce83216e91964 on project 19f2cc74793f4775beb55c8a005e248b. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:48.698748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:48.699695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:48.737308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3002/5976] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:32:48 2022] DELETE /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:48.741915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.745620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:48.772027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] MFA Rules not processed for user `e4f3dfdd622847f8a7109a2fc064cf99`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:48.773356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:48.913873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63ab4-22e9-4dc8-b090-356d6a1b85ce tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:48.930121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:48.930802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:48.931079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:48.932849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:48.933606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:48.935219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:48.936787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3003/5977] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Oct 18 16:32:48 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:48.943714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:48.945281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.007958 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2975/5978] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:49.009941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.012528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.063723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:49.103212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908e3b5-cf0a-42c2-8b8f-610e5fa7faa5 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.129445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.130508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.131102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.131629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.133473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.134486 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:49.134486 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:49.134486 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:49.136120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.152045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3004/5979] 10.222.0.78 () {60 vars in 1378 bytes} [Tue Oct 18 16:32:48 2022] PUT /identity/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:49.153306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.170845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbed34-ee32-4d4a-a53b-776a23ed0ae3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.175404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a908a1b-40d9-4296-bac4-7621ed0a5bbc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.178198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.179200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.179697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.180263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.180680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.181312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.181434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.181811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.182618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] PATH_INFO: `/v3/projects/506d4e3e832c437f8fe3bcb34c90211f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.183661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506d4e3e832c437f8fe3bcb34c90211f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.185468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.185659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.188622 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3005/5980] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:49.189627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.205215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083bf53-353d-4b7a-ad29-3f1e61e9759d tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.213377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4f3dfdd622847f8a7109a2fc064cf99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92fedb8fca514f579c2c2a319d48b3f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.214895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.215412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.215907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] PATH_INFO: `/v3/domains/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.218843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.220846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.224862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3006/5981] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:49.226114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.244982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e318b-be70-493b-a76f-0c58d4be4f8d tempest-DefaultDomainTestJSON-1274826924 tempest-DefaultDomainTestJSON-1274826924-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.249774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506d4e3e832c437f8fe3bcb34c90211f', 'request_id': 'req-df644883-8f38-4dac-9260-cc164f778b47'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.260527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506d4e3e832c437f8fe3bcb34c90211f', 'request_id': 'req-df644883-8f38-4dac-9260-cc164f778b47'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.271074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506d4e3e832c437f8fe3bcb34c90211f', 'request_id': 'req-df644883-8f38-4dac-9260-cc164f778b47'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.288949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] The token cache is being invalidate because project 506d4e3e832c437f8fe3bcb34c90211f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:49.288949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.289842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.293072 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2976/5982] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:49 2022] DELETE /identity/v3/projects/506d4e3e832c437f8fe3bcb34c90211f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:49.294765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.297280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.350794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.351885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.352273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.352681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/users/15e039834f6343f4817ce83216e91964/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.354129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.356127 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:49.356127 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:49.356127 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:49.357390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.377168 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3007/5983] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/system/users/15e039834f6343f4817ce83216e91964/roles => generated 375 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:49.381171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.382836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.418784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:49.495758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644883-8f38-4dac-9260-cc164f778b47 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.501993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.503940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.504399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.504929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.510550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.512227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.513742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2977/5984] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:49.515672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.517529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.518671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a785b-9194-45f7-8c3f-fbd684d7d94f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.524980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.526170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.526467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.526740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] PATH_INFO: `/v3/users/e4f3dfdd622847f8a7109a2fc064cf99` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.527912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f3dfdd622847f8a7109a2fc064cf99)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.529871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.534560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939a064-5524-4d9b-b8cd-81d2a532bc7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.541143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.541688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.542841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.543126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] PATH_INFO: `/v3/users/6a8e00f9809244db8c845d5049cca142` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.544492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8e00f9809244db8c845d5049cca142)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.546604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.605942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f3dfdd622847f8a7109a2fc064cf99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.617192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f3dfdd622847f8a7109a2fc064cf99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.618311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:49.619095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f3dfdd622847f8a7109a2fc064cf99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.621395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8e00f9809244db8c845d5049cca142'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.623030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8e00f9809244db8c845d5049cca142'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.633261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f3dfdd622847f8a7109a2fc064cf99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.634655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f3dfdd622847f8a7109a2fc064cf99'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.638261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8e00f9809244db8c845d5049cca142'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.639508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8e00f9809244db8c845d5049cca142'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.652944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8e00f9809244db8c845d5049cca142'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:49.674265 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3008/5985] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:49 2022] DELETE /identity/v3/users/e4f3dfdd622847f8a7109a2fc064cf99 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:49.675824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.680617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.692613 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2978/5986] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:49 2022] DELETE /identity/v3/users/6a8e00f9809244db8c845d5049cca142 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:49.694351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.697897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.804048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2777b-89c6-49a6-82aa-9c4601944c70 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.804713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c673-c689-42f9-9f3d-46f9fe8eaa6e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.811575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.813316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.813827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.814314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.815272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.818082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe262dd-2f92-4ef4-8868-dd211e914d7f tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.820044 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2979/5987] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:49.822377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.823173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.823691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.849284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:49.851650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.858000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:49.894529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.895513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.895980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.896590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.898724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.900019 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:49.900019 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:49.900019 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:49.901486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.912656 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3009/5988] 10.222.0.78 () {58 vars in 1360 bytes} [Tue Oct 18 16:32:49 2022] HEAD /identity/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:49.913918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.915605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.944128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2980/5989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:49.944966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.962574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf944ac8-217c-4011-b6d8-05678e2a48d2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:49.968422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:49.969296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:49.969579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:49.969983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:49.971448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:49.973117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:49.974426 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2981/5990] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Oct 18 16:32:49 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:49.977917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:49.980264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:49.999130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99681d7c-fcb2-4e2e-bda3-2dd0792c2d53 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.005615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.006276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.006565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.006994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.008887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=15e039834f6343f4817ce83216e91964, role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.009865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daeea9-b744-451f-b89b-eb1e47cd7456 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.010221 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:50.010221 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:50.010221 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:50.011231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.015624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.016269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.016585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.016861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] PATH_INFO: `/v3/users/ed5f927857d54bba9371256669c262f1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.018983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5f927857d54bba9371256669c262f1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.021677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2982/5991] 10.222.0.78 () {58 vars in 1362 bytes} [Tue Oct 18 16:32:49 2022] DELETE /identity/v3/system/users/15e039834f6343f4817ce83216e91964/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:50.023280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.023767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.026567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.091360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5f927857d54bba9371256669c262f1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.103485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5f927857d54bba9371256669c262f1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.104283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5f927857d54bba9371256669c262f1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.113033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5f927857d54bba9371256669c262f1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.113703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5f927857d54bba9371256669c262f1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.130125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76409-e47b-4836-9d85-2e58f76d07c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.133886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.134480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.134763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.135264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.136803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.140151 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3010/5992] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:49 2022] DELETE /identity/v3/users/ed5f927857d54bba9371256669c262f1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:50.141101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.142639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.161916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:50.163525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.165305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.179304 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2983/5993] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:50.179966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.182436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.200642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d67d6-02c0-4b35-92bc-f5d5cb5a1b7f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.285723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.286345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.286627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.286907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.287804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.289190 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:50.289190 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:50.289190 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:50.290094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.294686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:50.306310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6ef9-f8a0-4124-a99b-f3e653f9fef7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.322195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2984/5994] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:50 2022] POST /identity/v3/roles => generated 270 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:50.323431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.326047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.331219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.333390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.335567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.336020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.337874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.342109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.345617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3011/5995] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:50 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:50.352237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.419053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78883284-d118-47a8-8a00-4cc1ee8ea8a4 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.458016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.458939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.459966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.459966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.464568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.464568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.497501 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3012/5996] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:50 2022] POST /identity/v3/roles => generated 269 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:50.498674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.512895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7030d1-cf8d-4ce1-971a-3c940a62489c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.519477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.519962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.520525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.521127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.521999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.524501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.529644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3013/5997] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:50.532282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.540297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f43b-17ee-4871-a7a0-83e616fcd097 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.553746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.555469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.555469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.555469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] PATH_INFO: `/v3/projects/dcc4940a22764c0f83820f5391a3720b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.556696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc4940a22764c0f83820f5391a3720b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.556883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a743cd0-f34b-4521-9f4a-fcf7e9ddef19 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.558697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.585070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.586712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.590829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.591361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/979c1a27677a45d7825abb0022e7d86c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.595583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=979c1a27677a45d7825abb0022e7d86c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.600709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.657452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc4940a22764c0f83820f5391a3720b', 'request_id': 'req-f9e8c3c3-25c1-4642-b188-6aa756f19216'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.667113 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3014/5998] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:50 2022] PUT /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/979c1a27677a45d7825abb0022e7d86c => generated 530 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:50.669782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.672705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc4940a22764c0f83820f5391a3720b', 'request_id': 'req-f9e8c3c3-25c1-4642-b188-6aa756f19216'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.687027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc4940a22764c0f83820f5391a3720b', 'request_id': 'req-f9e8c3c3-25c1-4642-b188-6aa756f19216'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.715954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] The token cache is being invalidate because project dcc4940a22764c0f83820f5391a3720b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:50.715954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.716605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:50.718480 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2985/5999] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:50 2022] DELETE /identity/v3/projects/dcc4940a22764c0f83820f5391a3720b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:50.719289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.725020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.764240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:50.784795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b80e-70cb-4fbc-a2c5-9b518d7cc0cd tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.790705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.792282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.792282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.792282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.792630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.794345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.795761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3015/6000] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:32:50 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 18 16:32:50.796540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:50.798319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:50.841123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c3c3-25c1-4642-b188-6aa756f19216 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.896891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251c21-00f8-4e5f-bb97-ed2209b32a3c tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:50.902145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.902778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.903054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.903401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.904503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.905871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2ec47-067f-417d-ad93-d7ae296159d5 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.927169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3016/6001] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:50 2022] POST /identity/v3/domains => generated 276 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:50.928892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.929235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.929556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.932002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:50.932979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:50.933549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:50.933823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] PATH_INFO: `/v3/projects/4329dc19129c4c4783c5934ff48b045a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:50.935028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4329dc19129c4c4783c5934ff48b045a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:50.937051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:50.963831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:50.965126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.009311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4329dc19129c4c4783c5934ff48b045a', 'request_id': 'req-aa52f871-8dbb-4980-a08f-33cc5df4e51b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.022190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4329dc19129c4c4783c5934ff48b045a', 'request_id': 'req-aa52f871-8dbb-4980-a08f-33cc5df4e51b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.026488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:51.030718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4329dc19129c4c4783c5934ff48b045a', 'request_id': 'req-aa52f871-8dbb-4980-a08f-33cc5df4e51b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.042470 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3017/6002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.043549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.046159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.051484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] The token cache is being invalidate because project 4329dc19129c4c4783c5934ff48b045a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:51.052386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.053797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.057514 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2986/6003] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:50 2022] DELETE /identity/v3/projects/4329dc19129c4c4783c5934ff48b045a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:51.058477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.059941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.062652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6e091-c25f-4c36-b900-90066413e62a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.132189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.132814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.133126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.133396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] PATH_INFO: `/v3/projects/92fedb8fca514f579c2c2a319d48b3f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.134576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fedb8fca514f579c2c2a319d48b3f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.136627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.138551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:51.147412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f871-8dbb-4980-a08f-33cc5df4e51b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.158760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.159957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.160223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.160491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/2d59b4f814b74303a9631238faf70fea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.169976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find domain: 2d59b4f814b74303a9631238faf70fea.: keystone.exception.DomainNotFound: Could not find domain: 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:51.175768 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:51.178102 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:32:51.179610 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2d59b4f814b74303a9631238faf70fea. Oct 18 16:32:51.181451 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:51.181451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2987/6004] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:51 2022] PATCH /identity/v3/domains/2d59b4f814b74303a9631238faf70fea => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:51.181451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.181451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.209837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fedb8fca514f579c2c2a319d48b3f0', 'request_id': 'req-7058f357-e2c3-4544-83e1-00ca1b3d8072'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.218168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fedb8fca514f579c2c2a319d48b3f0', 'request_id': 'req-7058f357-e2c3-4544-83e1-00ca1b3d8072'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.229513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fedb8fca514f579c2c2a319d48b3f0', 'request_id': 'req-7058f357-e2c3-4544-83e1-00ca1b3d8072'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.255058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] The token cache is being invalidate because project 92fedb8fca514f579c2c2a319d48b3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:51.255607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.256509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7058f357-e2c3-4544-83e1-00ca1b3d8072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:51.258231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3018/6005] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:51 2022] DELETE /identity/v3/projects/92fedb8fca514f579c2c2a319d48b3f0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:51.259609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.260233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.260507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.280269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b518-1c2a-4d59-b14a-df2d88bd419a tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.295355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:51.297292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.366919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.367718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.368009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.368284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.369184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.370893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df306b86-40fa-4ec1-91f1-2b57f719a8b2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.389833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2988/6006] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/roles => generated 269 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:51.391276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda8c-ffc5-49d0-a141-83d3e5b88c80 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.391567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda8c-ffc5-49d0-a141-83d3e5b88c80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.391897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda8c-ffc5-49d0-a141-83d3e5b88c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.396024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3019/6007] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.396862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.398380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.425198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4c1eda8c-ffc5-49d0-a141-83d3e5b88c80 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:51.426851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c1eda8c-ffc5-49d0-a141-83d3e5b88c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.431930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:51.446230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2989/6008] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.446230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.446230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.446230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.473392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:51.475347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.480917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3faa-0433-415c-8cc3-32f0b472d61d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.493359 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2990/6009] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.493359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.493359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.495881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.496541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.496818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.497151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/85b85f2e9e72437388af697ba45a8238` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.505945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find domain: 85b85f2e9e72437388af697ba45a8238.: keystone.exception.DomainNotFound: Could not find domain: 85b85f2e9e72437388af697ba45a8238. Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 85b85f2e9e72437388af697ba45a8238. Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:51.511230 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:51.512464 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:32:51.513827 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 85b85f2e9e72437388af697ba45a8238. Oct 18 16:32:51.515208 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.515208 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3020/6010] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:51 2022] PATCH /identity/v3/domains/85b85f2e9e72437388af697ba45a8238 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:51.515208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.518908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e71580-e955-4b41-8996-afe1f7bc294b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.526713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.527467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.527836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.528193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/529385782c1e4f01b5855bd2128cd3fd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.529630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289b84e-a398-41a2-840f-3d53c0be2559 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.530232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=529385782c1e4f01b5855bd2128cd3fd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.531846 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:51.531846 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:51.531846 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:51.533251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca8421-5b00-488a-8d80-902c6154ca6f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.537858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.538687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.539145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.539706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.540375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:51.540680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.542795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9fd1d-0cf1-419b-9fa4-1504227ed93e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.567697 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3021/6011] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:51.567697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303237-085a-4690-b223-13e8f492f766 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.567697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303237-085a-4690-b223-13e8f492f766 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.568290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2991/6012] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:51 2022] PUT /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/529385782c1e4f01b5855bd2128cd3fd => generated 530 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:51.568438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303237-085a-4690-b223-13e8f492f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.568592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.569260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.569260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.591058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f4303237-085a-4690-b223-13e8f492f766 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:51.591758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:51.592736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4303237-085a-4690-b223-13e8f492f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.593266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:51.677805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:51.691972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3022/6013] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.692907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2992/6014] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:51.693224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303237-085a-4690-b223-13e8f492f766 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.694139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.717737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07858-c76d-4079-bcc7-b623ba722964 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.726346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.727385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.727751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.728145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.728879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.731066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.768966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2993/6015] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:51 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:51.770660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.787639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303237-085a-4690-b223-13e8f492f766 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.863131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:51.871285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9b0f864ce1b4808b5b00208e0f91683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42b7844e716941879d55a8f6e48c4ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.871904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.872187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.872462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb5db-ba24-42a3-8b39-d1c0cba00170 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:51.872577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] PATH_INFO: `/v3/domains/aee00f94d1e9413d86bfefb378a6be13` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.877687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:51.878633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:51.878919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:51.879214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:51.880242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:32:51.881119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:51.882818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Could not find domain: aee00f94d1e9413d86bfefb378a6be13.: keystone.exception.DomainNotFound: Could not find domain: aee00f94d1e9413d86bfefb378a6be13. Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aee00f94d1e9413d86bfefb378a6be13. Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:51.885343 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:51.886468 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:32:51.890639 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aee00f94d1e9413d86bfefb378a6be13. Oct 18 16:32:51.891924 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:51.891924 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3023/6016] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:51 2022] PATCH /identity/v3/domains/aee00f94d1e9413d86bfefb378a6be13 => generated 112 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:51.891924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.912765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2994/6017] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:51 2022] PUT /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/21c02b4140604999b6d019ae684d349b => generated 526 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:51.916966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:51.991633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694aadc-b37c-451c-be23-297c5799a975 tempest-DomainConfigurationTestJSON-706410256 tempest-DomainConfigurationTestJSON-706410256-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.007331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f85551-7466-452d-8276-8fcbf2b0db16 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.012640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.013776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.014153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.014519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.015282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:52.016199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.020428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.035284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2995/6018] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:52.036390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.049472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db04df-63a7-402a-9e97-9ee4c92e20d3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.056901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.056901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.056901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.056901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.058169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.059403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.066340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.066961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.067387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.067667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.068320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:52.068622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.070254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.088071 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2996/6019] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/users => generated 284 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:52.089102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.090208 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3024/6020] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:52.091088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.094315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.110901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e3c03-980f-4e34-ab9c-fcce10c47f85 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.115679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.116298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.116577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.116841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] PATH_INFO: `/v3/users/583979c8fd1446b6ad97a6438681de68` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.118028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583979c8fd1446b6ad97a6438681de68)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.119916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.150607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:52.173911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be98c2a-6269-4fd5-9cdf-d4c0ebbd66fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.174171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583979c8fd1446b6ad97a6438681de68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:52.174831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583979c8fd1446b6ad97a6438681de68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:52.179033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.179688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.179984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.180297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/21c02b4140604999b6d019ae684d349b/implies/7f8195f7a91c4172a17eb60350e4bb0e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.182043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=21c02b4140604999b6d019ae684d349b, implied_role_id=7f8195f7a91c4172a17eb60350e4bb0e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.183377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583979c8fd1446b6ad97a6438681de68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:52.183704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.184253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583979c8fd1446b6ad97a6438681de68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:52.194585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583979c8fd1446b6ad97a6438681de68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] 7f8195f7a91c4172a17eb60350e4bb0e cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7f8195f7a91c4172a17eb60350e4bb0e cannot be an implied roles. Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 18 16:32:52.207749 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 7f8195f7a91c4172a17eb60350e4bb0e cannot be an implied roles. Oct 18 16:32:52.208912 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:32:52.212092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3025/6021] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:52 2022] PUT /identity/v3/roles/21c02b4140604999b6d019ae684d349b/implies/7f8195f7a91c4172a17eb60350e4bb0e => generated 116 bytes in 121 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:52.212890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.215433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.219722 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2997/6022] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:52 2022] DELETE /identity/v3/users/583979c8fd1446b6ad97a6438681de68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:52.219722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.219722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.236257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a9575-df89-4a0e-841c-83c9f55daaa6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.275985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:52.302061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97660-fca4-4507-ac54-951dbdd026e3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.307382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.307826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.308107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.308381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.309106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.310752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.324648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2998/6023] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:52.325504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.327498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.328492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.329151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.329441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.330053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.330345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.333198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.343665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bd624-f87b-4450-9aae-99a66bfe0c6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.349373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.349983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.350260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.350532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.351269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.353291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b14cfb-7d3c-42fe-ae8c-b8719e0fbab6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.367866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3026/6024] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:52.368723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.371531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.386547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 2999/6025] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:52.387901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.388364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.388500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.410123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:52.411534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.460939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169726b-3fbe-4738-b9ee-9ccca99ed68a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.480777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3000/6026] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:52.481857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.492357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cc05e-75ab-4c0f-b451-8bc501d12410 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.497089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.497687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.497959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.498251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.498884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.500456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.516732 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3001/6027] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:52.516732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.521918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.522578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.522859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.523132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.524861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.525291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f84acb-c378-424c-b97e-95d9da47c329 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.526541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.529949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.530520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.530800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.531214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.531863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.534390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.536053 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3027/6028] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:52 2022] DELETE /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:52.536906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.546707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:52.562347 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3002/6029] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:52.563192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.564833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.601148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:52.606893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f4a18-12bb-4f4b-9afa-87e9ca34ea29 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.614944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.616047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.616715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.616986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.617642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.619537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.624605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2ee6-3a73-41c0-88ec-8e34f1801a4b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.642363 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3028/6030] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:52.644217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.654220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686be7-9793-4325-85a3-e88de02c9071 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.659470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.660205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.660480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.660752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] PATH_INFO: `/v3/projects/4414b1e0651f40318b6f6449508f8dc2/users/95bd43c73f43458eaff0610ad1c80ae6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.676631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4414b1e0651f40318b6f6449508f8dc2, user_id=95bd43c73f43458eaff0610ad1c80ae6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.679301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.682474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.683089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.683374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.683643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.695768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.697439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.701325 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3029/6031] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:52 2022] PUT /identity/v3/projects/4414b1e0651f40318b6f6449508f8dc2/users/95bd43c73f43458eaff0610ad1c80ae6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:52.702260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.708328 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3003/6032] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:52.708865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.718962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af691d-bb72-4878-aeac-db1060d47a6f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.780038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dab25-3270-4fbe-997f-e7e084d7c239 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.785225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.785954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.786225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.786498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/529385782c1e4f01b5855bd2128cd3fd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.788722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=529385782c1e4f01b5855bd2128cd3fd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.789114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.789728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.790178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.790292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.790376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.790881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.792460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51c9db-3cd9-444a-81bf-59be7078908b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.802331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3030/6033] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:52 2022] DELETE /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/529385782c1e4f01b5855bd2128cd3fd => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:52.803158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.810884 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3004/6034] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:52.810884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.810884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.810884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.842333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] MFA Rules not processed for user `95bd43c73f43458eaff0610ad1c80ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:52.843698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:52.884190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:52.890112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ebb49-682e-413f-aee9-2f3982c67805 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.896111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.896761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.897073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.897347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.898434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.899803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.913917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3031/6035] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:52.914770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.924210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3005/6036] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:52.926099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.937355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c7e5-f1ee-46da-a743-435d8e095493 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.943122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.943822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.944202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.944539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.945351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.947066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:52.962930 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3006/6037] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:52.962930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:52.974559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f266-07dc-44f5-a07a-048d1ddaa9f9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:52.979636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:52.980231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:52.980502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:52.980767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:52.981434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:52.983034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.001379 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3007/6038] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:52 2022] GET /identity/v3/roles => generated 2324 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:53.001379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.003020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:53.010318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169a7d7-d038-4f12-88d0-33b96a9e46e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.016068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.016695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.016927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.017168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030c05-d652-464e-90a9-cef5b51098ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.017267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.017934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.019820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.023291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.023938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.024236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.024493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/529385782c1e4f01b5855bd2128cd3fd` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.025676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=529385782c1e4f01b5855bd2128cd3fd)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.027303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.050513 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3008/6039] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:52 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:53.051335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.076593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 529385782c1e4f01b5855bd2128cd3fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:53.077019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.077977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.084054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3032/6040] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:52 2022] DELETE /identity/v3/roles/529385782c1e4f01b5855bd2128cd3fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:53.084054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.085354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.125347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f5db8-cd06-4e30-8e9c-e87e72d9527f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.157345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84a043-c1e3-45b6-9c79-bc7e7729b6b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.162732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.163398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.163680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.163949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] PATH_INFO: `/v3/projects/ba79606e524741829336d54b9d93ea63/users/4064b8b6e24149d48f3ab0699e61c175/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.179935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba79606e524741829336d54b9d93ea63, user_id=4064b8b6e24149d48f3ab0699e61c175, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.182854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.185059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.185718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.185990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.186255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] PATH_INFO: `/v3/projects/aadcfad8dfcc4df09a1dea47eb788458/users/0acf463f50eb474ab434d3d2520cec4b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.198109 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3033/6041] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:53 2022] PUT /identity/v3/projects/ba79606e524741829336d54b9d93ea63/users/4064b8b6e24149d48f3ab0699e61c175/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:53.199146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.202166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadcfad8dfcc4df09a1dea47eb788458, user_id=0acf463f50eb474ab434d3d2520cec4b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.202619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.205078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.219210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3009/6042] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:53 2022] PUT /identity/v3/projects/aadcfad8dfcc4df09a1dea47eb788458/users/0acf463f50eb474ab434d3d2520cec4b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:53.220020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.221788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.251232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:53.272225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9a470-0bd6-4019-a327-190ff654ca59 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.293820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98005-168e-4f5d-8fa8-e74d0bda270c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.301965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.302698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.303368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.303652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] PATH_INFO: `/v3/projects/12fe7cb08a1f42ce8295228e2390635f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.305340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fe7cb08a1f42ce8295228e2390635f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.307522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.327909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:53.353896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.354617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.354788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.355054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.356344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.358476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.366057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fe7cb08a1f42ce8295228e2390635f', 'request_id': 'req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.378255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fe7cb08a1f42ce8295228e2390635f', 'request_id': 'req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.386994 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3034/6043] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:53 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:53.386994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.386994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.388342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fe7cb08a1f42ce8295228e2390635f', 'request_id': 'req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.400721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] The token cache is being invalidate because project 12fe7cb08a1f42ce8295228e2390635f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:53.401282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.402140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9e01ba78-3ce1-4c2d-8375-1fe4a1ab852f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.408241 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3010/6044] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:53 2022] DELETE /identity/v3/projects/12fe7cb08a1f42ce8295228e2390635f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:53.409867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2db87-97da-4edc-91cd-04ac9c480393 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.410147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2db87-97da-4edc-91cd-04ac9c480393 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.410510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2db87-97da-4edc-91cd-04ac9c480393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.431711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d1b2db87-97da-4edc-91cd-04ac9c480393 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:53.432914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1b2db87-97da-4edc-91cd-04ac9c480393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.468742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1c294-4046-4c41-95c4-d2a9f8bd62a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.507202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3011/6045] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:53.512636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.513133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.513521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.547582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] MFA Rules not processed for user `0acf463f50eb474ab434d3d2520cec4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:53.550253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.552053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.552797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.553113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.553390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/56a9c24d28774b01ab374041ec9c29af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.566207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=56a9c24d28774b01ab374041ec9c29af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.567852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.594926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.595689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.603997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:53.630288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.630927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.633226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3012/6046] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:53.634162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.637207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3035/6047] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:32:53 2022] PATCH /identity/v3/domains/56a9c24d28774b01ab374041ec9c29af => generated 277 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:53.638039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.639487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.639614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.655529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e43b1-101e-4f1c-b4d4-e7b40ee942bd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.703150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:53.722430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.723047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.723323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.723589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.724635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.726118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.731390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176cc6-09f9-45cf-9e1c-49160425ebcc tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.737298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.737860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3013/6048] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:53 2022] GET /identity/v3/roles => generated 2324 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:53.737982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.738247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.738518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] PATH_INFO: `/v3/users/a9b0f864ce1b4808b5b00208e0f91683` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.738708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.741873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b0f864ce1b4808b5b00208e0f91683)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.742026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.743859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.802739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b0f864ce1b4808b5b00208e0f91683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.812838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b0f864ce1b4808b5b00208e0f91683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.813544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b0f864ce1b4808b5b00208e0f91683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.819001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de3a68-b3d5-4211-8ccf-99b4a7baecc2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.822980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b0f864ce1b4808b5b00208e0f91683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.823923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b0f864ce1b4808b5b00208e0f91683'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:53.824397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.825151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.825432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.825706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.827795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.845361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.847941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.851423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3036/6049] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:53 2022] DELETE /identity/v3/users/a9b0f864ce1b4808b5b00208e0f91683 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:53.852367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.853971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.860895 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3014/6050] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:53.862687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.864330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:53.943039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98290f5-536d-4365-b0ea-e22362386de7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.948596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:53.949370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:53.949883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:53.950874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:53.951587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:53.953856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:53.981862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ffdad-1798-4fa7-aeba-626d7b7942dc service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:53.993662 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3037/6051] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:53 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:53.993662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:53.995055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.020658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:54.064345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:54.097511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405f403-fdcb-41d6-8430-96bd99cc1672 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.103207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.104590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.104719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.105445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.105830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/56a9c24d28774b01ab374041ec9c29af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.105971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.106146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.106554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] PATH_INFO: `/v3/projects/7a88edd779b346e9b73a2b5a617b9423/users/aed4f21d2c8d4df59b9b6a0b58da9b1b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.121742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=56a9c24d28774b01ab374041ec9c29af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.123808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.134735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a88edd779b346e9b73a2b5a617b9423, user_id=aed4f21d2c8d4df59b9b6a0b58da9b1b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.139386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.156081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.161784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '56a9c24d28774b01ab374041ec9c29af'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.163636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3038/6052] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:53 2022] PUT /identity/v3/projects/7a88edd779b346e9b73a2b5a617b9423/users/aed4f21d2c8d4df59b9b6a0b58da9b1b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:54.166506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.224103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.234935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.245661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.260344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] The token cache is being invalidate because project 56a9c24d28774b01ab374041ec9c29af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:54.260706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.261325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.272485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.273374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.277900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '56a9c24d28774b01ab374041ec9c29af', 'request_id': 'req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.283197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a3190-2dba-495d-a1b9-4a89f6e97e00 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.286536 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3015/6053] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:53 2022] DELETE /identity/v3/domains/56a9c24d28774b01ab374041ec9c29af => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:54.287510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.289619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.396865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.399199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.399668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.401449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.403727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.406887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.428676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db79a7-2c9a-4fcf-b9b0-711dc083ede3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.436835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.437760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.438214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.438632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.439429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.443420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.464827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3039/6054] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:54 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:54.465875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.466662 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3016/6055] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:54 2022] GET /identity/v3/roles => generated 2324 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:54.467797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.471738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.473910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.481582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:54.489578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88fcef-5299-43fe-8911-98688b28f825 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.495679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.496311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.496584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.496881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] PATH_INFO: `/v3/projects/42b7844e716941879d55a8f6e48c4ed2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.499922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b7844e716941879d55a8f6e48c4ed2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.502818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.577866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b7844e716941879d55a8f6e48c4ed2', 'request_id': 'req-2e782efa-c621-4c0a-9cd9-7fdf72232f05'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.591014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b7844e716941879d55a8f6e48c4ed2', 'request_id': 'req-2e782efa-c621-4c0a-9cd9-7fdf72232f05'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.603237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b7844e716941879d55a8f6e48c4ed2', 'request_id': 'req-2e782efa-c621-4c0a-9cd9-7fdf72232f05'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.619252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] The token cache is being invalidate because project 42b7844e716941879d55a8f6e48c4ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:54.619785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.620855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:54.626648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3017/6056] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:32:54 2022] DELETE /identity/v3/projects/42b7844e716941879d55a8f6e48c4ed2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:54.628143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d914a-6f72-48e6-8049-38d66ba88479 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.628633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.631418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.646507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:54.741978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782efa-c621-4c0a-9cd9-7fdf72232f05 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.748093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.748958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.749383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.749751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] PATH_INFO: `/v3/projects/7a88edd779b346e9b73a2b5a617b9423/users/aed4f21d2c8d4df59b9b6a0b58da9b1b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.752645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a88edd779b346e9b73a2b5a617b9423, user_id=aed4f21d2c8d4df59b9b6a0b58da9b1b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.755887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.757179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.757856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.758131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.758399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/979c1a27677a45d7825abb0022e7d86c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.767874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f8195f7a91c4172a17eb60350e4bb0e, implied_role_id=979c1a27677a45d7825abb0022e7d86c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.769711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3018/6057] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:54 2022] PUT /identity/v3/projects/7a88edd779b346e9b73a2b5a617b9423/users/aed4f21d2c8d4df59b9b6a0b58da9b1b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:54.771675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.778051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.779596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b2c5-dced-4d12-8057-83ea75d0f087 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.800652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3040/6058] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:54 2022] DELETE /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e/implies/979c1a27677a45d7825abb0022e7d86c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:54.802574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.802861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.803133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.842051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:54.843286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:54.877143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005790c-bf5a-486d-a32a-0f5a0d998788 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:54.912636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:54.962052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:54.962701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.963276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.963882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.964544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:54.966274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6f9fe-dedf-40d1-b15f-6c9bc9dc953c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:54.982526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3019/6059] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:54 2022] GET /identity/v3/roles => generated 2324 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:54.983908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:54.984215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:54.984458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:54.990381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3041/6060] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:54.991444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:54.997570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.029820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] MFA Rules not processed for user `aed4f21d2c8d4df59b9b6a0b58da9b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:55.032033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.140602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d723ee4-b988-426b-a85c-54a2fe351ec0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.149589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.150654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.151211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.151717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/979c1a27677a45d7825abb0022e7d86c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.154386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=979c1a27677a45d7825abb0022e7d86c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.156310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.182227 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3020/6061] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:55.182227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.195403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ffd4c-110b-4cba-970d-33b5c81daec4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.202279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.203118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.203581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.204005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.204709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.208100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.218086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 979c1a27677a45d7825abb0022e7d86c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:55.219159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:55.219972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1448d87d-c441-4d5f-9938-b2fea86696a1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:55.223317 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3042/6062] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:54 2022] DELETE /identity/v3/roles/979c1a27677a45d7825abb0022e7d86c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:55.226515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.227251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.227788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.230816 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3021/6063] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:55 2022] GET /identity/v3/roles => generated 2324 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:55.231759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.234434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.251107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82a1e2-d1db-4075-95f8-7fa7c06fcb9e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.286158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:55.293083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.328183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:55.342674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.343310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.343585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.343853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.344503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.351158 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:55.351158 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:55.351158 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:55.352104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.389639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3022/6064] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:55 2022] POST /identity/v3/regions => generated 224 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:55.390598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.396368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.451307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3043/6065] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:55.452385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.457068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.468545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:55.489806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2c650-825e-4375-a462-e703b240a01f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.496890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.497845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.498318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.498871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] PATH_INFO: `/v3/projects/c69187a807d5410ea6a7740aadbf6774/users/062bb34ef07e4f7f896e9059a0a4a2e9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.525897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69187a807d5410ea6a7740aadbf6774, user_id=062bb34ef07e4f7f896e9059a0a4a2e9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.529258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.554910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3044/6066] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:55 2022] PUT /identity/v3/projects/c69187a807d5410ea6a7740aadbf6774/users/062bb34ef07e4f7f896e9059a0a4a2e9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:55.557431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.576461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeb61f-3448-4f94-950d-d88a2fd0a986 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.700154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.701143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.705600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.706715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.709664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7f8195f7a91c4172a17eb60350e4bb0e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.711470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.719833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e825b6f-c93b-4b2e-b74b-6ed3acab09ed admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.727113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:55.728839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.729650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.730395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.732559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:55.735016 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:55.735016 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:32:55.735016 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:32:55.736390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:55.775983 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3045/6067] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:32:55 2022] POST /identity/v3/regions => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:55.777033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.789889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 7f8195f7a91c4172a17eb60350e4bb0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:32:55.790226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:55.790903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c35c2cdf-ab60-42f9-8383-46d8f8fec83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:32:55.798388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3023/6068] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:32:55 2022] DELETE /identity/v3/roles/7f8195f7a91c4172a17eb60350e4bb0e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:55.799838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:55.800112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:55.800387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:55.842031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] MFA Rules not processed for user `062bb34ef07e4f7f896e9059a0a4a2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:55.843391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:55.919216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:55.930139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052f3c-f46e-4d6e-90af-018e4d617c3d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:55.965706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3024/6069] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:55.966707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:55.985507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:56.019751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.020377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.020655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.020926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.021618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:56.021923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.023489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:56.023677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.037208 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3046/6070] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:56.038230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.042258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:56.115115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809301-4b4a-4dcc-b7b9-0b863c062a36 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.124458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.125038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.125356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.125745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/09fe7fdb-b338-462a-856e-df8a8a8a0f7d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.126577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:create_region(region_id=09fe7fdb-b338-462a-856e-df8a8a8a0f7d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.128712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.183048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3025/6071] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Oct 18 16:32:55 2022] PUT /identity/v3/regions/09fe7fdb-b338-462a-856e-df8a8a8a0f7d => generated 231 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:56.183939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.185962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:56.224077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2c980-0f9a-4427-af32-c9fbd69de93c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.282356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.282983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.283265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.283605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.289252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.298915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.348637 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3047/6072] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:56 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 521 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:56.348637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.348972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dbd05-4e60-43b1-9a66-6052b122b57c tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.350234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:56.422383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.423148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.423771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.424709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.430766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:56.498505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:56.521427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fca32-faae-49c1-9e9f-9064c498ccea tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.527487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.528117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.529250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.529250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.529480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.531332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.575515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.577229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.596200 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3048/6073] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:56 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:56.596200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.597405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:56.630585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3026/6074] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:56.631910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.720443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390690-2acf-4930-bab1-350a471808ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.729660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.730473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.730848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.731187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/09fe7fdb-b338-462a-856e-df8a8a8a0f7d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.731980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=09fe7fdb-b338-462a-856e-df8a8a8a0f7d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.733806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.759278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a04d2-0489-4dda-895d-7fbd4719cc69 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.773618 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3049/6075] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Oct 18 16:32:56 2022] DELETE /identity/v3/regions/09fe7fdb-b338-462a-856e-df8a8a8a0f7d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:56.773618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.884037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40bf35-1a86-4722-a5dc-8f6f2f4db028 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.886573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.887599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.887879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.888152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.890716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.892319 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:56.892319 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:56.892319 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:56.894046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.895273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.895909 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:56.895909 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:56.895909 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:56.896767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.903926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3027/6076] 10.222.0.78 () {58 vars in 1345 bytes} [Tue Oct 18 16:32:56 2022] HEAD /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:56.904836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:56.907031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.908107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.909221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.910334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.911258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.915950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f133-88de-444b-9e7e-31b263971be6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.950645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5705fc-f9a3-4dcb-8132-e54d023c580f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:56.956418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:56.957206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.957490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.957759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.958461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:56.960059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:56.961937 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3050/6077] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:56 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:56.963531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:56.963816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:56.964149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:56.991461 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3028/6078] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:32:56 2022] POST /identity/v3/regions => generated 254 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:56.993036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.020699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9981-263c-4c90-b87a-430d2e4e9ca7 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.027262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.028071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.028362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.028688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.030421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.032109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.038734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:57.040223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:57.040671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3029/6079] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:32:56 2022] GET /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 521 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:57.041967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.046322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:57.068505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754150d-c7dd-4500-9a44-234bc9fdb4e3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.075723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.076269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.076546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.076829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.077644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.079264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.093736 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3030/6080] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:57 2022] GET /identity/v3/roles => generated 2324 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:57.095058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.135290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1883-2e71-439b-91a8-8ddec2ed3017 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.144436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.145575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.146799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.147211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/60e29a330e3441a8a233b329063d3c91` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.148095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:update_region(region_id=60e29a330e3441a8a233b329063d3c91)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.151349 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:57.151349 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:57.151349 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:57.152396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.164140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:57.166211 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3051/6081] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:57.176317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.186268 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3031/6082] 10.222.0.78 () {60 vars in 1250 bytes} [Tue Oct 18 16:32:57 2022] PATCH /identity/v3/regions/60e29a330e3441a8a233b329063d3c91 => generated 253 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:57.187358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.195941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887daab-bcfe-4374-9637-4218b232d70f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.216513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.217463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a925e9b-28fb-4260-907e-7c6f5dbc673b tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.218493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.218986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.220159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.224678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.225045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.225673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.225996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.226753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.227273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.227944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.233957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.244170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3052/6083] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:57 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:57.245770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.265566 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3032/6084] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:57 2022] GET /identity/v3/roles => generated 2324 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:57.266678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.285737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9546266-9a72-4a78-8748-a9155704df98 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.372229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.373091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.374337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.374489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.380281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.385972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1.: keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = query.one() Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:57.403163 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 16:32:57.404504 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 16:32:57.405735 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 16:32:57.405735 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:57.405735 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.405970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3033/6085] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:32:57 2022] GET /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 137 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:57.406625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.432785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add080a0-37b1-4ba2-85fb-ce0abe4b748f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.438190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.439051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.439486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.440043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/60e29a330e3441a8a233b329063d3c91` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.441560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:get_region(region_id=60e29a330e3441a8a233b329063d3c91)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.442801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.452871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3053/6086] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:57 2022] GET /identity/v3/regions/60e29a330e3441a8a233b329063d3c91 => generated 253 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:57.453979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.457862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:57.552807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec551c-0fcd-412f-b58f-1890f7059fff tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.558867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.559533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.559805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.560467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] PATH_INFO: `/v3/projects/085b9a8ddacd498598765a38d156b106/users/2d725b415a17400eaaf102e10809ad54/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.579014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe3d5b-aea4-40f4-86c7-b4e39d81b082 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.582610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085b9a8ddacd498598765a38d156b106, user_id=2d725b415a17400eaaf102e10809ad54, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.586005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.592899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.593569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.593865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.594114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.601751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:57.630658 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3034/6087] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:57 2022] PUT /identity/v3/projects/085b9a8ddacd498598765a38d156b106/users/2d725b415a17400eaaf102e10809ad54/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:57.630658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.678608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.680443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.695201 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3054/6088] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:57.696244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.719324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21aba8-961f-45f5-bec6-3e14ecc97b49 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.763298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:57.774085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a9d9-6255-4310-99bc-2ab6ca7689c5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:57.790038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.790910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.791193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.791478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.795776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.796835 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:57.796835 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:57.796835 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:57.798280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9775d307-64ac-4c6a-bc9f-42e524031e83 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1.: keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = query.one() Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._iter().one() Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._only_one_row( Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:57.826728 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 18 16:32:57.827857 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 18 16:32:57.828844 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 18 16:32:57.828844 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 18 16:32:57.828844 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 18 16:32:57.828844 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: eb3f2a1b48d34841850b09ac78a6e9bb does not imply 6263f1ac79214b84becc823ccf9a2fa1. Oct 18 16:32:57.828844 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:57.829196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3035/6089] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:57 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 137 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:57.830895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.834883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.835174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.861801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:57.863549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:57.865381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:57.865660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/60e29a330e3441a8a233b329063d3c91` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:57.866435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=60e29a330e3441a8a233b329063d3c91)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:57.868469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:57.901452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] MFA Rules not processed for user `2d725b415a17400eaaf102e10809ad54`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:57.904959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:57.912343 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3055/6090] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:57 2022] DELETE /identity/v3/regions/60e29a330e3441a8a233b329063d3c91 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:57.913885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:57.992154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fd484-64bb-4ee6-b9b1-d9be7bc0adb6 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.010086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.017950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.018515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.020151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.023764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.025402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.093545 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3056/6091] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:57 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 521 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:58.101699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.138182 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3036/6092] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:58.144033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.150660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:58.292641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:58.328695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441be-cf3d-4bbf-858d-3bf571962f06 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.353827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.354465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.354741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.355013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.355321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a7f46-267c-4c05-8ce3-4c9675629992 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.355623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.359039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.381546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3057/6093] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:32:58 2022] GET /identity/v3/regions => generated 669 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:58.382505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.514685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.515425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.515703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.516336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.612486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a69b9-23b1-45d2-96f9-2213ae6dcb9e tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.621694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.623371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.623371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.623371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.629961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.631810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.639356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:58.663957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.667518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.679794 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3058/6094] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:58 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64 => generated 521 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:58.680695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.713688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3037/6095] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:32:58.714341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.742455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd3bc6-732f-4ec5-8934-be2d16ccc8b4 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.865791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd113c-6343-4463-af0d-6113a775edd6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:58.871926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.873590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.873870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.874136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.875481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.878543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccc816-c898-478d-a1d5-c3545eb7de86 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.891209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:58.894525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.895037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.895516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/60e29a330e3441a8a233b329063d3c91` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:58.896324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=60e29a330e3441a8a233b329063d3c91)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:58.899696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Could not find region: 60e29a330e3441a8a233b329063d3c91.: keystone.exception.RegionNotFound: Could not find region: 60e29a330e3441a8a233b329063d3c91. Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 60e29a330e3441a8a233b329063d3c91. Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:32:58.929124 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 60e29a330e3441a8a233b329063d3c91. Oct 18 16:32:58.930409 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:32:58.934856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3038/6096] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:32:58 2022] DELETE /identity/v3/regions/60e29a330e3441a8a233b329063d3c91 => generated 112 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:32:58.934856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:58.954567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3059/6097] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:32:58 2022] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:58.962079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:58.962907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:58.963206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.011172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:32:59.012418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:32:59.024691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3a3ad-a442-4544-8085-f7353380bb96 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.072577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:59.116647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.117085 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3060/6098] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:32:59.117907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.118655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.119133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.120586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.122719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8155840ac06a462e906ff442f9fe8f64, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.124838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.168128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3039/6099] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:32:58 2022] PUT /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b => generated 521 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:59.169922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.181276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:59.203913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41f11b-de11-4ff3-8c34-e53c376febd8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.296655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.297315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.297609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.297847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.298573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.301641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.314040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3061/6100] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:32:59 2022] GET /identity/v3/regions => generated 669 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:59.314040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.322333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a45f04-1c28-4b4d-8d73-7ddbf3359c76 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.339190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.340713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.341033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.341324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.348025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.349605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.401238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3040/6101] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:32:59 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:59.405458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.489066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decc9a2-5299-482d-8383-1333f18e7e25 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.497847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.498721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.499169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.499595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.535559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:59.568968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394d019-f5b8-4cbb-ad35-5a8ad3fe014a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.574098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.574844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.575271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.575664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.576931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.578247 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:32:59.578247 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:32:59.578247 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:32:59.586520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.636237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3041/6102] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Oct 18 16:32:59 2022] GET /identity/v3/role_inferences => generated 1608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:59.639576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.651076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.653337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.669031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c764a-f3e4-463b-8bfa-d2f821a33c9e tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.674984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.675746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.676126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.676498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.677374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.682128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.707386 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3062/6103] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:32:59.707951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.729433 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3042/6104] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:32:59 2022] POST /identity/v3/regions => generated 253 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:32:59.753267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.753794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31770e-fc1d-48e7-a863-d616e5123494 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.791349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.791966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.792241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.792510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.793331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.795135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.807036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72e16-d38e-4084-91ab-1f6e31c9168f tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.815349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.816680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.816836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3063/6105] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:32:59 2022] GET /identity/v3/roles => generated 2324 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:32:59.817852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.818417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.819577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.822176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8155840ac06a462e906ff442f9fe8f64, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.824745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.848586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3043/6106] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:59 2022] DELETE /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:32:59.849559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:32:59.873456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a7bae-ae17-4c82-b479-a761f92aaa8f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.928612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:32:59.951968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ce6-4081-4629-b635-9d6aa57564ee tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:32:59.957384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.958572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.959235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.960278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.961391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Adding query filter params (parent_region_id=ceb52a8c791942e3b8ed208ccc00ba73) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:32:59.962550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:32:59.963509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:32:59.964244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:32:59.964375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:32:59.964701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:32:59.964840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] PATH_INFO: `/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b/users/b70befd21e674da5bd9e3a0157c3eb11/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:32:59.973194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3064/6107] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:32:59 2022] GET /identity/v3/regions?parent_region_id=ceb52a8c791942e3b8ed208ccc00ba73 => generated 399 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:32:59.974470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.005942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e76cf2caa85486f87584a6ab4fe8a8b, user_id=b70befd21e674da5bd9e3a0157c3eb11, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.014188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.049952 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3044/6108] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:32:59 2022] PUT /identity/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b/users/b70befd21e674da5bd9e3a0157c3eb11/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.049952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.049952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.113189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17bda2-97e2-45c9-b962-2fc77f608b7a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.147159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96ac23-1468-4172-a76c-d05afd8d814a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.153536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.154510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.155203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.155652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] PATH_INFO: `/v3/users/0acf463f50eb474ab434d3d2520cec4b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.157320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0acf463f50eb474ab434d3d2520cec4b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.160218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.181522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:00.239969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.241296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.242066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0acf463f50eb474ab434d3d2520cec4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:00.242554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.242832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.243834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0acf463f50eb474ab434d3d2520cec4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:00.245057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.246984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.258174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0acf463f50eb474ab434d3d2520cec4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:00.259012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0acf463f50eb474ab434d3d2520cec4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:00.265550 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3065/6109] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:32:59 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.266654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.270910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.271868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0acf463f50eb474ab434d3d2520cec4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:00.330781 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3045/6110] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:00 2022] DELETE /identity/v3/users/0acf463f50eb474ab434d3d2520cec4b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.332241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.341620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.531962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90071-910e-49db-80b9-5ec3c34f26c4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.541704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:00.573580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b9ae-5c68-40f2-a966-5b78e779801d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.589416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.590332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.590779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.591211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.592028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.593862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.619966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3046/6111] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:00 2022] GET /identity/v3/roles => generated 2324 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:00.620751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.625987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.648450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.649253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.649488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.649768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/a6caa1a753b14ddcae89d50529411e60` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.650368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a6caa1a753b14ddcae89d50529411e60)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.651982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96556e25-bd86-4d40-89b6-2dc37d31ea1a tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.689296 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3066/6112] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:00 2022] DELETE /identity/v3/regions/a6caa1a753b14ddcae89d50529411e60 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.691549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.691839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.692115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.740350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:00.741619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.783178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3067/6113] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:00.784438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.796371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da946f-95c8-4297-b4f9-bb20325d2d21 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.805859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2458a-8b8c-4fab-854a-394896f5a709 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:00.819012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.819703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.819984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.820262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] PATH_INFO: `/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b/users/b70befd21e674da5bd9e3a0157c3eb11/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.824292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e76cf2caa85486f87584a6ab4fe8a8b, user_id=b70befd21e674da5bd9e3a0157c3eb11, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.826996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.848066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:00.849038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:00.849278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:00.849541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:00.855005 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3068/6114] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:00 2022] PUT /identity/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b/users/b70befd21e674da5bd9e3a0157c3eb11/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.855555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:00.855877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.857221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:00.881425 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3047/6115] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:33:00 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:00.882504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:00.886490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:00.963045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:01.015612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb6a2-6c38-4dde-82b0-a508545fb008 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.060715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f1560-cae1-4754-b2b8-cdd3524c24d4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.068889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.069509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.069812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.070144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.131106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.132346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.132846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.133500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/07b7ebc86cd14467b200fbd350f5837d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.134359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=07b7ebc86cd14467b200fbd350f5837d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.136538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333175b5-27ec-4ed4-97fe-b9d1af882020 tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.159827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.162069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.171331 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3069/6116] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:00 2022] DELETE /identity/v3/regions/07b7ebc86cd14467b200fbd350f5837d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:01.175152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.175759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.176254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.177258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3048/6117] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:01.178255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.205257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:01.230260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] MFA Rules not processed for user `b70befd21e674da5bd9e3a0157c3eb11`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:01.232089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.292269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf400cc-d477-47da-8f9b-269eed485981 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.310584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.311402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.311685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.311955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.312598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.314436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922545-940d-4a70-80e8-490bd3b83e4b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.339317 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3049/6118] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:01 2022] GET /identity/v3/roles => generated 2324 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:01.340762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.341142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.341348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.345479 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3070/6119] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:01.347240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.383208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1519-8fda-47fb-9b35-8af3d0d5fa24 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.390685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aed4f21d2c8d4df59b9b6a0b58da9b1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a88edd779b346e9b73a2b5a617b9423', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.391822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.392108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.392440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] PATH_INFO: `/v3/regions/ceb52a8c791942e3b8ed208ccc00ba73` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.394384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ceb52a8c791942e3b8ed208ccc00ba73)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.394986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] MFA Rules not processed for user `4064b8b6e24149d48f3ab0699e61c175`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:01.396252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.397855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.427634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3071/6120] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:01 2022] DELETE /identity/v3/regions/ceb52a8c791942e3b8ed208ccc00ba73 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:01.427634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.462900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:01.466426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e1e2-e865-43e6-b3ba-cf2f60b3ef5d tempest-RegionsTestJSON-1055852642 tempest-RegionsTestJSON-1055852642-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.474872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.475640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.476298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.476298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.478435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.480143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.506719 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3072/6121] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/roles => generated 235 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:01.507551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.548283 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3050/6122] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:01.548283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.548283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.574774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b722-c559-4880-8de9-3841e0e748b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.580335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d906f1e-4e20-437e-8610-ac52f2e509e5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.588535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.588701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.589515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.589907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.590251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] PATH_INFO: `/v3/users/95bd43c73f43458eaff0610ad1c80ae6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.590638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.591633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.592013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bd43c73f43458eaff0610ad1c80ae6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.592554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.593839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.594529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.599759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.630321 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3073/6123] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/domains => generated 275 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:01.631418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.694747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bd43c73f43458eaff0610ad1c80ae6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:01.695683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bd43c73f43458eaff0610ad1c80ae6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:01.709766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bd43c73f43458eaff0610ad1c80ae6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:01.711739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bd43c73f43458eaff0610ad1c80ae6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:01.720059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429206f-2053-4e67-8669-b305fc090927 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.726754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.727493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.727808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.728229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/b97417288a7f4895a8bc8d8d8575aec7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.729885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:update_role(role_id=b97417288a7f4895a8bc8d8d8575aec7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.731364 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:01.731364 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:33:01.731364 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:33:01.732376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.737778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bd43c73f43458eaff0610ad1c80ae6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:01.754526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:01.776009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3074/6124] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Oct 18 16:33:01 2022] PATCH /identity/v3/roles/b97417288a7f4895a8bc8d8d8575aec7 => generated 238 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:01.778575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.779158 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3051/6125] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:01 2022] DELETE /identity/v3/users/95bd43c73f43458eaff0610ad1c80ae6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:01.780611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.781975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.784521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.868533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cef1b-7535-492a-8199-041d86c79035 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.875808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814cc9-f277-43e3-aee0-7aab6b5aed96 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.881065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.881811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.882145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.882508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.883240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.884955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.904901 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3052/6126] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/domains => generated 275 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:01.906110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.909877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:01.951302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.952875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.953187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.953461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.954148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.956789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:01.963413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:01.991771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860028e1-3f05-4e9c-8db5-ce797d5ca8b2 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:01.996597 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3075/6127] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:01.996742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:01.997095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:01.997375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:01.997640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] PATH_INFO: `/v3/projects/aadcfad8dfcc4df09a1dea47eb788458` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:01.997744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:01.998771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadcfad8dfcc4df09a1dea47eb788458)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:01.999627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.001122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.055385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadcfad8dfcc4df09a1dea47eb788458', 'request_id': 'req-c061085b-5f1f-407c-bd45-ca89398c584a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.066142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadcfad8dfcc4df09a1dea47eb788458', 'request_id': 'req-c061085b-5f1f-407c-bd45-ca89398c584a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.075649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1128338-170e-4195-bab1-9fb566a9b625 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.079909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadcfad8dfcc4df09a1dea47eb788458', 'request_id': 'req-c061085b-5f1f-407c-bd45-ca89398c584a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.098891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] The token cache is being invalidate because project aadcfad8dfcc4df09a1dea47eb788458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:02.099250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.100001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c061085b-5f1f-407c-bd45-ca89398c584a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.101887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3053/6128] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:01 2022] DELETE /identity/v3/projects/aadcfad8dfcc4df09a1dea47eb788458 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:02.103310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.103619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.103920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.129190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:02.130428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.144880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:02.145335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.146302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.146731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.147196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/b97417288a7f4895a8bc8d8d8575aec7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.167648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:get_role(role_id=b97417288a7f4895a8bc8d8d8575aec7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.168888 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:02.168888 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:33:02.168888 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:33:02.170373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.171943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3076/6129] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:33:01 2022] GET /identity/v3/roles/b97417288a7f4895a8bc8d8d8575aec7 => generated 238 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:02.172561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.175300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.223263 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3054/6130] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:02.224252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.226850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.250792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f8d92-5ec9-43dc-a530-72400a4e1341 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.257303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.257911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.258184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.258450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.261677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.263730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.272573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85125aeb-ff3c-428d-a866-58ea98697847 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.282725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.284276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.284895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.285133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.286217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.287836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.308777 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3077/6131] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:33:02 2022] POST /identity/v3/domains => generated 277 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:02.309804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.314256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3055/6132] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:02 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:02.314846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.316018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.318277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.339906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403dc90-7b37-4d9e-8ebd-beb271d5b3ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.364908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:02.474699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf915975-99ba-48d5-b7cd-c20143e982c7 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.478611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.479238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.479513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.479781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.481481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.482621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.487306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.488091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.488388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.488665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] PATH_INFO: `/v3/users/062bb34ef07e4f7f896e9059a0a4a2e9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.490247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062bb34ef07e4f7f896e9059a0a4a2e9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.492194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.529937 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3056/6133] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:02 2022] GET /identity/v3/roles => generated 2553 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:02.530737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.552848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.584964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062bb34ef07e4f7f896e9059a0a4a2e9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.600652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062bb34ef07e4f7f896e9059a0a4a2e9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.602439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062bb34ef07e4f7f896e9059a0a4a2e9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.614937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062bb34ef07e4f7f896e9059a0a4a2e9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.616670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062bb34ef07e4f7f896e9059a0a4a2e9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:02.660931 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3078/6134] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:02 2022] DELETE /identity/v3/users/062bb34ef07e4f7f896e9059a0a4a2e9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:02.662641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.664430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.772686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b171-bf58-46a1-832f-11773d33e275 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.864982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:02.886831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.887466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.887730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.887998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.895160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b806-53f5-40a9-aeee-c24d8abf8022 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:02.896023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:02.905277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:02.906320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:02.906666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:02.906868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:02.907549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:02.910677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:02.946417 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3079/6135] 10.222.0.78 () {60 vars in 1150 bytes} [Tue Oct 18 16:33:02 2022] POST /identity/v3/domains => generated 280 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:02.947615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:02.952676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.031691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:03.066279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c1cc-2f44-446a-bdf8-c2dfd14b57dd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.072953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.073884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.074380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.074882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.075876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.077888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.090006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.091971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.096984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3080/6136] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:02 2022] GET /identity/v3/roles => generated 2553 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:03.096984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.110376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.112053 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3057/6137] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:03.113346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.127885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ebcd-1fed-42da-8394-400cf1747483 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.250509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.251159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.251499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.251774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/18fbfbbac34a4c728a3abd1dc52e975f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.272583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=18fbfbbac34a4c728a3abd1dc52e975f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.272900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579fc19-8192-44d3-8037-24e14ad8b2b5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.280236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.284860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.285619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.286065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.286328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/b97417288a7f4895a8bc8d8d8575aec7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.287965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b97417288a7f4895a8bc8d8d8575aec7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.290613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.328143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.335863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.381532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role b97417288a7f4895a8bc8d8d8575aec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:03.381831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.386411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.396262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3081/6138] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:03 2022] DELETE /identity/v3/roles/b97417288a7f4895a8bc8d8d8575aec7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:03.397873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.402771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.444620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.459126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.488133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.491940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:03.509884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project 18fbfbbac34a4c728a3abd1dc52e975f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:03.511069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.517396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.543708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.545128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.550718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '18fbfbbac34a4c728a3abd1dc52e975f', 'request_id': 'req-853d3823-5fc3-49f0-866e-3347c2debffe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.568265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3058/6139] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:03 2022] DELETE /identity/v3/domains/18fbfbbac34a4c728a3abd1dc52e975f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:03.569284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.577056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.586167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4203ed9-f821-46f2-8b24-008701f4b83f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.682239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d3823-5fc3-49f0-866e-3347c2debffe tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.697529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.698714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.699198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.699660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] PATH_INFO: `/v3/projects/c69187a807d5410ea6a7740aadbf6774` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.703143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69187a807d5410ea6a7740aadbf6774)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.706233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:03.709228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.775455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.776590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.777111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.777593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] PATH_INFO: `/v3/projects/92905cba15d146cfbf6b9a73ffe13778/users/8413a8725d6d4561ae3a851486c29a69/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.807760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69187a807d5410ea6a7740aadbf6774', 'request_id': 'req-967d9113-4e88-484f-aac7-e4baaa364616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.818790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69187a807d5410ea6a7740aadbf6774', 'request_id': 'req-967d9113-4e88-484f-aac7-e4baaa364616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.822159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92905cba15d146cfbf6b9a73ffe13778, user_id=8413a8725d6d4561ae3a851486c29a69, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.827759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69187a807d5410ea6a7740aadbf6774', 'request_id': 'req-967d9113-4e88-484f-aac7-e4baaa364616'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.828347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:03.841643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] The token cache is being invalidate because project c69187a807d5410ea6a7740aadbf6774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:03.842030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.842973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:03.845044 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3059/6140] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:03 2022] DELETE /identity/v3/projects/c69187a807d5410ea6a7740aadbf6774 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:03.846077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.848104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.864936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3082/6141] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:03 2022] PUT /identity/v3/projects/92905cba15d146cfbf6b9a73ffe13778/users/8413a8725d6d4561ae3a851486c29a69/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:03.866336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:03.869288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:03.932322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9113-4e88-484f-aac7-e4baaa364616 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.949364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:03.968107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39627cde-c4b8-4beb-b964-1d4aa73a1518 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:03.973860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:03.974536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:03.974822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:03.975278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:03.977176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:03.978820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.003847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3083/6142] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:03 2022] POST /identity/v3/domains => generated 248 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:04.004637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.008261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.008487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.009087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.009449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.009784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.011869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.013608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6005-87f5-43a3-b0bf-91e7793918c3 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.053132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3060/6143] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:33:03 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 521 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:04.054634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.054999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.055340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.083873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:04.086126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.110598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866cb10-7fb3-433f-a9ec-f8df3864dd38 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.200725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.201402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.202056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.202338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] PATH_INFO: `/v3/projects/4414b1e0651f40318b6f6449508f8dc2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.203505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4414b1e0651f40318b6f6449508f8dc2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.206144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.208874 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3061/6144] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:04.211049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.212731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.225520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:04.233320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369eb0-8b77-48a0-a4a4-248191981372 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.242897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.244004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.244508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.245232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.246333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.248633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.263522 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3062/6145] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:04 2022] GET /identity/v3/roles => generated 2324 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:04.264254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.280057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4414b1e0651f40318b6f6449508f8dc2', 'request_id': 'req-f620f87d-acaf-4181-a407-e8b3e29b2148'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.287704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4414b1e0651f40318b6f6449508f8dc2', 'request_id': 'req-f620f87d-acaf-4181-a407-e8b3e29b2148'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.297496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4414b1e0651f40318b6f6449508f8dc2', 'request_id': 'req-f620f87d-acaf-4181-a407-e8b3e29b2148'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.321588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] The token cache is being invalidate because project 4414b1e0651f40318b6f6449508f8dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:04.321886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.323643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.327371 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3084/6146] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:04 2022] DELETE /identity/v3/projects/4414b1e0651f40318b6f6449508f8dc2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:04.328193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.330940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.386440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6952-d35e-48d2-b949-75116e35530b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.445513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:04.472455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620f87d-acaf-4181-a407-e8b3e29b2148 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.478762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.479556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.479907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.480253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.482307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.485121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638280c-1942-4e5a-9453-d53365a3bf6c tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.494574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.495872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.496351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.496847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/641cb4f5dc9943c9b42166dff4f9568e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.514745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=641cb4f5dc9943c9b42166dff4f9568e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.516756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.517234 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3085/6147] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:33:04 2022] PUT /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64 => generated 521 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:04.521351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.522002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.523558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.550876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:04.551349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.552110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.552245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.590514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.591292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.594999 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3063/6148] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:04 2022] PATCH /identity/v3/domains/641cb4f5dc9943c9b42166dff4f9568e => generated 249 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:04.596010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.598513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.629735 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3086/6149] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:04.630737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.633028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.648690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bbbb2-1c59-4048-8ad0-fa1fad6c8a16 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.653625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.654267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.654542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.654810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] PATH_INFO: `/v3/users/aed4f21d2c8d4df59b9b6a0b58da9b1b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.655942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed4f21d2c8d4df59b9b6a0b58da9b1b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.658108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.675924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:04.705952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ad8f-d6c4-4602-be11-3affd12a138e tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.712412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.713252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.713535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.713935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] PATH_INFO: `/v3/projects/92905cba15d146cfbf6b9a73ffe13778/users/8413a8725d6d4561ae3a851486c29a69/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.716142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92905cba15d146cfbf6b9a73ffe13778, user_id=8413a8725d6d4561ae3a851486c29a69, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.720783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:04.735113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3064/6150] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:04 2022] PUT /identity/v3/projects/92905cba15d146cfbf6b9a73ffe13778/users/8413a8725d6d4561ae3a851486c29a69/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:04.735530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.737381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.741406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed4f21d2c8d4df59b9b6a0b58da9b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.766659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed4f21d2c8d4df59b9b6a0b58da9b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.767269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed4f21d2c8d4df59b9b6a0b58da9b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.777484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed4f21d2c8d4df59b9b6a0b58da9b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.778279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed4f21d2c8d4df59b9b6a0b58da9b1b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:04.808239 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3087/6151] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:04 2022] DELETE /identity/v3/users/aed4f21d2c8d4df59b9b6a0b58da9b1b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:04.808239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:04.821696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:04.867535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944b976-7f6c-475a-9aa4-f0b4c381b4e6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:04.902913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:04.964132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:04.964900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:04.965504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:04.965787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:04.967797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8155840ac06a462e906ff442f9fe8f64, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:04.970942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.016488 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3065/6152] 10.222.0.78 () {60 vars in 1363 bytes} [Tue Oct 18 16:33:04 2022] PUT /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b => generated 521 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:05.018725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.022154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:05.022420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c4cca-9dab-4d13-89ce-44eacce412f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.118517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.119290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.119660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.121912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/641cb4f5dc9943c9b42166dff4f9568e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.151864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=641cb4f5dc9943c9b42166dff4f9568e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.153882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.161677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ade3-3845-4856-8d3d-e2f7ba6267e9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.167210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.167896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.168089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.168365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.170350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:05.170842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.175116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.193890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.200243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.206369 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3066/6153] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:05.207615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.212063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:05.214145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:05.321023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.330055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.380599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.416689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project 641cb4f5dc9943c9b42166dff4f9568e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:05.417078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.419514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.430928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66fbe-9675-42e1-ac71-41866d990299 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.435682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.436745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.441621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '641cb4f5dc9943c9b42166dff4f9568e', 'request_id': 'req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:05.453202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3088/6154] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:04 2022] DELETE /identity/v3/domains/641cb4f5dc9943c9b42166dff4f9568e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:05.454647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.456287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:05.557767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0bca-4c21-4d41-a910-4c330f2ead7d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.558270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:05.570953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.572368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.573142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.573591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.574448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.579317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.598915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.600963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.601834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.601834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.606502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.609792 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:05.609792 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:33:05.609792 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:33:05.613202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.631686 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3067/6155] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:33:05 2022] GET /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies => generated 490 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:05.637819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.642012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:05.652285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3089/6156] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:05 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:05.653489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.659663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:05.849732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805023-8d39-40b8-a762-ffa466d26e20 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.878947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214693c-6d4d-487c-ac08-a4960d1e9e48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:05.889792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.890499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.890948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.891255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] PATH_INFO: `/v3/projects/7a88edd779b346e9b73a2b5a617b9423` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.893855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a88edd779b346e9b73a2b5a617b9423)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.896086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.904879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:05.962111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:05.963203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:05.963825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:05.964317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:05.965520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:05.967637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:05.994161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3068/6157] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:05 2022] POST /identity/v3/domains => generated 278 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:05.995239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:05.998429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.010838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a88edd779b346e9b73a2b5a617b9423', 'request_id': 'req-44c294eb-ae5f-4320-9dc0-c37be9b451b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.025562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a88edd779b346e9b73a2b5a617b9423', 'request_id': 'req-44c294eb-ae5f-4320-9dc0-c37be9b451b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.045589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a88edd779b346e9b73a2b5a617b9423', 'request_id': 'req-44c294eb-ae5f-4320-9dc0-c37be9b451b3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.067621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] The token cache is being invalidate because project 7a88edd779b346e9b73a2b5a617b9423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:06.067818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.071909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.074275 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3090/6158] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:05 2022] DELETE /identity/v3/projects/7a88edd779b346e9b73a2b5a617b9423 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:06.075757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.077301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.119630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3ddc3-9d9e-4fea-9bbe-c9f2e32a06cd tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.127992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.129655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.130181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.130981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.133697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.136210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.150492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3069/6159] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Oct 18 16:33:05 2022] GET /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies => generated 661 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:06.150492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.151407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.185830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c294eb-ae5f-4320-9dc0-c37be9b451b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.194154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:06.250337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b412-e146-4691-ad91-c0651dfdb7c6 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.257548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.259139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.259531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.259890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/76f095ebe2174edc811d6be1f02919a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.277863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=76f095ebe2174edc811d6be1f02919a6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.280495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.285978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.287573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.291505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.292237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.293451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.298148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f1417-bc81-480c-9c3f-cd2e6b1723e8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.353670 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3091/6160] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:06 2022] POST /identity/v3/users => generated 286 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:06.357707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.357863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.358503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.359945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.360901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.414658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:06.417710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.423173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.424144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.427948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3070/6161] 10.222.0.78 () {60 vars in 1250 bytes} [Tue Oct 18 16:33:06 2022] PATCH /identity/v3/domains/76f095ebe2174edc811d6be1f02919a6 => generated 279 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:06.428870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.431414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.494661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:06.571836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4d0f-2ead-42d3-828d-3327e1ac394f tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.576748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.577467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.577748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.578025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.579424 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3092/6162] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:06.580649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8155840ac06a462e906ff442f9fe8f64, implied_role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.581420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.583095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.586802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.594751 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3071/6163] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:33:06 2022] DELETE /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64/implies/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:06.596076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.598462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.614075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4510798-72a0-4b92-8c76-9b09d8217f7a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.693101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89943cee-34f5-4ccc-bb1f-236544d7e1fe tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.719154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.720523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.721590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.722060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/76f095ebe2174edc811d6be1f02919a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.738392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=76f095ebe2174edc811d6be1f02919a6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.746011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.747983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.749030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeb3e4-1144-46d7-8709-059b26f2d82b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.749598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.749888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.752369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.756975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.759691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3072/6164] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:06 2022] GET /identity/v3/domains/76f095ebe2174edc811d6be1f02919a6 => generated 279 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:06.761208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.761496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.761770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.787382 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3093/6165] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:06 2022] GET /identity/v3/roles => generated 2324 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:06.790530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.793175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:06.794678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:06.810549 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3073/6166] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:06.811506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.834135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:06.865379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55570cf-ce34-4fdd-8beb-abc408301d45 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.882607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.883281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.883568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.883846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/76f095ebe2174edc811d6be1f02919a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.895446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=76f095ebe2174edc811d6be1f02919a6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.897153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.911076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d54a-364e-4e6b-9938-4aa6228dbad3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:06.917729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:06.917943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:06.918191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:06.918469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:06.920310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:06.925668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:06.944424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:06.944718 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3094/6167] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:33:06 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/8155840ac06a462e906ff442f9fe8f64 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:06.945744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:06.952396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '76f095ebe2174edc811d6be1f02919a6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.015161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.028038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.038056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.055259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project 76f095ebe2174edc811d6be1f02919a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:07.055558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.056340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.065293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906767a-c051-4715-86be-e2c937950cbb tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.068200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.068932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.074105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '76f095ebe2174edc811d6be1f02919a6', 'request_id': 'req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:07.079593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:07.083539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3074/6168] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:06 2022] DELETE /identity/v3/domains/76f095ebe2174edc811d6be1f02919a6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:07.084878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.088007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:07.179412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.180472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.180979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.181485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.182373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.184381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.200955 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3095/6169] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:06 2022] GET /identity/v3/roles => generated 2324 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:07.202246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.204044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:07.243685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff84f3-3842-46ea-8daa-6e7d4d23c50d tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.258001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.258898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.259083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.259421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.260160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:07.260541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.272851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.290080 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3075/6170] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:07.291332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.293768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:07.345217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8592f8d-cf64-401d-8115-cb8299a96191 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.353043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.353773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.354610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.354892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.359924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=eb3f2a1b48d34841850b09ac78a6e9bb, implied_role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.362717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.379092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3096/6171] 10.222.0.78 () {58 vars in 1347 bytes} [Tue Oct 18 16:33:07 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb/implies/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:07.380101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.383783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:07.386557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:07.444663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd4660-8bd7-471a-8263-6272111aca7f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.528647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0b26a-6d38-4828-836d-aca4a0efc003 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.539420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.543731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.544457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.544938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] PATH_INFO: `/v3/projects/9e485dacc4cb4debaa307360f5262c0a/users/e12e63c76594460a9d2995005508993d/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.575758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e485dacc4cb4debaa307360f5262c0a, user_id=e12e63c76594460a9d2995005508993d, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.579192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.600514 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3097/6172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:07 2022] PUT /identity/v3/projects/9e485dacc4cb4debaa307360f5262c0a/users/e12e63c76594460a9d2995005508993d/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:07.601587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.622760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.624479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.624762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.625130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.625912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.628257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.656397 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3076/6173] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:33:07 2022] GET /identity/v3/domains => generated 1611 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:07.658245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:07.666163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:07.740871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d9c7-678f-4e7a-a894-7cb57ef543a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.751628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.753134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.753650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.754644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.754892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:07.760648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5eb40-eed5-4a83-8620-3ddd51e3ed87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:07.793730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc41a04-4a2b-44ab-a3f2-afac38a4049c tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:07.821486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3098/6174] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:07 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:07.821486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.821486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.821486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.886809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] MFA Rules not processed for user `e12e63c76594460a9d2995005508993d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:07.888765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:07.889468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:07.889800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:07.890073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/56a9c24d28774b01ab374041ec9c29af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:07.890200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:07.900622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Could not find domain: 56a9c24d28774b01ab374041ec9c29af.: keystone.exception.DomainNotFound: Could not find domain: 56a9c24d28774b01ab374041ec9c29af. Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 56a9c24d28774b01ab374041ec9c29af. Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:07.912412 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:07.913668 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 56a9c24d28774b01ab374041ec9c29af. Oct 18 16:33:07.914651 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:07.918092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3077/6175] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:07 2022] PATCH /identity/v3/domains/56a9c24d28774b01ab374041ec9c29af => generated 112 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:07.918980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.005704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:08.047839 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3099/6176] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:08.057760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.066020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f720e-16c6-42b6-a6cf-09803c7ceba9 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.193014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff46b7-66f4-422c-bcf6-31244ddf6a27 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.194331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.195126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.195510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.195899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.196518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.196756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.197237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.197519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.197794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/76f095ebe2174edc811d6be1f02919a6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.199360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.227682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find domain: 76f095ebe2174edc811d6be1f02919a6.: keystone.exception.DomainNotFound: Could not find domain: 76f095ebe2174edc811d6be1f02919a6. Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 76f095ebe2174edc811d6be1f02919a6. Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:08.243775 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:08.244977 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 76f095ebe2174edc811d6be1f02919a6. Oct 18 16:33:08.246249 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:08.251480 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3078/6177] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:07 2022] PATCH /identity/v3/domains/76f095ebe2174edc811d6be1f02919a6 => generated 112 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:08.257181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.263477 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3100/6178] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:08 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:08.264283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.269695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:08.368689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:08.435626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f427a0a-3de1-4108-bb8b-34458d91a924 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.446600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.448338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.448886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.453535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.458491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ccf21-361e-4e64-b4ab-5d48fed01e43 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.468793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.470012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.470526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.471017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/users/15e039834f6343f4817ce83216e91964` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.473573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_user(user_id=15e039834f6343f4817ce83216e91964)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.477277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.487121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.488592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.536978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3101/6179] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:08.538163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.570606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badbd67-802e-4aa3-a276-dbc839aa07c3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.588500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.589440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.589968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.590455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.591351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.594536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.638079 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3102/6180] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:08 2022] POST /identity/v3/domains => generated 271 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:08.639389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.691991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:08.693286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:08.711278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:08.712692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:08.731966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e039834f6343f4817ce83216e91964'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:08.753126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:08.786238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3079/6181] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:08 2022] DELETE /identity/v3/users/15e039834f6343f4817ce83216e91964 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:08.788815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.792260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:08.843981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a361e-8e3b-4286-b784-324cbf728027 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.924903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4150a-a7d1-4de7-81b8-fb1f69a53d39 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:08.926675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.927715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.928098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.928711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.929526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.931347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.938527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:08.940224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:08.941183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:08.941483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:08.942171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:08.944464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:08.952409 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3103/6182] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:08 2022] GET /identity/v3/roles => generated 2324 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:08.953902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:08.957377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.003057 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3080/6183] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:08 2022] POST /identity/v3/users => generated 348 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:09.003948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.008168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.041094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1bef5-59c4-465c-a3e4-891be18d76ab tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.051846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.052467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.052738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.053042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.053879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.056800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.087233 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3081/6184] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:09 2022] GET /identity/v3/roles => generated 2324 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:09.089230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.101637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf18e4-1625-43cf-884f-4f5b2c9c4a2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.115252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.116480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6e40-0c36-4cde-9f55-9d3e0ab2abd0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.118311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.118728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.119000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/21c02b4140604999b6d019ae684d349b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.123447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_role(role_id=21c02b4140604999b6d019ae684d349b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.127970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.129711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.130366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.130640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.132337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.133034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.134924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.141121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:09.171411 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3082/6185] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:33:09 2022] POST /identity/v3/groups => generated 324 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:09.174332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.198545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 21c02b4140604999b6d019ae684d349b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:09.199051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.199643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.199881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a904d81-b042-4447-9ce5-315186424bff tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.205674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3104/6186] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:08 2022] DELETE /identity/v3/roles/21c02b4140604999b6d019ae684d349b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:09.206816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.208511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.348711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980fdf4-1f3a-443a-91b4-f2c8e546cb2f tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.353506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.354832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.356146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.356517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] PATH_INFO: `/v3/projects/d5e78e0480c44fe7a842032c95e905d9/users/7898d0d924694088a3c931530455bc75/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.361138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.361920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.363083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.363798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/fb4de6904314449ba9572f35c032c6a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.365749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fb4de6904314449ba9572f35c032c6a4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.371751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.393184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e78e0480c44fe7a842032c95e905d9, user_id=7898d0d924694088a3c931530455bc75, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.396249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.422096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.424551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3083/6187] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:09 2022] PUT /identity/v3/projects/d5e78e0480c44fe7a842032c95e905d9/users/7898d0d924694088a3c931530455bc75/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:09.425116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.425954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.432232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.506600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.508437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ca3263f5-48fc-445c-a71a-6a29eefb5e59 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:09.520067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3105/6188] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:09 2022] PATCH /identity/v3/domains/fb4de6904314449ba9572f35c032c6a4 => generated 272 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:09.525573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.527222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.527512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.560907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:09.633126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] MFA Rules not processed for user `7898d0d924694088a3c931530455bc75`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:09.635092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.665766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8e12-1549-412a-91fe-1f9d5dfea5ef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:09.808859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3106/6189] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:09.808859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:09.813612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:09.826607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:09.827270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:09.827844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:09.832312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/groups/04e24c9c455449098bfb9f4102c4217d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:09.837404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_group(group_id=04e24c9c455449098bfb9f4102c4217d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:09.841362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:09.898601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:09.995310 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3084/6190] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:09 2022] DELETE /identity/v3/groups/04e24c9c455449098bfb9f4102c4217d => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:09.999308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:10.004962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:10.056421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8a12b-df7b-470c-843a-4207150ef907 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:10.274891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911542b8-2d92-4ad1-995c-e10ccdd53020 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:10.304660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:10.305818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:10.306296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:10.306910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:10.308066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:10.311893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:10.314672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:10.315184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:10.318232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/fb4de6904314449ba9572f35c032c6a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:10.323480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:10.349198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fb4de6904314449ba9572f35c032c6a4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:10.351370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:10.390596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3085/6191] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:09 2022] POST /identity/v3/projects => generated 369 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:10.390596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:10.394384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:10.407758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.422350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.559424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:10.706985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3a8b7-8634-452c-93d1-a8d252d999ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:10.771156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:10.820882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e6a5e7208244a9ab85c32036bfa677'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.835995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e6a5e7208244a9ab85c32036bfa677'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.838816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e6a5e7208244a9ab85c32036bfa677'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.867503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e6a5e7208244a9ab85c32036bfa677'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.868283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e6a5e7208244a9ab85c32036bfa677'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:10.899434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:10.900098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:10.900375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:10.901738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/projects/19f2cc74793f4775beb55c8a005e248b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:10.903854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19f2cc74793f4775beb55c8a005e248b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:10.910333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.039446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.049528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f2cc74793f4775beb55c8a005e248b', 'request_id': 'req-62b26080-4ba4-4421-a547-a3c9962c9eb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.053772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.066910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f2cc74793f4775beb55c8a005e248b', 'request_id': 'req-62b26080-4ba4-4421-a547-a3c9962c9eb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.074442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.081664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f2cc74793f4775beb55c8a005e248b', 'request_id': 'req-62b26080-4ba4-4421-a547-a3c9962c9eb2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.104456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project fb4de6904314449ba9572f35c032c6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:11.104862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.107617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.114188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] The token cache is being invalidate because project 19f2cc74793f4775beb55c8a005e248b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:11.114515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.115178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.120435 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3086/6192] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:10 2022] DELETE /identity/v3/projects/19f2cc74793f4775beb55c8a005e248b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:11.121436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.123587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.138671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.140732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.141707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fb4de6904314449ba9572f35c032c6a4', 'request_id': 'req-be7b8424-470e-41fa-b458-581a587316d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.175350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3107/6193] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:09 2022] DELETE /identity/v3/domains/fb4de6904314449ba9572f35c032c6a4 => generated 0 bytes in 1363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:11.176672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.180934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.251048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:11.264009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b26080-4ba4-4421-a547-a3c9962c9eb2 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.283158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.283798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.284072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.284337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.285334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:11.288079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.333620 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3087/6194] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:11 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:11.337777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.344099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.345602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b8424-470e-41fa-b458-581a587316d3 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.449867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:11.514432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.515530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.515994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.516430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.520552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3e65b30fa269455aa5e5e07d0c443ce0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:11.522458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.545350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c39f9-3d29-419a-83f5-e1316b35efcd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.560377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.564173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.565302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.565592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/fb4de6904314449ba9572f35c032c6a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.585700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=fb4de6904314449ba9572f35c032c6a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:11.589339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.593848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.601712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find domain: fb4de6904314449ba9572f35c032c6a4.: keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:11.623100 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:11.624466 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:11.625788 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:11.628564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3088/6195] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:11 2022] GET /identity/v3/domains/fb4de6904314449ba9572f35c032c6a4 => generated 112 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:11.630836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.636853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.681509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542f4cf-36fd-4810-bf6a-64fbf0b47d26 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.682132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.684588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:11.692272 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3108/6196] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:11 2022] PATCH /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0 => generated 278 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:11.693442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.702570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.849275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34cc08-4fc4-400c-9414-148eb763aca4 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.850887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.851515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.851791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.852057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.855925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:11.862228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.865081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.865874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.866872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.867332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/users/a5e6a5e7208244a9ab85c32036bfa677` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.876979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:get_user(user_id=a5e6a5e7208244a9ab85c32036bfa677)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:11.879510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:11.891962 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3089/6197] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:11 2022] GET /identity/v3/roles => generated 2098 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:11.892543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find user: a5e6a5e7208244a9ab85c32036bfa677.: keystone.exception.UserNotFound: Could not find user: a5e6a5e7208244a9ab85c32036bfa677. Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 16:33:11.898777 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:11.899855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a5e6a5e7208244a9ab85c32036bfa677. Oct 18 16:33:11.900920 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:11.902882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.907228 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3109/6198] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Oct 18 16:33:11 2022] GET /identity/v3/users/a5e6a5e7208244a9ab85c32036bfa677 => generated 110 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:11.908976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:11.910842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:11.933557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6cee9-4da3-4c7d-9a9b-771f473d3988 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:11.945120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:11.945943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:11.949698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:11.950902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] PATH_INFO: `/v3/projects/01cce6c4f29a4cbba18801900b710db1/users/cd55f182582b49e5b4947c0666b15c35/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:11.999760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cce6c4f29a4cbba18801900b710db1, user_id=cd55f182582b49e5b4947c0666b15c35, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:12.003525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:12.030404 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3110/6199] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:11 2022] PUT /identity/v3/projects/01cce6c4f29a4cbba18801900b710db1/users/cd55f182582b49e5b4947c0666b15c35/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:12.031373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:12.090355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57b3d-9426-4f08-91a5-704fd7d5846e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:12.145582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:12.214381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67252cb-26c2-4a90-96b0-ff11aeda0a96 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:12.228317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:12.229120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:12.229799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:12.229799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/groups/5b1706d2836141748f668f36c1e2cce1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:12.230509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:12.231389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:12.231864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:12.232345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:12.247172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:get_group(group_id=5b1706d2836141748f668f36c1e2cce1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:12.249252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:12.263186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3e65b30fa269455aa5e5e07d0c443ce0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:12.265494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find group: 5b1706d2836141748f668f36c1e2cce1.: keystone.exception.GroupNotFound: Could not find group: 5b1706d2836141748f668f36c1e2cce1. Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 18 16:33:12.279470 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:12.280538 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 5b1706d2836141748f668f36c1e2cce1. Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:12.281979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3111/6200] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:12 2022] GET /identity/v3/groups/5b1706d2836141748f668f36c1e2cce1 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:12.285641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:12.296477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:12.331962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.343040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.451494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.464205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.479681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.489897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8056a-3f06-4465-8892-adb9e4e5f5fb tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:12.509838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] The token cache is being invalidate because project 3e65b30fa269455aa5e5e07d0c443ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:12.510681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.511626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.552290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.553032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.561801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3e65b30fa269455aa5e5e07d0c443ce0', 'request_id': 'req-fc120043-c197-4f8b-af38-a7f8cbd6798b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:12.576252 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3090/6201] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:11 2022] DELETE /identity/v3/domains/3e65b30fa269455aa5e5e07d0c443ce0 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:12.577322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:12.581113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:12.686226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:12.697916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:12.698347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:12.698484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:12.699170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:12.706851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:12.737291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3112/6202] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:12 2022] GET /identity/v3/roles => generated 2098 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:12.738397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:12.740374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:12.787172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc120043-c197-4f8b-af38-a7f8cbd6798b tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:12.805620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:12.809618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:12.809934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:12.810218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/groups/5b1706d2836141748f668f36c1e2cce1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:12.823423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:12.849240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find group: 5b1706d2836141748f668f36c1e2cce1.: keystone.exception.GroupNotFound: Could not find group: 5b1706d2836141748f668f36c1e2cce1. Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 18 16:33:12.869065 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:12.870676 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 5b1706d2836141748f668f36c1e2cce1. Oct 18 16:33:12.871994 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:12.875589 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3091/6203] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:12 2022] DELETE /identity/v3/groups/5b1706d2836141748f668f36c1e2cce1 => generated 111 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:12.881854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:12.890955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:12.927781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716deeb-2d9b-43b1-baee-1dcca2285c8b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:12.947044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:12.952348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:12.952635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:12.952903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] PATH_INFO: `/v3/projects/01cce6c4f29a4cbba18801900b710db1/users/cd55f182582b49e5b4947c0666b15c35/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:12.957781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cce6c4f29a4cbba18801900b710db1, user_id=cd55f182582b49e5b4947c0666b15c35, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:12.962933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:13.020758 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3092/6204] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:12 2022] PUT /identity/v3/projects/01cce6c4f29a4cbba18801900b710db1/users/cd55f182582b49e5b4947c0666b15c35/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:13.021469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:13.022972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f901ba-eca7-4205-a79b-38a7e61d9d3f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.290630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:13.330823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.331824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.332119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.332449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/8155840ac06a462e906ff442f9fe8f64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.349804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8155840ac06a462e906ff442f9fe8f64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:13.352788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:13.354645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb6f6a-2b3b-4a13-aaa6-024b37fbaafe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.369586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.371081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.371081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.371081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/users/a5e6a5e7208244a9ab85c32036bfa677` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.398037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5e6a5e7208244a9ab85c32036bfa677)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:13.406150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-f35b7fee-3480-47df-b41f-11825a1ba733 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find user: a5e6a5e7208244a9ab85c32036bfa677.: keystone.exception.UserNotFound: Could not find user: a5e6a5e7208244a9ab85c32036bfa677. Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 18 16:33:13.495461 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:13.496646 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a5e6a5e7208244a9ab85c32036bfa677. Oct 18 16:33:13.497981 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:13.504383 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3093/6205] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:13 2022] DELETE /identity/v3/users/a5e6a5e7208244a9ab85c32036bfa677 => generated 110 bytes in 480 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:13.504383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.506758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.507073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.507700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 8155840ac06a462e906ff442f9fe8f64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:13.508203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:13.510512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:13.518193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3113/6206] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:12 2022] DELETE /identity/v3/roles/8155840ac06a462e906ff442f9fe8f64 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:13.519234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:13.523187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:13.609358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] MFA Rules not processed for user `cd55f182582b49e5b4947c0666b15c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:13.614063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:13.662678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c975d-0191-4ec9-b799-73ac1c713554 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.678827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.679561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.679842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.680110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/fb4de6904314449ba9572f35c032c6a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.701651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find domain: fb4de6904314449ba9572f35c032c6a4.: keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:13.726197 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:13.727270 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:13.728238 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:13.729903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3114/6207] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:13 2022] PATCH /identity/v3/domains/fb4de6904314449ba9572f35c032c6a4 => generated 112 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:13.729903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:13.732640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:13.790031 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3094/6208] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:13.791694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:13.810973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad985b0-0c01-4df4-b3f7-425cc33eeca7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.819273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.823320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.824146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.824538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.825347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:13.829524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:13.865109 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3095/6209] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Oct 18 16:33:13 2022] GET /identity/v3/domains => generated 1345 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:13.866320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:13.893070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb430d-b3f2-4fb6-98cc-2dd45b17ab97 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.900676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.901913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.905538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.905931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.906758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:13.920951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:13.926277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98575-95eb-49af-816c-6c7574c96139 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:13.967928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:13.967928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:13.968385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:13.968385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/6263f1ac79214b84becc823ccf9a2fa1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:13.976423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6263f1ac79214b84becc823ccf9a2fa1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:13.979376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:14.061601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3096/6210] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:33:13 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:14.062962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.073263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role 6263f1ac79214b84becc823ccf9a2fa1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:14.073565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:14.074291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:14.082233 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3115/6211] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:13 2022] DELETE /identity/v3/roles/6263f1ac79214b84becc823ccf9a2fa1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:14.083018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.091748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:14.157049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788896b-4496-4473-8a97-75d33f2b86e9 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:14.179308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:14.275261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557320c0-cdd3-400a-9fa7-3aa53b223132 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:14.286097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:14.311667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:14.312862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:14.313278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:14.313656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/086643bcf27345e4b1344c7b800754f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:14.315181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=086643bcf27345e4b1344c7b800754f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:14.317061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:14.353730 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3116/6212] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:14 2022] DELETE /identity/v3/services/086643bcf27345e4b1344c7b800754f0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:14.353730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.356065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:14.440516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:14.441046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:14.441406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:14.441700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:14.442608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:14.447147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:14.449122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:14.497808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3097/6213] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:14 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:14.498701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.566745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4199564-83d0-45bf-8924-a3e67454c2e0 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:14.571783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d4aff69b24f4919aba047902b698f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a530bc1b58443c6a76ac31d341b12d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:14.572888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:14.590354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:14.590847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] PATH_INFO: `/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:14.592641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb3f2a1b48d34841850b09ac78a6e9bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:14.596096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ee242-4849-4672-bf08-dfa7aa882040 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:14.597665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:14.625497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:14.640456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:14.640702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:14.640971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:14.644343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:14.662420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:14.698407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invalidating the token cache because role eb3f2a1b48d34841850b09ac78a6e9bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:14.699045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:14.700433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:14.707393 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3117/6214] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:14 2022] DELETE /identity/v3/roles/eb3f2a1b48d34841850b09ac78a6e9bb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:14.708454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.710170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:14.730169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3098/6215] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:14 2022] POST /identity/v3/services => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:14.731249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:14.740307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:14.883691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:14.917579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6bf26-5745-4f79-8ee7-4b807ce603b1 tempest-RolesV3TestJSON-17502687 tempest-RolesV3TestJSON-17502687-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:14.973928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:14.974925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:14.975784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:14.976313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:14.978633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-172490870) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:14.980046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:14.984915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:15.033999 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3118/6216] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Oct 18 16:33:14 2022] GET /identity/v3/domains?name=tempest-test_domain-172490870 => generated 406 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:15.037233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:15.042942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:15.092295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34be230-44cc-4020-9ce4-3025334a3778 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:15.239561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:15.241447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.241703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.242476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] PATH_INFO: `/v3/users/9965671245ca45988258c031eb628d29` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.246025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9965671245ca45988258c031eb628d29)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:15.251935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:15.336340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00aa2c-d6b4-4f4b-84a6-4158772fa4b6 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:15.347848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:15.350371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.351190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.351773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/59e6a75103334cd78147c79f80de14a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.353120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:update_service(service_id=59e6a75103334cd78147c79f80de14a4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:15.355272 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:15.355272 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:33:15.355272 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:33:15.358473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:15.364817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:15.405779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9965671245ca45988258c031eb628d29'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:15.408802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9965671245ca45988258c031eb628d29'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:15.421124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3119/6217] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Oct 18 16:33:15 2022] PATCH /identity/v3/services/59e6a75103334cd78147c79f80de14a4 => generated 284 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:15.422283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:15.448357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9965671245ca45988258c031eb628d29'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:15.448357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9965671245ca45988258c031eb628d29'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:15.460837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9965671245ca45988258c031eb628d29'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:15.515402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479c848-2ce3-4e87-98ba-ebf080be1a5e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:15.520469 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3099/6218] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:14 2022] DELETE /identity/v3/users/9965671245ca45988258c031eb628d29 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:15.521373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:15.524507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:15.532229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:15.533023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.533389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.533761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/fb4de6904314449ba9572f35c032c6a4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.557112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f0c86e96-e1f2-427f-87e0-0497dd2ce87b tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Could not find domain: fb4de6904314449ba9572f35c032c6a4.: keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:15.568089 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:15.569993 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fb4de6904314449ba9572f35c032c6a4. Oct 18 16:33:15.571217 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:15.583790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3120/6219] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:15 2022] PATCH /identity/v3/domains/fb4de6904314449ba9572f35c032c6a4 => generated 112 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:15.585319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.585666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.586040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.667051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] MFA Rules not processed for user `8413a8725d6d4561ae3a851486c29a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:15.697591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:15.728830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5d39-c934-44eb-9690-636f888ef0e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:15.810632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:15.811857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.815605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.816045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/59e6a75103334cd78147c79f80de14a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.816879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:get_service(service_id=59e6a75103334cd78147c79f80de14a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:15.817987 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:15.817987 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:33:15.817987 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:33:15.819051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73da10-5a30-4dad-8fcb-476323e04e31 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:15.861618 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3100/6220] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:15 2022] GET /identity/v3/services/59e6a75103334cd78147c79f80de14a4 => generated 284 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:15.864002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:15.864494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:15.864969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:15.932912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:15.939730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:16.051088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3121/6221] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3457 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:16.052778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.071071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:16.114440 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3101/6222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:16.114440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.132771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f57903-ffa9-4109-8f7e-344267ef9985 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.143507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.144620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.144980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.145879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/59e6a75103334cd78147c79f80de14a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.147649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=59e6a75103334cd78147c79f80de14a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.150423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.190226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3102/6223] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:16 2022] DELETE /identity/v3/services/59e6a75103334cd78147c79f80de14a4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:16.191763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.193537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:16.209187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:16.249421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:16.351808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f455b84-74a1-48bf-ad12-579f8b267a9c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.377103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e641c-3463-4f0d-831d-39648fbf50a7 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.385522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.386572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.386859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.387132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.389358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:16.412614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.413445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.413944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.414426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/84c1e392a9814595b495e8416b3503ce` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.448383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=84c1e392a9814595b495e8416b3503ce)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.450316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.506191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.507780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.518286 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3122/6224] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:16 2022] PATCH /identity/v3/domains/84c1e392a9814595b495e8416b3503ce => generated 277 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:16.519416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.521586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:16.575383 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3103/6225] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:16.576461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.623610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e7972-4f2a-402b-ad82-3f72fba81c25 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.684976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603b723-2567-4af8-8103-7009df8c7d70 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.685455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.689653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.689956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.694049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/59e6a75103334cd78147c79f80de14a4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.696437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:get_service(service_id=59e6a75103334cd78147c79f80de14a4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.698958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.700480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.702020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.702821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.707835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.742871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.744458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Could not find service: 59e6a75103334cd78147c79f80de14a4.: keystone.exception.ServiceNotFound: Could not find service: 59e6a75103334cd78147c79f80de14a4. Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 59e6a75103334cd78147c79f80de14a4. Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:16.748876 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:16.750094 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 59e6a75103334cd78147c79f80de14a4. Oct 18 16:33:16.751250 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:16.759024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3104/6226] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:16 2022] GET /identity/v3/services/59e6a75103334cd78147c79f80de14a4 => generated 113 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:16.760053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.780611 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3123/6227] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:16.781764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.793319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0d1d7-6d86-4416-8ce4-3748f11d4c69 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.807106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.807917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189a9cb-b9d6-430a-b609-1e707c5d2ea6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.808613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.808955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.809726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/84c1e392a9814595b495e8416b3503ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.815836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.816889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.817546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.818021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.818821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.821314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.837916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=84c1e392a9814595b495e8416b3503ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.841078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.859165 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3124/6228] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:16 2022] POST /identity/v3/services => generated 274 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:16.865668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.920326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b251cf5-f317-4e48-921a-95588269d236 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:16.953084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:16.953837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:16.954145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:16.954584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:16.955932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:16.957616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:16.981181 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3125/6229] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:16 2022] POST /identity/v3/services => generated 274 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:16.986630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:16.998161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '84c1e392a9814595b495e8416b3503ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.016045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '84c1e392a9814595b495e8416b3503ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.016659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d350a-d301-401c-b46a-adedda230ca2 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.022557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.023186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.023463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.023730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.024502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.027168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.050462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3126/6230] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:16 2022] POST /identity/v3/services => generated 275 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:33:17.055935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.093564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:17.117223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a97ce4-c626-4a48-951a-ec2dfb053450 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.127283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.130126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.131206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.131673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.133644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.135507 n-d-858383-14 devstack@keystone.service[81776]: WARNING py.warnings [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:17.135507 n-d-858383-14 devstack@keystone.service[81776]: warnings.warn(msg) Oct 18 16:33:17.135507 n-d-858383-14 devstack@keystone.service[81776]: Oct 18 16:33:17.137645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.169224 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3127/6231] 10.222.0.78 () {58 vars in 1131 bytes} [Tue Oct 18 16:33:17 2022] GET /identity/v3/services => generated 2978 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:17.175822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.209818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f376e3b-cac4-4a66-906a-e6fc0ce98855 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.234429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.248401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:17.262888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.280842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.319877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project 84c1e392a9814595b495e8416b3503ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:17.320474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.323663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.364320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.377520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.391133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '84c1e392a9814595b495e8416b3503ce', 'request_id': 'req-45465ec8-8e23-4912-8ee9-d80501277f8a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.423196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3105/6232] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:16 2022] DELETE /identity/v3/domains/84c1e392a9814595b495e8416b3503ce => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:17.430964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.437639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:17.502438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.505296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.509241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.509947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.511323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-902413139) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:17.513128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.530232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.562464 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3128/6233] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Oct 18 16:33:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-902413139 => generated 416 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:33:17.564386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.580242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:17.639037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3d392-4579-4caa-99b3-60c480fb0e49 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.667530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.668826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.669478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.670119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.677342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-952472150) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:17.678636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.681468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.712892 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3129/6234] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Oct 18 16:33:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-952472150 => generated 416 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:17.714756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.757590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e4dc-05b9-4715-806f-f53ea88aa32e tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.786131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45465ec8-8e23-4912-8ee9-d80501277f8a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.790454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.792129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.792530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.792917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.794055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1206954500) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:17.794478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.796878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.808242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3130/6235] 10.222.0.78 () {58 vars in 1222 bytes} [Tue Oct 18 16:33:17 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1206954500 => generated 418 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:17.809629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.828275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ac6b-e3f7-4147-9b57-8421f5f3a2ac tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.829245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.830150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.830655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.831086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/941ca179370848a98c5863be93cbf11a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.839006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.839834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.840230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.840760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/bedf2577ea1041d18d5c01241761b3ba` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.841551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bedf2577ea1041d18d5c01241761b3ba)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.843476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.874976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=941ca179370848a98c5863be93cbf11a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.876656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:17.887935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3131/6236] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:17 2022] DELETE /identity/v3/services/bedf2577ea1041d18d5c01241761b3ba => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:17.889744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:17.962021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a458-b4c3-4eaf-bb15-784106732f36 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:17.969930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.973329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:17.982808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:17.990127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:17.990473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:17.990750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/8f859a01e0ec48f68108940b0b93174b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:17.991573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8f859a01e0ec48f68108940b0b93174b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:17.993824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:18.044842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.050695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.060753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3106/6237] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:17 2022] PATCH /identity/v3/domains/941ca179370848a98c5863be93cbf11a => generated 276 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:18.063104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:18.065088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:18.074886 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3132/6238] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:17 2022] DELETE /identity/v3/services/8f859a01e0ec48f68108940b0b93174b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:18.077107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:18.082012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:18.139905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d8db-a06b-45af-8280-f53b817239cf tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:18.240548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e0fc3-cd6a-41ca-bc8b-2b875f80f132 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:18.272075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=91,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:18.279894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:18.280660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:18.281182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:18.281529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/941ca179370848a98c5863be93cbf11a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:18.319905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=941ca179370848a98c5863be93cbf11a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:18.321507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd55f182582b49e5b4947c0666b15c35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01cce6c4f29a4cbba18801900b710db1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:18.321782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:18.322502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:18.322901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:18.323397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] PATH_INFO: `/v3/services/dc233d501deb41ba81e39c4f0b7a0a28` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:18.324074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dc233d501deb41ba81e39c4f0b7a0a28)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:18.325942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:18.339867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:18.387123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3133/6239] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:18 2022] DELETE /identity/v3/services/dc233d501deb41ba81e39c4f0b7a0a28 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:18.390560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:18.394176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:18.413151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.421054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '941ca179370848a98c5863be93cbf11a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.580843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432b56-5537-4473-8a94-38c4570bc254 tempest-ServicesTestJSON-1058066150 tempest-ServicesTestJSON-1058066150-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:18.596731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.611997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.633543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.658586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project 941ca179370848a98c5863be93cbf11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:18.658879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.663822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.681395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.682970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.702257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '941ca179370848a98c5863be93cbf11a', 'request_id': 'req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.722851 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3107/6240] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:18 2022] DELETE /identity/v3/domains/941ca179370848a98c5863be93cbf11a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:18.725542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:18.729466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:18.836648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:18.836648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:18.836648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:18.836648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] PATH_INFO: `/v3/users/7898d0d924694088a3c931530455bc75` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:18.837887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7898d0d924694088a3c931530455bc75)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:18.837887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:18.977542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7898d0d924694088a3c931530455bc75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:18.978248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be5e47-3bb5-43df-ab49-cd7d67c1b9f1 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:19.007611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7898d0d924694088a3c931530455bc75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.008678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7898d0d924694088a3c931530455bc75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.030255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7898d0d924694088a3c931530455bc75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.031269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-581eef99-c5fa-47a0-94db-10d8067206a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7898d0d924694088a3c931530455bc75'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.042647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:19.044510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:19.045505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:19.047585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/b8b6633f184e45f499bf4623031c2d1a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:19.089419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b8b6633f184e45f499bf4623031c2d1a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:19.099494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:19.100098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3134/6241] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:18 2022] DELETE /identity/v3/users/7898d0d924694088a3c931530455bc75 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:19.104694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:19.105269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:19.107306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:19.135328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.136314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.141354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:19.145553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:19.170853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:19.172954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:19.197418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.199060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.205334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3108/6242] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:18 2022] PATCH /identity/v3/domains/b8b6633f184e45f499bf4623031c2d1a => generated 276 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:19.207879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:19.210899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:19.347569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3135/6243] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:19.366096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:19.367940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:19.459177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e14fa-acdb-45e8-b124-95179ed31091 tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:19.489752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b70befd21e674da5bd9e3a0157c3eb11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e76cf2caa85486f87584a6ab4fe8a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:19.490517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:19.490806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:19.491089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] PATH_INFO: `/v3/domains/b8b6633f184e45f499bf4623031c2d1a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:19.534281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540754-4018-435e-a31f-0f4a9ab2817c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:19.547494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b8b6633f184e45f499bf4623031c2d1a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:19.552495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:19.553625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:19.556901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:19.557254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:19.557734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:19.589646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:19.590577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:19.629577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.633423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3136/6244] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:33:19.634403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:19.639789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.641254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:19.679797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86001c-4909-457b-9ffa-8f0d673d71af service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:19.702680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:19.703523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:19.703902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:19.704313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] PATH_INFO: `/v3/projects/9cd424c869de4ad5ade60a2b96fd85a0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:19.706667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd424c869de4ad5ade60a2b96fd85a0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:19.710768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:19.802741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.823666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.848194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.880817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd424c869de4ad5ade60a2b96fd85a0', 'request_id': 'req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.895709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd424c869de4ad5ade60a2b96fd85a0', 'request_id': 'req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.898109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] The token cache is being invalidate because project b8b6633f184e45f499bf4623031c2d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:19.898455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.900856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.932456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd424c869de4ad5ade60a2b96fd85a0', 'request_id': 'req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.936459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.947407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.960927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b8b6633f184e45f499bf4623031c2d1a', 'request_id': 'req-27796c27-5c90-46ea-bb88-addf321c4e6a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.983022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] The token cache is being invalidate because project 9cd424c869de4ad5ade60a2b96fd85a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:19.984467 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3109/6245] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:19 2022] DELETE /identity/v3/domains/b8b6633f184e45f499bf4623031c2d1a => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:19.984885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.987066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:19.988136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:19.990994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:19.993071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3137/6246] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:19 2022] DELETE /identity/v3/projects/9cd424c869de4ad5ade60a2b96fd85a0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:19.998313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:20.006123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:20.052480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:20.126807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:20.203310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796c27-5c90-46ea-bb88-addf321c4e6a tempest-DomainsTestJSON-1123619173 tempest-DomainsTestJSON-1123619173-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:20.247485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ec0d8-3aa7-41c5-a21f-2925766dd67f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:20.258224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:20.260173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:20.260596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:20.261173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] PATH_INFO: `/v3/users/3d4aff69b24f4919aba047902b698f94` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:20.264720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4aff69b24f4919aba047902b698f94)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:20.270151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:20.401695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:20.408190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:20.411491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:20.411491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] PATH_INFO: `/v3/users/2d725b415a17400eaaf102e10809ad54` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:20.431142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d725b415a17400eaaf102e10809ad54)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:20.435646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:20.459525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4aff69b24f4919aba047902b698f94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.483272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4aff69b24f4919aba047902b698f94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.483272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4aff69b24f4919aba047902b698f94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.531365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4aff69b24f4919aba047902b698f94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.532751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9c9e372b-7f90-437a-8b4c-44ae52369f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4aff69b24f4919aba047902b698f94'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.578331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d725b415a17400eaaf102e10809ad54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.579721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d725b415a17400eaaf102e10809ad54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.600240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d725b415a17400eaaf102e10809ad54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.601649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d725b415a17400eaaf102e10809ad54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.604391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3138/6247] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:19 2022] DELETE /identity/v3/users/3d4aff69b24f4919aba047902b698f94 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:33:20.620607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d725b415a17400eaaf102e10809ad54'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:20.705162 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3110/6248] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:19 2022] DELETE /identity/v3/users/2d725b415a17400eaaf102e10809ad54 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:20.715688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:20.715994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:20.716164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:20.764402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:20.766154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:20.796416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:20.798426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:20.925149 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3139/6249] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:20.940421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:20.945378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:20.971672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:21.043611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e581-5437-41d0-a4ab-c0d80a7cff80 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:21.070855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:21.083948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:21.084542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:21.088002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] PATH_INFO: `/v3/projects/d5e78e0480c44fe7a842032c95e905d9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:21.092167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e78e0480c44fe7a842032c95e905d9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:21.112092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:21.119040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:21.177192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208f4d-c6f0-4e43-91a4-23d55c80761e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:21.187564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:21.188781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:21.191456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:21.191821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:21.225301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:21.226928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:21.240879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3140/6250] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:21.347754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e78e0480c44fe7a842032c95e905d9', 'request_id': 'req-4980f2b0-de9f-4144-a561-537aa4a0f63e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.380087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e78e0480c44fe7a842032c95e905d9', 'request_id': 'req-4980f2b0-de9f-4144-a561-537aa4a0f63e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.398552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e78e0480c44fe7a842032c95e905d9', 'request_id': 'req-4980f2b0-de9f-4144-a561-537aa4a0f63e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.456050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] The token cache is being invalidate because project d5e78e0480c44fe7a842032c95e905d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:21.460500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.463687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.466970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3111/6251] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:20 2022] DELETE /identity/v3/projects/d5e78e0480c44fe7a842032c95e905d9 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:21.472540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:21.494882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0b872-3046-46fb-81bc-5e823f9768bc service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:21.636522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:21.637240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:21.637512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:21.637781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] PATH_INFO: `/v3/users/cd55f182582b49e5b4947c0666b15c35` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:21.638958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd55f182582b49e5b4947c0666b15c35)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:21.641752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:21.744409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd55f182582b49e5b4947c0666b15c35'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.758975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd55f182582b49e5b4947c0666b15c35'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.759880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd55f182582b49e5b4947c0666b15c35'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.790010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd55f182582b49e5b4947c0666b15c35'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.793042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd55f182582b49e5b4947c0666b15c35'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:21.843415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3141/6252] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:21 2022] DELETE /identity/v3/users/cd55f182582b49e5b4947c0666b15c35 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:22.127321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:22.128913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.152279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f2b0-de9f-4144-a561-537aa4a0f63e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:22.178003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:22.181617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.288578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb8d2f-6c9f-46a2-b701-650d18366a99 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:22.294446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:22.295642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:22.296160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:22.296735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] PATH_INFO: `/v3/users/e854934ad7a14e75a2845ccf391d4252` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:22.299068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e854934ad7a14e75a2845ccf391d4252)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:22.302009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:22.305326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:22.305974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:22.306251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:22.306523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] PATH_INFO: `/v3/projects/7a530bc1b58443c6a76ac31d341b12d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:22.307797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a530bc1b58443c6a76ac31d341b12d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:22.309747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:22.311723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:22.393045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e854934ad7a14e75a2845ccf391d4252'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.406538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e854934ad7a14e75a2845ccf391d4252'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.409917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e854934ad7a14e75a2845ccf391d4252'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.429255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e854934ad7a14e75a2845ccf391d4252'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.432012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e854934ad7a14e75a2845ccf391d4252'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.447806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a530bc1b58443c6a76ac31d341b12d1', 'request_id': 'req-df10a662-b923-4cd8-afb3-ed7e50eb5325'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.461670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a530bc1b58443c6a76ac31d341b12d1', 'request_id': 'req-df10a662-b923-4cd8-afb3-ed7e50eb5325'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.492159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a530bc1b58443c6a76ac31d341b12d1', 'request_id': 'req-df10a662-b923-4cd8-afb3-ed7e50eb5325'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.529766 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3142/6253] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:22 2022] DELETE /identity/v3/users/e854934ad7a14e75a2845ccf391d4252 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:33:22.530042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] The token cache is being invalidate because project 7a530bc1b58443c6a76ac31d341b12d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:22.530244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:22.530407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.530407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-df10a662-b923-4cd8-afb3-ed7e50eb5325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.530698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.533883 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3112/6254] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:22 2022] DELETE /identity/v3/projects/7a530bc1b58443c6a76ac31d341b12d1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:22.542150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf61e-37eb-49dd-bd35-beb5fcf5ffed None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:22.543232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf61e-37eb-49dd-bd35-beb5fcf5ffed None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:22.548904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf61e-37eb-49dd-bd35-beb5fcf5ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:22.592704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:22.611133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-83ddf61e-37eb-49dd-bd35-beb5fcf5ffed None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:22.615055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-83ddf61e-37eb-49dd-bd35-beb5fcf5ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.674783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc1bcc-3cd2-4c84-920b-c706fa68fb9a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:22.681750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:22.682452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:22.682724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:22.683141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] PATH_INFO: `/v3/projects/085b9a8ddacd498598765a38d156b106` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:22.684330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085b9a8ddacd498598765a38d156b106)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:22.687492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:22.775137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085b9a8ddacd498598765a38d156b106', 'request_id': 'req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.784259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085b9a8ddacd498598765a38d156b106', 'request_id': 'req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.789208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3113/6255] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:22.792200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:22.792345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085b9a8ddacd498598765a38d156b106', 'request_id': 'req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.792812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:22.794126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:22.829974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] The token cache is being invalidate because project 085b9a8ddacd498598765a38d156b106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:22.830512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.831649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:22.835609 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3143/6256] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:22 2022] DELETE /identity/v3/projects/085b9a8ddacd498598765a38d156b106 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:22.839565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:22.842825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.848400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:22.850640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:22.886864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:23.004470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b2df1-6753-44b1-8f39-0c4e1a7013b1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:23.011762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:23.012670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:23.013216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:23.013561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] PATH_INFO: `/v3/users/b70befd21e674da5bd9e3a0157c3eb11` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:23.015044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70befd21e674da5bd9e3a0157c3eb11)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:23.017975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:23.019747 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3114/6257] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:23.022534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:23.024888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:23.088751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70befd21e674da5bd9e3a0157c3eb11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.101410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70befd21e674da5bd9e3a0157c3eb11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.102185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70befd21e674da5bd9e3a0157c3eb11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.116809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70befd21e674da5bd9e3a0157c3eb11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.117720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2bf0f93f-2abb-4578-9f67-8722fa760998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70befd21e674da5bd9e3a0157c3eb11'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.159553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3144/6258] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:22 2022] DELETE /identity/v3/users/b70befd21e674da5bd9e3a0157c3eb11 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:23.159553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:23.171390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:23.171914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:23.196620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f9ba-07e6-4005-a81f-9c40bd9d8a2c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:23.246065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:23.248267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:23.319852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:23.321600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:23.322636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:23.322921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:23.327015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:23.426270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:23.482663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3145/6259] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:23.485276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:23.490491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:23.541952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c262171-9845-4f78-8ebc-a36d2d27be50 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:23.567287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:23.568561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:23.569061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:23.569504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] PATH_INFO: `/v3/projects/01cce6c4f29a4cbba18801900b710db1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:23.571869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cce6c4f29a4cbba18801900b710db1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:23.582411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:23.655631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:23.666195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:23.732216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:23.733693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3115/6260] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:23.737421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:23.799365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505f97d-b29e-4db7-8242-c5034ecea1f3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:23.806410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cce6c4f29a4cbba18801900b710db1', 'request_id': 'req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.833843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cce6c4f29a4cbba18801900b710db1', 'request_id': 'req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.870415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cce6c4f29a4cbba18801900b710db1', 'request_id': 'req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.899343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] The token cache is being invalidate because project 01cce6c4f29a4cbba18801900b710db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:23.900491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.901644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e80ff5d4-0b38-481c-8f83-c91bdf7cddbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:23.917220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3146/6261] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:23 2022] DELETE /identity/v3/projects/01cce6c4f29a4cbba18801900b710db1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:23.920536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:23.921264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:23.921755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.039059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:24.041724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:24.102906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:24.104149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.104608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.105944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.107081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:24.107583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:24.121944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:24.182732 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3116/6262] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:24.184677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:24.193994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:24.262416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c763822-fd3b-493c-9d32-aeccd1827bdd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:24.285152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:24.287211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.287834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.294615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.296907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:24.307267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:24.398819 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3117/6263] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:24 2022] POST /identity/v3/projects => generated 369 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:24.404004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:24.560683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694b25e-c083-4a8e-9c49-63d38ae991aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:24.580132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:24.580845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.581146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.581420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.582060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:24.584001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:24.633113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3118/6264] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:24 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:33:24.633113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:24.637867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:24.640325 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3147/6265] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 722 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:24.656976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:24.704040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459cf52-46b8-4104-86fe-9decda4f16e3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:24.724539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:24.725957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.726256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.726513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] PATH_INFO: `/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.729559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e76cf2caa85486f87584a6ab4fe8a8b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:24.730766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5befafd-7193-4aa4-9ae5-31bf60a244b8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:24.731511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:24.761492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:24.767403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:24.771290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.771937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.772414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.777420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:24.786765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa754-64cd-4797-9364-e4eb2f2a24e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:24.844481 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3148/6266] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:24.849759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:24.850145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:24.850527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:24.894844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e76cf2caa85486f87584a6ab4fe8a8b', 'request_id': 'req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:24.903118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:24.904528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:24.919472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e76cf2caa85486f87584a6ab4fe8a8b', 'request_id': 'req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:24.967085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e76cf2caa85486f87584a6ab4fe8a8b', 'request_id': 'req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.010962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] The token cache is being invalidate because project 5e76cf2caa85486f87584a6ab4fe8a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:25.011257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.014025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.021220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3119/6267] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:24 2022] DELETE /identity/v3/projects/5e76cf2caa85486f87584a6ab4fe8a8b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:25.021220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.022536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.075040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3149/6268] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:25.076402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.081870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.123367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1083d-5cee-43bf-a22c-a58746d89e0b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.137073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.139883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.143771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.144856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] PATH_INFO: `/v3/projects/20397a84caf44c0ea12819dd94b0cfdc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.147895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20397a84caf44c0ea12819dd94b0cfdc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.153285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.189600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab167-7e4b-4836-8c4d-3a7cb1b416c4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.198093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.198793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.200179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.200179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.201096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.202834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271920da-dc42-464f-8a42-81fef6cb58e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.220140 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3120/6269] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:25.221611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.224975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.225199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.262201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:25.266014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:25.268849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.279667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20397a84caf44c0ea12819dd94b0cfdc', 'request_id': 'req-fc103805-d509-472a-a494-e3855fc0d0c6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.294503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20397a84caf44c0ea12819dd94b0cfdc', 'request_id': 'req-fc103805-d509-472a-a494-e3855fc0d0c6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.315715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20397a84caf44c0ea12819dd94b0cfdc', 'request_id': 'req-fc103805-d509-472a-a494-e3855fc0d0c6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.343834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] The token cache is being invalidate because project 20397a84caf44c0ea12819dd94b0cfdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:25.344130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.346321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.352441 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3150/6270] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:25 2022] DELETE /identity/v3/projects/20397a84caf44c0ea12819dd94b0cfdc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:25.352441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.357471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.421331 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3121/6271] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:25.422427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.429707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.463558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ced8-43c5-4a64-a21d-c61713001448 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.475493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.476363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.476777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.480336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] PATH_INFO: `/v3/projects/156d657258ca406cbb8088fcf69951f5/users/e41015ec5a9243eab336e9ebce77f017/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.490699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc103805-d509-472a-a494-e3855fc0d0c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.533454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.535193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.535661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.537053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.538242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:25.539559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.545401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.558810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] RBAC: Authorizing `identity:create_grant(project_id=156d657258ca406cbb8088fcf69951f5, user_id=e41015ec5a9243eab336e9ebce77f017, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.564191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d33d-67ce-494e-bc4d-fc0dc0b3eead admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.570305 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3151/6272] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:25.571330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.573227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.593170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e429-43bb-43b8-8ab6-2833ccda484a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.605052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3122/6273] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:25 2022] PUT /identity/v3/projects/156d657258ca406cbb8088fcf69951f5/users/e41015ec5a9243eab336e9ebce77f017/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:25.605052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.605052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.605052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.648030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:25.650157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.664176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:25.737009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.737902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.738345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.738789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] PATH_INFO: `/v3/users/1c6d7a624a09431180f2b8404e2ba056` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.740825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6d7a624a09431180f2b8404e2ba056)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.744385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.755510 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3123/6274] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:25.755510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:25.775082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5ca96-810d-424c-b8bd-4ffd83e177bb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:25.788826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:25.790417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.791544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.791885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.795030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:25.796381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e9f2-21ad-4b8a-8477-c59d27146e37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:25.871164 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3124/6275] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:25 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:25.885571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:25.886236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:25.888496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:25.929590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] MFA Rules not processed for user `e41015ec5a9243eab336e9ebce77f017`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:25.931205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:25.973837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6d7a624a09431180f2b8404e2ba056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.993430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6d7a624a09431180f2b8404e2ba056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:25.993430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6d7a624a09431180f2b8404e2ba056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:26.003826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6d7a624a09431180f2b8404e2ba056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:26.004826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6d7a624a09431180f2b8404e2ba056'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:26.007277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.049968 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3152/6276] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:25 2022] DELETE /identity/v3/users/1c6d7a624a09431180f2b8404e2ba056 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:26.050866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.054024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:26.100313 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3125/6277] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:26.102993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.107045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:26.239583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94adc9e-1a24-4a4a-8a54-fd91a485a548 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.251408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.252155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.252439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.252718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.253939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:26.254806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.256449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.274950 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3153/6278] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:26.275821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.278549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:26.280396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7008a-57be-4153-8133-71c5bc7d20f6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.294981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9fb21-4a9a-4b5a-a41b-123fddddc9f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.296765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.297499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.297770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.298775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.302279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.304441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.312502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.314847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.315987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.316573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.317617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.321653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.366101 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3126/6279] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:26 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:26.368356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.381200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645229c-1834-43ff-940e-0a7727b7b65b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.389343 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3154/6280] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:26.390429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.394142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.395046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.395408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.395695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.397848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.405589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.419535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.456984 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3127/6281] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:26.461200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.565564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275cf7e-934b-4b52-8f40-eedafb8607cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.622052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00942-a9ce-4025-a55d-36eaac5c2909 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.643396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.644313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.644750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.645255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.646056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.648203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.699525 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3128/6282] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:26 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:26.700654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.728769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.729696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.729976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.730244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.730894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.733968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.736951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:26.742013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb35ea1-3443-41d8-a80a-6261c3ea7b63 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.762360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.763683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.764047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.764286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.765219 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3155/6283] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:26.766565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.768454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.768757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.802196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800d94-e2fd-4a04-a9d6-9464c3aee76e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.808775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.810599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.811824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.812508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.815942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.818119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.821766 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3129/6284] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:26 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:26.822690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.833727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3156/6285] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:26.834863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.838131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:26.846936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cdf77-02e1-437e-9074-d8614218c0d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.863443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.864184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.864557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.864914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.867652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.870719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.875667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902772-dae4-4a5f-bd81-b7cb1406acc1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.889573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.892044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.892430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.892792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] PATH_INFO: `/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.897970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7dc339d4de04b818f4dfc3f4e14a506)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.899334 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3130/6286] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:26.901542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:26.903913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.924485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb04fa-0d4a-4069-aaa5-92c4108c161a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:26.956889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:26.958135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:26.958676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:26.959310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:26.963014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:26.968927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:26.992272 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3131/6287] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:26.993196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.013951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f16d9-e1eb-4db2-b729-aa75fcf3d088 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.017626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7dc339d4de04b818f4dfc3f4e14a506', 'request_id': 'req-825792cb-8ac7-4521-a111-ecf1d222c967'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:27.036862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7dc339d4de04b818f4dfc3f4e14a506', 'request_id': 'req-825792cb-8ac7-4521-a111-ecf1d222c967'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:27.050843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7dc339d4de04b818f4dfc3f4e14a506', 'request_id': 'req-825792cb-8ac7-4521-a111-ecf1d222c967'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:27.073700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] The token cache is being invalidate because project e7dc339d4de04b818f4dfc3f4e14a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:27.074088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:27.076070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:27.079935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3157/6288] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:26 2022] DELETE /identity/v3/projects/e7dc339d4de04b818f4dfc3f4e14a506 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:27.080982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.083977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.093459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.094159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.097431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.097774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] PATH_INFO: `/v3/projects/5a03aa5df7e443179b4efac3be945de9/users/021665a90920422f893bafe02b9936db/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.127394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825792cb-8ac7-4521-a111-ecf1d222c967 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.137416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a03aa5df7e443179b4efac3be945de9, user_id=021665a90920422f893bafe02b9936db, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.140070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.141172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.141172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.142330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] PATH_INFO: `/v3/projects/9a4c0a809df846398556e284ae0813c2/users/000242da1af84511afe3fe5a40e88032/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.149669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.179833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4c0a809df846398556e284ae0813c2, user_id=000242da1af84511afe3fe5a40e88032, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.181814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3132/6289] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:26 2022] PUT /identity/v3/projects/5a03aa5df7e443179b4efac3be945de9/users/021665a90920422f893bafe02b9936db/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:27.183178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391937a-f5d7-45e5-83c0-c73f3cd754f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.186788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.190030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.207422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3158/6290] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:27 2022] PUT /identity/v3/projects/9a4c0a809df846398556e284ae0813c2/users/000242da1af84511afe3fe5a40e88032/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:27.208583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.208865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.209169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.238301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:27.239735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:27.241089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.301148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf715d5-9f28-47c8-9bc4-f1eea7c4a9bb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.323457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3159/6291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:27.324411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.325831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.338797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77cfc-1cef-4345-ba78-6c2e92f8f6a8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.344293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.344979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.345408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.345881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.346545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.348151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b150ffe-c060-4c39-ba52-9024cfd928e6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.367311 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3160/6292] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:27.368542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.368821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.369572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.410729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] MFA Rules not processed for user `000242da1af84511afe3fe5a40e88032`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:27.412289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.427698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.428314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.428586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.429104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.429542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.431367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d35e-c9f8-4c30-89ee-ce7aa7dabfcf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.443630 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3133/6293] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:27.444916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.445881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:27.446203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.446484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.489498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:27.491308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.502285 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3134/6294] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:27.508604 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3161/6295] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:27.508604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.510220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.517273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891d1be-185d-4517-972a-ff0fd072e0ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.521346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aadf2e-7624-439f-833a-d5ccaaf75280 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.528975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.530792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.530915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.531084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.531362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] PATH_INFO: `/v3/projects/5a03aa5df7e443179b4efac3be945de9/users/021665a90920422f893bafe02b9936db/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.531530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.531808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.532077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] PATH_INFO: `/v3/projects/6e09666b89e54303a2ba6a93e458050d/users/12e31a35dfe846aa8f720a1f44d687a3/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.534605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a03aa5df7e443179b4efac3be945de9, user_id=021665a90920422f893bafe02b9936db, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.538970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.553516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3162/6296] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:27 2022] PUT /identity/v3/projects/5a03aa5df7e443179b4efac3be945de9/users/021665a90920422f893bafe02b9936db/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:27.554157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e09666b89e54303a2ba6a93e458050d, user_id=12e31a35dfe846aa8f720a1f44d687a3, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.554453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.557128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.585627 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3135/6297] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:27 2022] PUT /identity/v3/projects/6e09666b89e54303a2ba6a93e458050d/users/12e31a35dfe846aa8f720a1f44d687a3/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:27.586906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:27.655209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317194-461e-4f9a-af3d-35d13f5313b2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.729943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60025b9-2d36-4351-8e29-6b9da3be3bec admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:27.738198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.739114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.739846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.740541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.741342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.744253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8aad2-b38c-41bf-b3b1-262202bd197c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.757053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:27.757699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.758876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.759165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.759841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:27.760144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:27.761868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a7d87-420a-4aee-be78-fad9ad528d5d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:27.791281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3163/6298] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:27.799400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.799783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.802484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.809994 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3136/6299] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:27.812739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:27.814116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:27.814410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:27.866690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] MFA Rules not processed for user `021665a90920422f893bafe02b9936db`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:27.868217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.888167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] MFA Rules not processed for user `12e31a35dfe846aa8f720a1f44d687a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:27.893261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:27.900856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:27.970935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:28.019995 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3137/6300] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:28.021067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.043680 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3164/6301] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:28.044326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.168077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47390b6-7cfb-4d19-9d2f-8fe4529153e4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.181119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.181879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.182501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.183107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.184104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.186238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.198958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad5d69-5903-4110-bf64-1650311cffd9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.210383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.211156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.225024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.225024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.225024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.225024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.263832 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3138/6302] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.263832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.268421 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3165/6303] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.269354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.293485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939591f1-c587-4385-ad24-c826a30c1307 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.387586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176bd57-96e8-44fa-a02f-e3227b57b9a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.396886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.397785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.398066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.398334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.398964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.401641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.447594 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3139/6304] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.448516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.465700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.467136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.467579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.467862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.468758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.472351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.515354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:28.537969 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3166/6305] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/projects => generated 328 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.539402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.602167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614234d-2ccd-4867-9238-0a28dd64b668 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.649070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:28.666463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d83022-3523-4121-aabe-da44f8ca86f5 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.675346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.676347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.676701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.677073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.677820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.679550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.700131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3167/6306] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:28.700849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.707656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.708391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.708746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.709207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.709937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.711981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.747324 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3140/6307] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/users => generated 294 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.748860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.816754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74e94-f0a7-4f2f-a1b4-3eaa67ad863c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.824313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.826011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.826729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.827076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/4a17a59d1880495286dd07843401010c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.832678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=4a17a59d1880495286dd07843401010c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.834742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.877435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3168/6308] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 18 16:33:28 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/4a17a59d1880495286dd07843401010c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:28.878313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.903951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757634-914f-4e2d-ad9d-3cd6522d24e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.912310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.913137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.913486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.913792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:28.914495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:28.916780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:28.950847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e60695-98b3-41ec-862b-e8d7fda1ac66 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:28.972234 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3141/6309] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:28 2022] POST /identity/v3/users => generated 416 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:28.973477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:28.974023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:28.975080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:28.975541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:28.975934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] PATH_INFO: `/v3/projects/107a453859b74efdac3e9214780b82bf/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.003196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40fe1-199c-46e0-a13c-67b0a93ebfa7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.011040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107a453859b74efdac3e9214780b82bf, user_id=79f89efaf40442a1994a3919c3fa5967, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.014001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.021022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.023087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.023564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.024686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.026717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.033808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.041681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3169/6310] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:28 2022] PUT /identity/v3/projects/107a453859b74efdac3e9214780b82bf/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:29.042629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.065065 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3142/6311] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:29.068471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.089486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41ba77-cda3-4bf2-9db2-b700eb87b744 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.158069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611b746-9b20-4f97-8a83-1d052513aa00 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.167828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.168869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.169411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.169912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.170788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.170917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:29.172613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.201103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.201910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.202248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.202598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.206521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.208392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.239193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3170/6312] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 18 16:33:29 2022] POST /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:29.240378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.246299 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3143/6313] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:29 2022] POST /identity/v3/roles => generated 244 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:29.247652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.423924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a90c3-ab72-438b-b7d9-07713140e5aa tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.428373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93df37-8b0f-4269-ad30-ca2a6b408783 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.438823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.440001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.440449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.440919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.442109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.445261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.445523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.446199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.446849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.447131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.447647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:29.450996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.456447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.477881 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3171/6314] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:29 2022] GET /identity/v3/roles => generated 1655 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:29.477881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.487777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3144/6315] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:29 2022] GET /identity/v3/roles => generated 1655 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:29.491523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.494721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc55be-0d83-4459-9d5c-ac96992b9223 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.504804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.506465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.507050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.507737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/f47704cc3466441c95ded135b3b4a54f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.511230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=f47704cc3466441c95ded135b3b4a54f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.514207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.516182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8f634-de87-480c-b265-8aebc4e8a69b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.529830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.530777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.531353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.533515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.537512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.539649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.550640 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3172/6316] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 18 16:33:29 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/f47704cc3466441c95ded135b3b4a54f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:29.552450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.566955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c2eb1-5fea-4e30-a24f-a99d66336140 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.567915 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3145/6317] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:29 2022] POST /identity/v3/roles => generated 247 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:29.572762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.575624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.577103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.577572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.578706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] PATH_INFO: `/v3/projects/107a453859b74efdac3e9214780b82bf/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.582481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=107a453859b74efdac3e9214780b82bf, user_id=79f89efaf40442a1994a3919c3fa5967, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.586337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.589561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd0b1d-3154-45d5-84d7-184edbc7f319 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.598196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.598196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.598196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.598622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] PATH_INFO: `/v3/projects/569029c7c4b346a9a7919154d04c02d5/users/26031342d1684b28bdfda428a92c1721/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.605929 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3173/6318] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:29 2022] PUT /identity/v3/projects/107a453859b74efdac3e9214780b82bf/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:29.607087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.639567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] RBAC: Authorizing `identity:create_grant(project_id=569029c7c4b346a9a7919154d04c02d5, user_id=26031342d1684b28bdfda428a92c1721, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.642872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.680399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3146/6319] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:29 2022] PUT /identity/v3/projects/569029c7c4b346a9a7919154d04c02d5/users/26031342d1684b28bdfda428a92c1721/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:29.694878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:29.709031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c241818-fe77-4988-ae38-cd0c12dadf4f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.796463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa92fc6-a72a-4b17-a11c-3a746c8c55a1 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.797558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92fc6-a72a-4b17-a11c-3a746c8c55a1 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.799116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92fc6-a72a-4b17-a11c-3a746c8c55a1 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.799614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa92fc6-a72a-4b17-a11c-3a746c8c55a1 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/f47704cc3466441c95ded135b3b4a54f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-2fa92fc6-a72a-4b17-a11c-3a746c8c55a1 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Could not find credential: fa6dfbc1c03e311eb1667f2879272b2162802bbc08792379c21f007e9174f32a.: keystone.exception.CredentialNotFound: Could not find credential: fa6dfbc1c03e311eb1667f2879272b2162802bbc08792379c21f007e9174f32a. Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 18 16:33:29.836944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:29.838579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: fa6dfbc1c03e311eb1667f2879272b2162802bbc08792379c21f007e9174f32a. Oct 18 16:33:29.839623 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:29.842922 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3174/6320] 10.222.0.78 () {58 vars in 1377 bytes} [Tue Oct 18 16:33:29 2022] GET /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/f47704cc3466441c95ded135b3b4a54f => generated 148 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:29.846160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.847012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.847574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.879526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c360917-5bc0-48d0-9da1-87fed16a378b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:29.898629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:29.899430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.899687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] MFA Rules not processed for user `79f89efaf40442a1994a3919c3fa5967`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:29.900104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.900490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9476c4a0df7349a699d235368e8abad0/users/b6f5d503608945c8bd4fd90801fd9f6c/roles/5d68307ce1074b3998c396cee6532379` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:29.901583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:29.960186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9476c4a0df7349a699d235368e8abad0, user_id=b6f5d503608945c8bd4fd90801fd9f6c, role_id=5d68307ce1074b3998c396cee6532379)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:29.964390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3eae9-0b31-4f2b-84a5-0414d0d207f3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:29.996506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3147/6321] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:29 2022] PUT /identity/v3/projects/9476c4a0df7349a699d235368e8abad0/users/b6f5d503608945c8bd4fd90801fd9f6c/roles/5d68307ce1074b3998c396cee6532379 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:29.998459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:29.998851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:29.999450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.044153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3175/6322] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:30.045481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.056388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] MFA Rules not processed for user `26031342d1684b28bdfda428a92c1721`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:30.058463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:30.060137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb6c7d-cb9e-4916-a937-931cb5645031 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.065751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:30.082518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:30.204507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.204507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.204507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.205148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.205148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.206810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.210916 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3148/6323] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:30.211919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.248174 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3176/6324] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:30.248174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.341683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409898-467e-4f89-aa25-07d5c8beb14e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.349770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.350181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.350531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.351003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9476c4a0df7349a699d235368e8abad0/users/b6f5d503608945c8bd4fd90801fd9f6c/roles/b5a7e042fb2449f18e895280571f5f71` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.353660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9476c4a0df7349a699d235368e8abad0, user_id=b6f5d503608945c8bd4fd90801fd9f6c, role_id=b5a7e042fb2449f18e895280571f5f71)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.356554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.374116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72b3f2-009f-4e31-a1d2-74eadf759319 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.390763 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3149/6325] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:30 2022] PUT /identity/v3/projects/9476c4a0df7349a699d235368e8abad0/users/b6f5d503608945c8bd4fd90801fd9f6c/roles/b5a7e042fb2449f18e895280571f5f71 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:30.392065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.511574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.512595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.523406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.524011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.525855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.527998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.553803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386fcb1-4098-4ac5-acfe-386a3c1216a4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.559390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.559970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.560273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.560575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.561358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.563516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.573073 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3177/6326] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/projects => generated 367 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:30.573901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.605132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3150/6327] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:30.605132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.629293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:30.651608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:30.663742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386df0bb-51ab-4cb7-a56e-de47cdbe2dd2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.703613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa54401-f692-41e3-8fe6-e278349ab8e0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.711229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.712629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.713830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.714279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.715397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.724278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.771833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.775243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.777316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.777782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.780101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.782863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.792392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3151/6328] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:30 2022] GET /identity/v3/users => generated 8607 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:30.793305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.812175 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3178/6329] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 367 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:30.817893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:30.920958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42b539-f157-4716-853d-ccd13db228be tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.929754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.930936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.931221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.931510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.932742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.934983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374a93c-1343-413b-bcae-adb2e8c8f50a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.963136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673c904-0af0-482e-9165-8475c36c4f81 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:30.969060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:30.970384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.970673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.970925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:30.971610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:30.973812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:30.973951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3152/6330] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:30.976011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:30.977331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:30.977695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.010288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3179/6331] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:31.011182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.026069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16e6a-cbc8-41e4-9171-796c1a9c58c3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.031261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.034448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.036068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.036068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.039091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.044359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.055927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] MFA Rules not processed for user `b6f5d503608945c8bd4fd90801fd9f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:31.059493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:31.074141 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3180/6332] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Oct 18 16:33:31 2022] GET /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 865 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:31.074141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.092388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92438206-3fc1-4b27-9f60-ea999a62491c tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.101065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.102566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.103016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.103670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.104470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.107161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.134633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3181/6333] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:31 2022] GET /identity/v3/roles => generated 1893 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:31.135634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.148794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e6b06-93a7-4d93-b9c5-18e062712810 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.154607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.155229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.155507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.155783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.156501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.158844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.184091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3153/6334] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:31.185470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.188224 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3182/6335] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:31 2022] GET /identity/v3/roles => generated 1893 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:31.189812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.201629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5923281-a6e9-441d-8c62-e263b8da2235 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.211956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a0fc6-67d3-4385-8955-123d1e49ce8f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.215873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.217604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.218069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.218526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.220777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.221413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.222418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.222905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.223302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/606a2b0262754697bb4d3ed09703b555` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.223602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.226736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=606a2b0262754697bb4d3ed09703b555)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.229690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ebda4-d03f-48df-a768-bf090e7789d3 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.249359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3183/6336] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:31 2022] GET /identity/v3/roles => generated 1893 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:31.251811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.270215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1302a-4a92-4949-93a1-397692d53dc4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.280511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3154/6337] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 18 16:33:31 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/606a2b0262754697bb4d3ed09703b555 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:31.283717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.284202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.284667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.285977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.287188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.287612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.288057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] PATH_INFO: `/v3/projects/ae965f6e95e74affb59bba4aa8d1de64/users/62e6d9c50ae944f89af18fcb92fd9953/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.334552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae965f6e95e74affb59bba4aa8d1de64, user_id=62e6d9c50ae944f89af18fcb92fd9953, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.337865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.357267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] MFA Rules not processed for user `b6f5d503608945c8bd4fd90801fd9f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:31.358423 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3184/6338] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:31 2022] PUT /identity/v3/projects/ae965f6e95e74affb59bba4aa8d1de64/users/62e6d9c50ae944f89af18fcb92fd9953/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:31.359710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.369419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:31.388232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:31.415834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:31.489284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3155/6339] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:31.491018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.571150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84970967-3769-4195-bbd5-e561d1e921b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.588149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.589187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.589478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.589755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] PATH_INFO: `/v3/projects/be569c2de8ca4abaac5a4dac09d4c86a/users/0f191c1cfcf248dda8459cb05c2cff59/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.620602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be569c2de8ca4abaac5a4dac09d4c86a, user_id=0f191c1cfcf248dda8459cb05c2cff59, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.624362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.656713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3185/6340] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:31 2022] PUT /identity/v3/projects/be569c2de8ca4abaac5a4dac09d4c86a/users/0f191c1cfcf248dda8459cb05c2cff59/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:31.660935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.668837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cefe2-881a-41eb-a3c9-a16c3da1b657 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.845603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.846266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.846541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.846815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/ac0287f6bf254c9287031a1fc6128b1f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.849071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=ac0287f6bf254c9287031a1fc6128b1f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.850603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.870161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25946bcc-5405-4869-8119-aa88ca30ba7e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:31.881091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:31.881867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.882242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.882776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.883562 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3156/6341] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 18 16:33:31 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/ac0287f6bf254c9287031a1fc6128b1f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:31.883733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:31.886115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce224f2f-8cb2-4c4e-a713-aafaa46936ad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:31.892111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:31.908827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3186/6342] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:31 2022] GET /identity/v3/roles => generated 1893 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:31.910672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:31.911446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:31.912005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:31.980683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] MFA Rules not processed for user `0f191c1cfcf248dda8459cb05c2cff59`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:31.983069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:32.006350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762604-f57c-45ec-98f3-12201eb2ae2d tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.011797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f5d503608945c8bd4fd90801fd9f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9476c4a0df7349a699d235368e8abad0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1077456125', 'tempest-DelegatedRole-1614481509'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.012770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.013101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.013377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.014253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: Authorizing `identity:create_trust()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.015366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.077900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:32.142689 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3187/6343] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:32.143421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.158603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4489-85e1-4798-b493-75566743fcd2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.163546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.164084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.164365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.164791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.165606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.167718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.175368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3157/6344] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:33:31 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:32.176545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.200329 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3188/6345] 10.222.0.78 () {60 vars in 1299 bytes} [Tue Oct 18 16:33:32 2022] POST /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:32.202531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.206796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe128-20be-49d1-9e6f-fc754bba36b7 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.222132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:32.223076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.223641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.223966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.224268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] PATH_INFO: `/v3/projects/ae965f6e95e74affb59bba4aa8d1de64/users/62e6d9c50ae944f89af18fcb92fd9953/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.232747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae965f6e95e74affb59bba4aa8d1de64, user_id=62e6d9c50ae944f89af18fcb92fd9953, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.236399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.254678 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3158/6346] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:32 2022] PUT /identity/v3/projects/ae965f6e95e74affb59bba4aa8d1de64/users/62e6d9c50ae944f89af18fcb92fd9953/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:32.255921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.364664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756b47d-cf77-43cf-9b20-ec03480904dc tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.410421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45c947-be3d-4d6e-80c0-aba4f6558d73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.419157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.419904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.420264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.420608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.421682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.423859 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:32.423859 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:33:32.423859 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:33:32.425392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.434792 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3159/6347] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Oct 18 16:33:32 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:32.436120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.492324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.492964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.493271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.493543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.494237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.496169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8d27-9b40-4e37-b949-83a21ec4b2c1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.531580 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3189/6348] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:32 2022] POST /identity/v3/domains => generated 277 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:32.535607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.539462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.542181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.573446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff059bd-32c0-409d-9e31-32982f1e3317 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.617857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] MFA Rules not processed for user `62e6d9c50ae944f89af18fcb92fd9953`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:32.620008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:32.686737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.688934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.689643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.690129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/8067acff0256461e9fe1bb3379f5463c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.692824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=8067acff0256461e9fe1bb3379f5463c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.695179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.699608 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3160/6349] 10.222.0.78 () {58 vars in 1377 bytes} [Tue Oct 18 16:33:32 2022] GET /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/8067acff0256461e9fe1bb3379f5463c => generated 367 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:32.700833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.710595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:32.803401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f0abd-78f2-4f60-b2b3-8b3b7e3a4696 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.815165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f5d503608945c8bd4fd90801fd9f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9476c4a0df7349a699d235368e8abad0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1077456125', 'tempest-DelegatedRole-1614481509'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.815900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.816475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.818405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] PATH_INFO: `/v3/OS-TRUST/trusts/1d3c983874cc4902b4aeea0b3903f2d3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.849354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: Authorizing `identity:delete_trust(trust_id=1d3c983874cc4902b4aeea0b3903f2d3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.851879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:32.897865 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3190/6350] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:32.899558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.907015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1d3c983874cc4902b4aeea0b3903f2d3', 'request_id': 'req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:32.909101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1d3c983874cc4902b4aeea0b3903f2d3', 'request_id': 'req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:32.910209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1d3c983874cc4902b4aeea0b3903f2d3', 'request_id': 'req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:32.957443 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3161/6351] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:33:32 2022] DELETE /identity/v3/OS-TRUST/trusts/1d3c983874cc4902b4aeea0b3903f2d3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:32.957855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:32.959294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:32.977154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:32.984307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45870e-b7bd-4c9c-b9b5-84f7df9c5fae tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:32.992672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e31a35dfe846aa8f720a1f44d687a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e09666b89e54303a2ba6a93e458050d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:32.993937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:32.994480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:32.994929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/8067acff0256461e9fe1bb3379f5463c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:32.997386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=12e31a35dfe846aa8f720a1f44d687a3, credential_id=8067acff0256461e9fe1bb3379f5463c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:32.999151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.024452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3162/6352] 10.222.0.78 () {58 vars in 1380 bytes} [Tue Oct 18 16:33:32 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3/credentials/OS-EC2/8067acff0256461e9fe1bb3379f5463c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:33.025733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.028228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.047210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60413e-31b0-4b86-bffc-3e48ba828edf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.061119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.063114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.063482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.064726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.065514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.070187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.104538 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3191/6353] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:32 2022] POST /identity/v3/roles => generated 239 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:33.105765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.109337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.133998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a34b-2b99-4abc-b864-203fd98fd960 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.141199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6f5d503608945c8bd4fd90801fd9f6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9476c4a0df7349a699d235368e8abad0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1077456125', 'tempest-DelegatedRole-1614481509'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.142972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.143375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.143605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] PATH_INFO: `/v3/OS-TRUST/trusts/1d3c983874cc4902b4aeea0b3903f2d3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.184374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4d50-bdf1-4161-98df-ad886d656532 tempest-EC2CredentialsTest-1565200059 tempest-EC2CredentialsTest-1565200059-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.188859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.189628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.190152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.190497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.192492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Could not find trust: 1d3c983874cc4902b4aeea0b3903f2d3.: keystone.exception.TrustNotFound: Could not find trust: 1d3c983874cc4902b4aeea0b3903f2d3. Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 16:33:33.204916 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1d3c983874cc4902b4aeea0b3903f2d3. Oct 18 16:33:33.206268 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:33.207397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3192/6354] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:33:33 2022] GET /identity/v3/OS-TRUST/trusts/1d3c983874cc4902b4aeea0b3903f2d3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:33.208346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.210477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.211855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.215715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.239938 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3163/6355] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:33.241065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.242468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.260060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa524-bbac-4cbb-abb0-fef97d2e9078 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.267411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.268208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.268492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.268766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0133f022d62f4baa8529441962330bc9/users/0f191c1cfcf248dda8459cb05c2cff59/roles/8c7326fd362549f5b90f041c4f1aa5d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.287916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0133f022d62f4baa8529441962330bc9, user_id=0f191c1cfcf248dda8459cb05c2cff59, role_id=8c7326fd362549f5b90f041c4f1aa5d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.297486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.322388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3164/6356] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 18 16:33:33 2022] PUT /identity/v3/domains/0133f022d62f4baa8529441962330bc9/users/0f191c1cfcf248dda8459cb05c2cff59/roles/8c7326fd362549f5b90f041c4f1aa5d1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:33.325579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.329528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.388575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44208d-2b5a-44ec-a397-e5ca743cbc48 tempest-TrustsV3TestJSON-283082803 tempest-user-1155966937] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.411937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:33.477750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3080778-a693-4a1f-91c6-9e86fac30858 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.484848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.486304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.486863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.487594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/b5a7e042fb2449f18e895280571f5f71` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.489369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b5a7e042fb2449f18e895280571f5f71)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.491015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.500568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.501856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.505243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.506542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] PATH_INFO: `/v3/users/12e31a35dfe846aa8f720a1f44d687a3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.508073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e31a35dfe846aa8f720a1f44d687a3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.510084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:33.567128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role b5a7e042fb2449f18e895280571f5f71 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:33.567432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.568145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.574447 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3165/6357] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:33 2022] DELETE /identity/v3/roles/b5a7e042fb2449f18e895280571f5f71 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:33.576177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.582445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.590345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e31a35dfe846aa8f720a1f44d687a3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.605774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e31a35dfe846aa8f720a1f44d687a3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.607232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e31a35dfe846aa8f720a1f44d687a3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.624021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e31a35dfe846aa8f720a1f44d687a3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.625170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e31a35dfe846aa8f720a1f44d687a3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:33.631681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:33.661777 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3193/6358] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:33 2022] DELETE /identity/v3/users/12e31a35dfe846aa8f720a1f44d687a3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:33.662521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:33.664470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:33.729407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa61e-0df5-48ee-ae8d-d0b51794ff1d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.872526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092f81e-6c1b-4fb7-bd32-62c748445c1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:33.894547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:33.895146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:33.895421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:33.895686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] PATH_INFO: `/v3/users/26031342d1684b28bdfda428a92c1721` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:33.896904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26031342d1684b28bdfda428a92c1721)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:33.899546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.009050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26031342d1684b28bdfda428a92c1721'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.020614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26031342d1684b28bdfda428a92c1721'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.021739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26031342d1684b28bdfda428a92c1721'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.033078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26031342d1684b28bdfda428a92c1721'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.034513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26031342d1684b28bdfda428a92c1721'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.087747 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3194/6359] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:33 2022] DELETE /identity/v3/users/26031342d1684b28bdfda428a92c1721 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:34.088973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.090929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.176460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.177111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.177388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.177661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.178326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.179954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f60cc5-2724-4615-a5fd-31e7859b7161 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.216005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3174d-8c17-497b-bbfd-7ec72011e189 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.219073 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3166/6360] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:33 2022] POST /identity/v3/domains => generated 277 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:34.221239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879b3b-7d47-4d86-8d60-0b084104034f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.221686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879b3b-7d47-4d86-8d60-0b084104034f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.222132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879b3b-7d47-4d86-8d60-0b084104034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.239017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:34.254213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33879b3b-7d47-4d86-8d60-0b084104034f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:34.256384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33879b3b-7d47-4d86-8d60-0b084104034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.328896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.330014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:34.330318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.330714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.331444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/5d68307ce1074b3998c396cee6532379` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.333469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5d68307ce1074b3998c396cee6532379)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.338468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.398920 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3167/6361] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:34.401450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.401954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.403412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.433224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 5d68307ce1074b3998c396cee6532379 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:34.433520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.434647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.440431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:34.442478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.451607 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3195/6362] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:34 2022] DELETE /identity/v3/roles/5d68307ce1074b3998c396cee6532379 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:34.454971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.457793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.573422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3168/6363] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:34.574225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.575787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.591947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaece0-ac30-4e43-ac66-04ec0c628048 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.600859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.601634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.601834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.603996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.603996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.604704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.642557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3196/6364] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:34 2022] POST /identity/v3/roles => generated 239 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:34.643502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.645776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.713741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968beb6-f652-47ea-84bf-ccdae0ff2f6e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.734441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.735889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.735889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.736217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.741116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:34.765730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.768158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.779923 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3169/6365] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:34.780985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.799453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ecb9-d3bf-467c-82e2-732f3427f70c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.804434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.805252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.805564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.806228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.821638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.822784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc1d8f-fc9a-466d-9eb9-836131d3b0b2 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.823092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.845689 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3170/6366] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:34.846306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.847319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:34.847507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.849740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.850072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/b6f5d503608945c8bd4fd90801fd9f6c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.858975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b6f5d503608945c8bd4fd90801fd9f6c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.861873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.867565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774072ed-c83f-42e0-982c-c9e8d9ecbfbf service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:34.875251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:34.879185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:34.880285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:34.883332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:34.884076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:34.886875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:34.891356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:34.926587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f5d503608945c8bd4fd90801fd9f6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.942608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f5d503608945c8bd4fd90801fd9f6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.943226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f5d503608945c8bd4fd90801fd9f6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.970740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f5d503608945c8bd4fd90801fd9f6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:34.973472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f5d503608945c8bd4fd90801fd9f6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.013052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3171/6367] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:33:34 2022] POST /identity/v3/groups => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:35.014301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.018342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:35.035196 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3197/6368] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:34 2022] DELETE /identity/v3/users/b6f5d503608945c8bd4fd90801fd9f6c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:35.037517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.040131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:35.063540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6507ce-647e-4cbf-ab75-f309017ba855 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.145989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65681ea1-ae92-4b0a-9aa1-f86ad3d703d9 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.152487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:35.153434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:35.153750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:35.154046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9476c4a0df7349a699d235368e8abad0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:35.155304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9476c4a0df7349a699d235368e8abad0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:35.159616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:35.255191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:35.297488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9476c4a0df7349a699d235368e8abad0', 'request_id': 'req-32b00964-de24-47ac-b1ca-629fdfc3f29e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.298886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:35.300129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:35.302120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:35.303305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/bf371b604e53475aaf940ec8c075220a/users/0f191c1cfcf248dda8459cb05c2cff59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:35.316873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9476c4a0df7349a699d235368e8abad0', 'request_id': 'req-32b00964-de24-47ac-b1ca-629fdfc3f29e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.317744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=bf371b604e53475aaf940ec8c075220a, user_id=0f191c1cfcf248dda8459cb05c2cff59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:35.324230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:35.336898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9476c4a0df7349a699d235368e8abad0', 'request_id': 'req-32b00964-de24-47ac-b1ca-629fdfc3f29e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.360845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project 9476c4a0df7349a699d235368e8abad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:35.361170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.362014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:35.369102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3198/6369] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:35 2022] DELETE /identity/v3/projects/9476c4a0df7349a699d235368e8abad0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:35.372784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.375143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:35.407805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:35.419186 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3172/6370] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:33:35 2022] PUT /identity/v3/groups/bf371b604e53475aaf940ec8c075220a/users/0f191c1cfcf248dda8459cb05c2cff59 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:35.420562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.426424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:35.543455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b00964-de24-47ac-b1ca-629fdfc3f29e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.556496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353172c-caeb-4f3c-9f38-a277f19ef837 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.571342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:35.572953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:35.573710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:35.575600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/9f20190ac54945a4875c687d3cde9c5c/groups/bf371b604e53475aaf940ec8c075220a/roles/0bd683a2c68d436e9930890c9194c1bd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:35.584377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9f20190ac54945a4875c687d3cde9c5c, group_id=bf371b604e53475aaf940ec8c075220a, role_id=0bd683a2c68d436e9930890c9194c1bd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:35.595516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:35.639847 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3173/6371] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:35 2022] PUT /identity/v3/domains/9f20190ac54945a4875c687d3cde9c5c/groups/bf371b604e53475aaf940ec8c075220a/roles/0bd683a2c68d436e9930890c9194c1bd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:35.643431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.654201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:35.658713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:35.659570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:35.660020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:35.660319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:35.660974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:35.664402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:35.717459 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3199/6372] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:33:35 2022] POST /identity/v3/projects => generated 329 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:35.718810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:35.888785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8c03-23d4-4578-adc2-d9dd0b711431 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.894044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f085e0-1375-46ae-857a-c1e3309448c4 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:35.899581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:35.900873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:35.901197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:35.901474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:35.902198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:35.904167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:35.944160 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3200/6373] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:35 2022] POST /identity/v3/domains => generated 276 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:35.945851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.076025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.076025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.076025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.076456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] PATH_INFO: `/v3/projects/569029c7c4b346a9a7919154d04c02d5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.080730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569029c7c4b346a9a7919154d04c02d5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.083294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.091147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:36.113976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:36.123769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15639-2093-4ec5-b07e-bcd015231cdf tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.133689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.134455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.134830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.135171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.135897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.139358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.170769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569029c7c4b346a9a7919154d04c02d5', 'request_id': 'req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.181808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569029c7c4b346a9a7919154d04c02d5', 'request_id': 'req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.187309 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3201/6374] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:35 2022] POST /identity/v3/users => generated 416 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:36.188427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.191680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.201287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569029c7c4b346a9a7919154d04c02d5', 'request_id': 'req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.232568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] The token cache is being invalidate because project 569029c7c4b346a9a7919154d04c02d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:36.232870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.234778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.253046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3174/6375] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:35 2022] DELETE /identity/v3/projects/569029c7c4b346a9a7919154d04c02d5 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:36.254460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.256052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.309033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf215be2-97cc-4b72-a320-df592ccf371c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.418621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce12a-fe83-4fc0-9cfc-95ca9836ee23 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.437090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.437090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.437090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.437527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.437527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.437527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.493018 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3175/6376] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:36 2022] POST /identity/v3/roles => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:36.493018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.501533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.513625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.514317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.514612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.514865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] PATH_INFO: `/v3/projects/6e09666b89e54303a2ba6a93e458050d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.525670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e09666b89e54303a2ba6a93e458050d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.531447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.618666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e09666b89e54303a2ba6a93e458050d', 'request_id': 'req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.626556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1143b-f9c8-4bd3-9bed-3b9908b68e08 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.626797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e09666b89e54303a2ba6a93e458050d', 'request_id': 'req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.637907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e09666b89e54303a2ba6a93e458050d', 'request_id': 'req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.654005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] The token cache is being invalidate because project 6e09666b89e54303a2ba6a93e458050d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:36.654863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.655147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.658846 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3202/6377] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:36 2022] DELETE /identity/v3/projects/6e09666b89e54303a2ba6a93e458050d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:36.659087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.660687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.674054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:36.689736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:36.698035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.698659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.698939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.699215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.700283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.701680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.725042 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3176/6378] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:36 2022] POST /identity/v3/roles => generated 244 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:36.725042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.725484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.782824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def2dbb-3a7f-4158-b8e0-af9aabbc71c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.796331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.797448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.798305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.798591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] PATH_INFO: `/v3/users/62e6d9c50ae944f89af18fcb92fd9953` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.800337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e6d9c50ae944f89af18fcb92fd9953)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.802997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.851168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3575-7c29-4530-beb9-39f47406a1ff tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:36.865875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:36.866727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.867022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.867335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8/users/0f191c1cfcf248dda8459cb05c2cff59/roles/f20cfdedb28845baaea301658dad44e7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.899077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0fd21c92e8f945348b1542ba7a9ba6e8, user_id=0f191c1cfcf248dda8459cb05c2cff59, role_id=f20cfdedb28845baaea301658dad44e7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:36.905596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf335b81-a58b-488d-8e26-8a1e2fbfa972 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:36.909071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e6d9c50ae944f89af18fcb92fd9953'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.920114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e6d9c50ae944f89af18fcb92fd9953'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.922354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e6d9c50ae944f89af18fcb92fd9953'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.932155 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3177/6379] 10.222.0.78 () {60 vars in 1480 bytes} [Tue Oct 18 16:33:36 2022] PUT /identity/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8/users/0f191c1cfcf248dda8459cb05c2cff59/roles/f20cfdedb28845baaea301658dad44e7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:36.933654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:36.933992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:36.934390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:36.946082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e6d9c50ae944f89af18fcb92fd9953'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.947178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e6d9c50ae944f89af18fcb92fd9953'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:36.972852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:36.974352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:36.990462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3203/6380] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:36 2022] DELETE /identity/v3/users/62e6d9c50ae944f89af18fcb92fd9953 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:36.991625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:36.993433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:37.119183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888eb4d5-5e2e-403b-b5e1-13bd5b21828a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.130249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.131605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.132225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.132506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.133410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.136476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9baf286-40a6-4784-bd3f-fcfca63cb1dc tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.168761 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3178/6381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:37.170157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.175837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:37.196417 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3204/6382] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:36 2022] POST /identity/v3/roles => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:37.196417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.196417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.197311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.233615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:37.237565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:37.290662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:37.357414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26d1bd-38c8-4e55-b14e-cd8dc8089084 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.369693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:37.399742 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3205/6383] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:37.400965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.448047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ff88-fede-409d-9e4d-0736ad782726 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.462610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.463337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.464709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.465037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0/users/17a48c729e3844a3996ddfe1b4b0c337/roles/4303b7c6ff2847d59a89623649b95380` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.505274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.505274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.511281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.512299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.514727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.519674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.524364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a8c76eced6b4ae18836f6afbfde12e0, user_id=17a48c729e3844a3996ddfe1b4b0c337, role_id=4303b7c6ff2847d59a89623649b95380)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.527322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.552940 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3179/6384] 10.222.0.78 () {60 vars in 1149 bytes} [Tue Oct 18 16:33:37 2022] POST /identity/v3/domains => generated 276 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:37.556431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.564971 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3206/6385] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:37 2022] PUT /identity/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0/users/17a48c729e3844a3996ddfe1b4b0c337/roles/4303b7c6ff2847d59a89623649b95380 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:37.566111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.676466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8273-48b0-488c-abeb-15468915326b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.687282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.688292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.689011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.690882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.691605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:37.693328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.697345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.735754 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3180/6386] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:37.753631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.754288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de396f68-f3e4-485c-b9e1-5b9859a3f236 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.899775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d93901-057b-4f93-a99d-8ffb823e022f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:37.914809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.917412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.919086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.919086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0/users/17a48c729e3844a3996ddfe1b4b0c337/roles/a683e4a9bdc540ac9df6721455e7b221` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.920121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:37.922465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:37.933155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:37.933155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:37.933155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.933155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.941021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a8c76eced6b4ae18836f6afbfde12e0, user_id=17a48c729e3844a3996ddfe1b4b0c337, role_id=a683e4a9bdc540ac9df6721455e7b221)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:37.944082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:37.962038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3207/6387] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:37 2022] POST /identity/v3/roles => generated 239 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:37.962936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.971448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3181/6388] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:37 2022] PUT /identity/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0/users/17a48c729e3844a3996ddfe1b4b0c337/roles/a683e4a9bdc540ac9df6721455e7b221 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:37.976059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:37.987916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610c97-02ee-49c0-8fc7-dc47b8d9ef37 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.045971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:38.075501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:38.110624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.111283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.111620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.112055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.112731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.117785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.121823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f1c73-5de5-48b8-a145-dc71aa9be300 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.128569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.129765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.130460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.130826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.131758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.134500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.180390 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3182/6389] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Oct 18 16:33:37 2022] POST /identity/v3/groups => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:38.181441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:38.208182 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3208/6390] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:38.232289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:38.239186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:38.342284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80bdc1-156e-4a99-a6ab-513ca5bdd175 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.451259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eb049-89bf-4ff3-8fb2-94e85ee7959f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.467471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.469251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.471353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.471631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] PATH_INFO: `/v3/projects/ae965f6e95e74affb59bba4aa8d1de64` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.475414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae965f6e95e74affb59bba4aa8d1de64)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.478564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.479590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.480497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.480870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.481279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.482339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.485256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.537297 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3183/6391] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:38 2022] GET /identity/v3/users => generated 8319 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:38.537297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:38.609143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae965f6e95e74affb59bba4aa8d1de64', 'request_id': 'req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:38.618890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae965f6e95e74affb59bba4aa8d1de64', 'request_id': 'req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:38.628083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae965f6e95e74affb59bba4aa8d1de64', 'request_id': 'req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:38.646270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] The token cache is being invalidate because project ae965f6e95e74affb59bba4aa8d1de64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:38.646524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:38.647137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:38.652817 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3209/6392] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:38 2022] DELETE /identity/v3/projects/ae965f6e95e74affb59bba4aa8d1de64 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:38.652817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:38.652817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:38.682369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:38.693244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d606d-5ff0-44cd-9a08-6e0d19e7e43a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.730170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:38.736478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a095bb-b4bd-4756-81d6-d0cbf52b9b98 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:38.743127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.744191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.744830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.745266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.746375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.750726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcead5f-5816-46c6-a35b-67ec27ebef71 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.779544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3210/6393] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:38 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:38.781489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.781489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.781718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.833162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:38.834523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.834907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.835297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3/users/0f191c1cfcf248dda8459cb05c2cff59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.848283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=21ebe35a92f146d4b4af91cf9524a8c3, user_id=0f191c1cfcf248dda8459cb05c2cff59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:38.852283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80986913-d56b-4c91-8177-de56c0bba2ea tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:38.864838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] MFA Rules not processed for user `17a48c729e3844a3996ddfe1b4b0c337`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:38.866283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:38.902691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3184/6394] 10.222.0.78 () {60 vars in 1360 bytes} [Tue Oct 18 16:33:38 2022] PUT /identity/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3/users/0f191c1cfcf248dda8459cb05c2cff59 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:38.904726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:38.905218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:38.905698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:38.958212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:38.959685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:39.006348 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3211/6395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:39.008016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.039022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151c3f5-3af9-4689-9c43-f5602ec33247 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.097256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3185/6396] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:39.099562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.105406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:39.144836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.146287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.146730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.147326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.148055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.150339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fe356-5d02-4c7f-96fe-41107d3f0c02 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.175319 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3212/6397] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:39 2022] GET /identity/v3/roles => generated 2813 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:39.175319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.175319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.175319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.205891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] MFA Rules not processed for user `17a48c729e3844a3996ddfe1b4b0c337`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:39.205891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:39.221868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8882e7-e5f0-4474-8ce1-0e8921c9a672 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.239100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.240127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.240460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.240740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0863ba54f0414b359db85661cd1d1c26/groups/21ebe35a92f146d4b4af91cf9524a8c3/roles/53dbd2f2c4f54a83970602717a571df6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.243404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0863ba54f0414b359db85661cd1d1c26, group_id=21ebe35a92f146d4b4af91cf9524a8c3, role_id=53dbd2f2c4f54a83970602717a571df6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.247071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aca994-665a-448e-83c8-02c560646003 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.273921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3186/6398] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:39 2022] PUT /identity/v3/domains/0863ba54f0414b359db85661cd1d1c26/groups/21ebe35a92f146d4b4af91cf9524a8c3/roles/53dbd2f2c4f54a83970602717a571df6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:39.275426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.275426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.275914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.307568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3213/6399] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:39.308867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.311398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:39.316176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:39.339531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fb368-4954-498a-af8c-fef3264cc79b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.360953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:39.361223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:39.453257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.454379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.454983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.455426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.456246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.459418 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3187/6400] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:39.460093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.460342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.461874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:39.477353 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3214/6401] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:39 2022] GET /identity/v3/roles => generated 2813 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:39.478819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.555174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf4120-6b21-4f0f-8f8d-dd96b9cda43c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.568939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a48c729e3844a3996ddfe1b4b0c337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c76eced6b4ae18836f6afbfde12e0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-682735405', 'tempest-DelegatedRole-1020901431'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.569688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.570033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.570377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.571124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorizing `identity:create_trust()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.572422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.591621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6656bd-07fb-4bf3-a221-2746785342af None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.596923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f191c1cfcf248dda8459cb05c2cff59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be569c2de8ca4abaac5a4dac09d4c86a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.597660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.598011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.598356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] PATH_INFO: `/v3/auth/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.599370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.600131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.731615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3215/6402] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:33:39 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:39.733646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.744906 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3188/6403] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Oct 18 16:33:39 2022] GET /identity/v3/auth/domains => generated 1174 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:39.745879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.760356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71abf7-f26b-43ec-8a53-104256050cdc tempest-TokensV3TestJSON-708839856 tempest-TokensV3TestJSON-708839856-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.766242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.767171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.767613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.767958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] PATH_INFO: `/v3/projects/3bbf9c0633b549b39197862c060d3481/users/e6ab6896fefb464b8932b5616a24f23f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.790356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edc8ab-eb1e-47e4-84f6-1661aaae610d tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.791745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbf9c0633b549b39197862c060d3481, user_id=e6ab6896fefb464b8932b5616a24f23f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.795310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.802007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.802778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.803160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.803465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.804257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:39.804589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.806404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.821659 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3189/6404] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:39 2022] PUT /identity/v3/projects/3bbf9c0633b549b39197862c060d3481/users/e6ab6896fefb464b8932b5616a24f23f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:39.834584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.850662 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3216/6405] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:39.853518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:39.855556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:39.922948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4118-57a2-4dd2-a8bf-b27c66b02c58 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:39.928565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a48c729e3844a3996ddfe1b4b0c337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c76eced6b4ae18836f6afbfde12e0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-682735405', 'tempest-DelegatedRole-1020901431'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:39.933125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.933125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.933125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.933125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:39.933125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8af3c-1322-4996-ad63-e7d3312bc098 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:39.943482 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3190/6406] 10.222.0.78 () {58 vars in 1252 bytes} [Tue Oct 18 16:33:39 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=17a48c729e3844a3996ddfe1b4b0c337 => generated 611 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:39.945078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:39.945237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:39.945497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:39.960721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:39.989143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] MFA Rules not processed for user `e6ab6896fefb464b8932b5616a24f23f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:39.991471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.024084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7baa-d15a-4784-bfda-74b30243dc7f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.121642 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3191/6407] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:40.123806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.180080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.180910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.181356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.181893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0863ba54f0414b359db85661cd1d1c26/groups/21ebe35a92f146d4b4af91cf9524a8c3/roles/53dbd2f2c4f54a83970602717a571df6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.184594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0863ba54f0414b359db85661cd1d1c26, group_id=21ebe35a92f146d4b4af91cf9524a8c3, role_id=53dbd2f2c4f54a83970602717a571df6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.187583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:40.201794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 53dbd2f2c4f54a83970602717a571df6 was removed from group 21ebe35a92f146d4b4af91cf9524a8c3 on domain 0863ba54f0414b359db85661cd1d1c26. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:40.202156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.205105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.234911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3217/6408] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:33:39 2022] DELETE /identity/v3/domains/0863ba54f0414b359db85661cd1d1c26/groups/21ebe35a92f146d4b4af91cf9524a8c3/roles/53dbd2f2c4f54a83970602717a571df6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:40.236050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.237959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.258140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd203d-bcbe-4cf7-ba46-78a6b523e339 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.353115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51804b-a731-48c3-a285-eeb59eee6cf4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.361390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a48c729e3844a3996ddfe1b4b0c337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c76eced6b4ae18836f6afbfde12e0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-682735405', 'tempest-DelegatedRole-1020901431'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.362444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.362614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.362780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] PATH_INFO: `/v3/OS-TRUST/trusts/fa0a3cd9530d4d7584353ab2fb9ad491` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.365164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:40.379103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorizing `identity:delete_trust(trust_id=fa0a3cd9530d4d7584353ab2fb9ad491)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.380812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:40.383175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.384478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.384910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.385385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.386450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.390164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:40.406466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'fa0a3cd9530d4d7584353ab2fb9ad491', 'request_id': 'req-668e0302-f036-4c16-9f54-d721671d5b57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.427032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fa0a3cd9530d4d7584353ab2fb9ad491', 'request_id': 'req-668e0302-f036-4c16-9f54-d721671d5b57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.428986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fa0a3cd9530d4d7584353ab2fb9ad491', 'request_id': 'req-668e0302-f036-4c16-9f54-d721671d5b57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.441133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3218/6409] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:33:40 2022] DELETE /identity/v3/OS-TRUST/trusts/fa0a3cd9530d4d7584353ab2fb9ad491 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:40.443022 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3192/6410] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:40 2022] POST /identity/v3/projects => generated 381 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:40.446099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.457965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.458781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.461755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.571233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:40.612082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521032d1-bfd2-4900-ae72-89c86923c212 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.616465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e0302-f036-4c16-9f54-d721671d5b57 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.620565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.621497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.622240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.624373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3/users/0f191c1cfcf248dda8459cb05c2cff59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.628854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=21ebe35a92f146d4b4af91cf9524a8c3, user_id=0f191c1cfcf248dda8459cb05c2cff59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.632176 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:33:40.632176 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:33:40.632176 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:33:40.636118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:40.651272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:40.687908 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3193/6411] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:33:40 2022] DELETE /identity/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3/users/0f191c1cfcf248dda8459cb05c2cff59 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:40.692155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.695243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.736239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.737918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.739802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.740263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.743064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.804729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b0a27-f797-4295-adbc-9cb4fcd67128 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.810959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17a48c729e3844a3996ddfe1b4b0c337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a8c76eced6b4ae18836f6afbfde12e0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-682735405', 'tempest-DelegatedRole-1020901431'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.811727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.812123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.812551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] PATH_INFO: `/v3/OS-TRUST/trusts/fa0a3cd9530d4d7584353ab2fb9ad491` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.819467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.820884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Could not find trust: fa0a3cd9530d4d7584353ab2fb9ad491.: keystone.exception.TrustNotFound: Could not find trust: fa0a3cd9530d4d7584353ab2fb9ad491. Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 16:33:40.824299 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: fa0a3cd9530d4d7584353ab2fb9ad491. Oct 18 16:33:40.825906 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:40.829400 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3194/6412] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:33:40 2022] GET /identity/v3/OS-TRUST/trusts/fa0a3cd9530d4d7584353ab2fb9ad491 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:40.831315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.833075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:40.841758 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3219/6413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:40.842776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:40.856224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaed060-0f44-4d93-902c-a837ec5438f1 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:40.958053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:40.960818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:40.962448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:40.963231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:40.967637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_group(group_id=21ebe35a92f146d4b4af91cf9524a8c3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:40.971305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.010240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb377a-579c-405a-bb93-a9428988bf40 tempest-TrustsV3TestJSON-1889845926 tempest-user-1686219599] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.020275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.021125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.021410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.021678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.022339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.024391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.036456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:41.064878 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3195/6414] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:40 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:41.065981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.067904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.078200 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3220/6415] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:40 2022] DELETE /identity/v3/groups/21ebe35a92f146d4b4af91cf9524a8c3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:41.079236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.088243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:41.161799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2e56-6cc0-4313-ab3f-8f4e32c441af admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.225165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b700efd-2e52-4888-84f6-a787d76a0d0a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.235643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.236754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.236754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.237383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.238182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.240006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.242662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.243421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.243701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.243972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/a683e4a9bdc540ac9df6721455e7b221` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.245599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a683e4a9bdc540ac9df6721455e7b221)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.247604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.261614 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3221/6416] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:41 2022] GET /identity/v3/roles => generated 2813 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:41.263669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.301796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role a683e4a9bdc540ac9df6721455e7b221 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:41.302396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.303451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-594a71b3-d845-4c23-a964-150cf918524b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.306762 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3196/6417] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:41 2022] DELETE /identity/v3/roles/a683e4a9bdc540ac9df6721455e7b221 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:41.308423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.308927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.309141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.338480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:41.339768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.364824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70f30-5ff1-483b-a602-49bb9379ea0c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.482110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.483035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.483473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.483926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles/53dbd2f2c4f54a83970602717a571df6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.486656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=53dbd2f2c4f54a83970602717a571df6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.488507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.529851 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3197/6418] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:33:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:41.539909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.542036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.549219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:41.554137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 53dbd2f2c4f54a83970602717a571df6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:41.554474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.556597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.573494 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3222/6419] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:41 2022] DELETE /identity/v3/roles/53dbd2f2c4f54a83970602717a571df6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:41.575681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.579972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.620262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:41.674317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb6b5c-455b-4c3f-b7e1-28f5a3569e98 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.795322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.796053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.796334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.796597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.797303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.798943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.800502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62f14-73dc-4ac2-a449-17a01cef28fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:41.815812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:41.816560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:41.818774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:41.819150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/4303b7c6ff2847d59a89623649b95380` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:41.821562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4303b7c6ff2847d59a89623649b95380)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:41.824591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3198/6420] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:41 2022] GET /identity/v3/roles => generated 2346 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:41.825673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:41.826016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.828307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.905213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 4303b7c6ff2847d59a89623649b95380 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:41.905874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.909506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:41.916650 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3223/6421] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:41 2022] DELETE /identity/v3/roles/4303b7c6ff2847d59a89623649b95380 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:41.925827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:41.933625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:41.996836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0131b83-274d-4d5e-9c73-f4e50fa82eb0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:42.051525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:42.081889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:42.082523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.082801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.083071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.085035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b784-f1f0-47ff-8cc0-9f0af93af86a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:42.086842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.097929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:42.098760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.099161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.099546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0863ba54f0414b359db85661cd1d1c26` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.108590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0863ba54f0414b359db85661cd1d1c26)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:42.110875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:42.151186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.152527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.189359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:42.191933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:42.202182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.202821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.206431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3224/6423] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:41 2022] PATCH /identity/v3/domains/0863ba54f0414b359db85661cd1d1c26 => generated 277 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:42.207339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3199/6423] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:42.207518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:42.209057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.209735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:42.214709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.399457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:42.402026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f172-5376-453e-a22a-1e3550c1d584 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:42.455138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf701-9a17-4e19-8ee6-e9de8f4101a8 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:42.460775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:42.461787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.462141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.462419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] PATH_INFO: `/v3/projects/4368656fc2204f209c552978a2863414/users/214bec43bb354764b3db1f818efe7a66/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.496635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4368656fc2204f209c552978a2863414, user_id=214bec43bb354764b3db1f818efe7a66, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:42.498917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:42.499658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.500034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.500375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/17a48c729e3844a3996ddfe1b4b0c337` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.501150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:42.502151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=17a48c729e3844a3996ddfe1b4b0c337)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:42.504487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:42.527924 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3225/6424] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:42 2022] PUT /identity/v3/projects/4368656fc2204f209c552978a2863414/users/214bec43bb354764b3db1f818efe7a66/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:42.530924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:42.542606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.575610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:42.622757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a48c729e3844a3996ddfe1b4b0c337'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.623802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a48c729e3844a3996ddfe1b4b0c337'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.633169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a48c729e3844a3996ddfe1b4b0c337'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.633995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a48c729e3844a3996ddfe1b4b0c337'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.646340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cf7c4f92-1dd5-4ecf-8df1-95569acb438e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a48c729e3844a3996ddfe1b4b0c337'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.690400 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3200/6425] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:42 2022] DELETE /identity/v3/users/17a48c729e3844a3996ddfe1b4b0c337 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:42.692051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.692247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.692559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.720143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c719ac-6cfc-44fd-b7ad-5adf61a4927a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:42.768349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] MFA Rules not processed for user `214bec43bb354764b3db1f818efe7a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:42.770780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.894478 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3201/6426] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:42.895352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:42.896688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:42.898118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:42.901397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:42.902019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:42.902550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0863ba54f0414b359db85661cd1d1c26` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:42.932939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0863ba54f0414b359db85661cd1d1c26)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:42.932939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:42.991341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:42.999881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0863ba54f0414b359db85661cd1d1c26'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.023417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cea1d-aec2-472e-8561-e1b2bcafede5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.029211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:43.029954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.030241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.030519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.032343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a8c76eced6b4ae18836f6afbfde12e0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:43.044591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:43.099975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:43.112393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.123311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.140299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.143223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:43.168394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8c76eced6b4ae18836f6afbfde12e0', 'request_id': 'req-a9ea65e7-3988-4fff-b8cc-456d5199db90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.169607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project 0863ba54f0414b359db85661cd1d1c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:43.169987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.170686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.183628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.184406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.185100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84e001b9-d7a4-45e1-88e2-9457785befab tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0863ba54f0414b359db85661cd1d1c26', 'request_id': 'req-84e001b9-d7a4-45e1-88e2-9457785befab'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.186870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8c76eced6b4ae18836f6afbfde12e0', 'request_id': 'req-a9ea65e7-3988-4fff-b8cc-456d5199db90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.201933 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3226/6427] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:42 2022] DELETE /identity/v3/domains/0863ba54f0414b359db85661cd1d1c26 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:43.204158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.204844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.205174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.210340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8c76eced6b4ae18836f6afbfde12e0', 'request_id': 'req-a9ea65e7-3988-4fff-b8cc-456d5199db90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.229779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project 4a8c76eced6b4ae18836f6afbfde12e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:43.230091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.230775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.232970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:43.233611 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3202/6428] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:42 2022] DELETE /identity/v3/projects/4a8c76eced6b4ae18836f6afbfde12e0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:43.234840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.236604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.240415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.357655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3227/6429] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:43.359062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.365032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.394258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea65e7-3988-4fff-b8cc-456d5199db90 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.412970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:43.414333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.415238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.415666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.416485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:43.418608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:43.464808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3203/6430] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:43 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:43.464808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.466802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.499037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f92025-d923-41f6-9ceb-9132fe21d8ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.587481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27824264-e6e0-4f8a-9cd0-7415625ce7d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.593083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:43.594276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.594978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.595361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.596100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:43.598712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:43.616464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:43.617491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.618648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.619106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8/users/0f191c1cfcf248dda8459cb05c2cff59/roles/f20cfdedb28845baaea301658dad44e7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.622351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0fd21c92e8f945348b1542ba7a9ba6e8, user_id=0f191c1cfcf248dda8459cb05c2cff59, role_id=f20cfdedb28845baaea301658dad44e7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:43.626865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:43.635419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role f20cfdedb28845baaea301658dad44e7 was removed from user 0f191c1cfcf248dda8459cb05c2cff59 on domain 0fd21c92e8f945348b1542ba7a9ba6e8. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:43.635741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.636559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:43.639437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:43.644304 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3204/6431] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:33:43 2022] POST /identity/v3/projects => generated 328 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:43.650893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.655130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.665745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3228/6432] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 18 16:33:43 2022] DELETE /identity/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8/users/0f191c1cfcf248dda8459cb05c2cff59/roles/f20cfdedb28845baaea301658dad44e7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:43.666720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.676176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.735507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:43.769088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a0cf-4f6c-4a0d-9a7c-3339ec423af4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.775409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:43.776043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:43.776363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:43.776887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:43.777835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:43.786164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:43.822003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ac16-70f1-4ac6-b633-6ceaba3567a8 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:43.863345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3229/6433] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:43 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:43.869557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:43.876822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:43.999672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.001712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.002603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.003320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.007445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.029713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4329eb-3ced-433e-a5de-4269a1d84444 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.037182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.037927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.038284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.038636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.039447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.041831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.082994 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3230/6434] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:43 2022] POST /identity/v3/users => generated 416 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:44.082994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.090851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.127586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.129627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.165740 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3205/6435] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:44.166655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.197361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c52a0-6f5d-4b8e-8a2a-692016ee059b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.200316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c676-073e-4dda-90d5-2e4f9471f64d service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.205468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.206321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.206872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.207443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles/f20cfdedb28845baaea301658dad44e7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.209984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f20cfdedb28845baaea301658dad44e7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.211099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.211623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.211905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.212170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.212525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.212920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.221413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.228469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:44.244319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3206/6436] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:44 2022] GET /identity/v3/roles => generated 2111 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:44.252584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.265813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role f20cfdedb28845baaea301658dad44e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:44.266570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.267382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.276745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3231/6437] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:44 2022] DELETE /identity/v3/roles/f20cfdedb28845baaea301658dad44e7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:44.277897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.278779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207613e-6d08-4d8a-87fa-d75dbb2d894b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.280299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.383686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.384486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af901f28-275e-4c9a-9621-6e46d58df0f4 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.384669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.384844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.385255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.386177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.388150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.393589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.394648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.395158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.395752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] PATH_INFO: `/v3/projects/e2e965f9dbc44e6284d44a7167413ba7/users/a7486e3933d741bfafbf0cde3ab74ebe/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.415627 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3207/6438] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:44 2022] POST /identity/v3/roles => generated 244 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:44.417256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.419472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.427728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:44.435619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e965f9dbc44e6284d44a7167413ba7, user_id=a7486e3933d741bfafbf0cde3ab74ebe, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.444767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.484144 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3232/6439] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:44 2022] PUT /identity/v3/projects/e2e965f9dbc44e6284d44a7167413ba7/users/a7486e3933d741bfafbf0cde3ab74ebe/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:44.485906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.488474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.577092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977041a-2959-419c-8e91-4a21b7a1b64c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.659614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5439ee-2ebe-4b13-ba44-7e1bb857ce2f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:44.678859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.681048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.681337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.681640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.684671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.690544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.742457 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3233/6440] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:44 2022] POST /identity/v3/roles => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:44.743522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.754818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:44.755541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:44.755831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:44.756131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:44.762513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0fd21c92e8f945348b1542ba7a9ba6e8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:44.773083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:44.827984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.830603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.905431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.906156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:44.909680 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3208/6441] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:44 2022] PATCH /identity/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8 => generated 277 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:44.910718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:44.914559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:44.914942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:44.923863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa425d6-1f27-4c0e-b68c-3d1eb5f7be31 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.025734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.026605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.026978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.027383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.028331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.032311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f11c0c-9db6-4a56-8d20-b09f414cd5fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.063988 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3234/6442] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:44 2022] GET /identity/v3/roles => generated 2353 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:45.067443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.067443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.067443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.077895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45907d4-3a6e-403e-87b0-c6f00be6b872 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.083995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.084731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.085035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.085329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/e41fa2831dde492ca3c177bda4336f03/users/b7a4439871de41c2b25c2db8349ba11a/roles/5295209717134f0dae7dd9a131da1fa2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.103514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e41fa2831dde492ca3c177bda4336f03, user_id=b7a4439871de41c2b25c2db8349ba11a, role_id=5295209717134f0dae7dd9a131da1fa2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.106406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.118412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:45.119839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:45.127022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.132127 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3209/6443] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:44 2022] PUT /identity/v3/projects/e41fa2831dde492ca3c177bda4336f03/users/b7a4439871de41c2b25c2db8349ba11a/roles/5295209717134f0dae7dd9a131da1fa2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:45.136596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:45.142210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.283208 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3235/6444] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:45.283928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:45.300716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.334831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a434b-b316-4b12-9add-188fb492d75c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.343185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.344883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.345299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.345877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.373014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0fd21c92e8f945348b1542ba7a9ba6e8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.376363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.442231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196eab2-fb2e-4f83-9c4e-7989cb1b2815 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.444563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.448749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.449940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.450230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.450547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.451813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] PATH_INFO: `/v3/projects/e2e965f9dbc44e6284d44a7167413ba7/users/a7486e3933d741bfafbf0cde3ab74ebe/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.458023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e965f9dbc44e6284d44a7167413ba7, user_id=a7486e3933d741bfafbf0cde3ab74ebe, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.460712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.480776 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3236/6445] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:45 2022] PUT /identity/v3/projects/e2e965f9dbc44e6284d44a7167413ba7/users/a7486e3933d741bfafbf0cde3ab74ebe/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:45.481725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:45.557424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.569066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:45.573471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.589923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.622723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ad823-d7dc-443d-a23f-2668c5083b6c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.625188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project 0fd21c92e8f945348b1542ba7a9ba6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:45.627825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.628742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.638672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.639407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.643953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0fd21c92e8f945348b1542ba7a9ba6e8', 'request_id': 'req-660064b2-3328-4b21-a992-8009c0233b87'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:45.650581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3210/6446] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:45 2022] DELETE /identity/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:45.651658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:45.653380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.713798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:45.760695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660064b2-3328-4b21-a992-8009c0233b87 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:45.767986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.768707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.768963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.769348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.771280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.774142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:45.774840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.775120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.775398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/e41fa2831dde492ca3c177bda4336f03/users/b7a4439871de41c2b25c2db8349ba11a/roles/aec89c797ec148018dc94e56d11cf4ee` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.777695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e41fa2831dde492ca3c177bda4336f03, user_id=b7a4439871de41c2b25c2db8349ba11a, role_id=aec89c797ec148018dc94e56d11cf4ee)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.780360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c9e27-7878-4a6d-9ff5-813f750d1dd7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.809250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3237/6447] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:45 2022] PUT /identity/v3/projects/e41fa2831dde492ca3c177bda4336f03/users/b7a4439871de41c2b25c2db8349ba11a/roles/aec89c797ec148018dc94e56d11cf4ee => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:45.810979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:45.811263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:45.811535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:45.858081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] MFA Rules not processed for user `a7486e3933d741bfafbf0cde3ab74ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:45.861104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:45.864515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:45.866465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:45.881845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3211/6448] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:45.883079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:45.886743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.019098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb46452-5952-488a-88e6-ea9fbc250828 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:46.108153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3238/6449] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:46.110638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:46.119735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.205039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:46.208167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.208475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.208670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/9f20190ac54945a4875c687d3cde9c5c/groups/bf371b604e53475aaf940ec8c075220a/roles/0bd683a2c68d436e9930890c9194c1bd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.217345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9f20190ac54945a4875c687d3cde9c5c, group_id=bf371b604e53475aaf940ec8c075220a, role_id=0bd683a2c68d436e9930890c9194c1bd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:46.230107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:46.237634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 0bd683a2c68d436e9930890c9194c1bd was removed from group bf371b604e53475aaf940ec8c075220a on domain 9f20190ac54945a4875c687d3cde9c5c. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:46.238074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:46.239195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:46.269742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3212/6450] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:33:45 2022] DELETE /identity/v3/domains/9f20190ac54945a4875c687d3cde9c5c/groups/bf371b604e53475aaf940ec8c075220a/roles/0bd683a2c68d436e9930890c9194c1bd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:46.271509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:46.273420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.318744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:46.367991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9223-8ff1-40c5-b9d3-e30e87d514ad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:46.402414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:46.464391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefdafa-0ba7-4e54-9af5-dfbaf0cd3f39 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:46.475039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:46.478440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.478726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.478999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.481838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.546625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:46.548449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.548808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.549221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.550635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:46.553206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390499d-4b4d-4460-bd2a-1e0d2f13ce87 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:46.625342 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3239/6451] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:46 2022] GET /identity/v3/users => generated 9173 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:46.627663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbd88-3b1c-4964-adf3-2e7b8fc5517f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.627947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbd88-3b1c-4964-adf3-2e7b8fc5517f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.628403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbd88-3b1c-4964-adf3-2e7b8fc5517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.657441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:46.660109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:46.664176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-df7cbd88-3b1c-4964-adf3-2e7b8fc5517f None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:46.666834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df7cbd88-3b1c-4964-adf3-2e7b8fc5517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.685251 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3213/6452] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:46.686826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:46.699830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.804709 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3240/6453] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:46.809331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.809331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.809331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.915210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] MFA Rules not processed for user `b7a4439871de41c2b25c2db8349ba11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:46.916518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:46.918798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d8f7f-e975-463c-95e1-e076f97b52a8 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:46.935473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:46.936220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:46.936518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:46.936795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/bf371b604e53475aaf940ec8c075220a/users/0f191c1cfcf248dda8459cb05c2cff59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:46.941256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=bf371b604e53475aaf940ec8c075220a, user_id=0f191c1cfcf248dda8459cb05c2cff59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:46.943202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:46.973185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:47.005968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3214/6454] 10.222.0.78 () {58 vars in 1344 bytes} [Tue Oct 18 16:33:46 2022] DELETE /identity/v3/groups/bf371b604e53475aaf940ec8c075220a/users/0f191c1cfcf248dda8459cb05c2cff59 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:47.008001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.010927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:47.155140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3241/6455] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:47.156814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.171992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c6086-d1ed-4dbc-a565-8920c7f3b892 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:47.182475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:47.228715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:47.247130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f37ea-c5ca-4fc8-83f2-060cdeddd0d7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:47.261508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:47.262987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:47.264165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:47.264966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:47.287663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:47.288499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:47.289025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:47.289435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/groups/bf371b604e53475aaf940ec8c075220a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:47.290956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_group(group_id=bf371b604e53475aaf940ec8c075220a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:47.295871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1e2c9-2991-4151-aa88-27faab6d65b6 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:47.420107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3242/6456] 10.222.0.78 () {58 vars in 1227 bytes} [Tue Oct 18 16:33:47 2022] DELETE /identity/v3/groups/bf371b604e53475aaf940ec8c075220a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:47.424392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:47.424684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:47.425663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:47.444724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:47.449280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:47.476376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] MFA Rules not processed for user `b7a4439871de41c2b25c2db8349ba11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:47.477820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:47.478555 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3215/6457] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:47.480491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.525672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543db40c-ea50-4dc3-9a6e-b222bfc6aa3b service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:47.569687 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3243/6458] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:47.570742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.648348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:47.649446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:47.649730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:47.650050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles/0bd683a2c68d436e9930890c9194c1bd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:47.652682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0bd683a2c68d436e9930890c9194c1bd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:47.654615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:47.738070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 0bd683a2c68d436e9930890c9194c1bd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:47.738633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:47.740126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:47.756900 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3216/6459] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:47 2022] DELETE /identity/v3/roles/0bd683a2c68d436e9930890c9194c1bd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:47.765027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.770626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:47.795310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd8a31-2374-4066-bb72-0e0cb3f8265a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:47.889708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:47.925805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7486e3933d741bfafbf0cde3ab74ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e965f9dbc44e6284d44a7167413ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:47.929242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:47.929570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:47.929854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:47.930549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:47.930860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:47.943185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:47.970041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3244/6460] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:47.971372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:47.973178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:47.998434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dc6b9-7c83-449c-91a7-ffa0a1b7ae17 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.010680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.011852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.012834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.013394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.014849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:create_trust()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.020317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de23154-c49a-4d43-b034-a2518ccafd31 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.030702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:48.100572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444de290-2ab6-4ab4-8b3f-6a84626cd715 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.107325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.108800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.110846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.111441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/9f20190ac54945a4875c687d3cde9c5c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.114852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9f20190ac54945a4875c687d3cde9c5c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.118454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.200098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.201850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.244553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.245223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.250350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3245/6461] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:47 2022] PATCH /identity/v3/domains/9f20190ac54945a4875c687d3cde9c5c => generated 278 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:48.251643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:48.253908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:48.258468 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3217/6462] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:33:47 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:48.260143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.260433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.260707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.306082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:48.314419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:48.356404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903574f-9098-4b34-a028-96b2d506c1f1 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.368730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7486e3933d741bfafbf0cde3ab74ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e965f9dbc44e6284d44a7167413ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.369488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.369835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.370911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.371639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.374474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.396203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3218/6463] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:48.397632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:48.399933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:48.423562 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3246/6464] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:48 2022] POST /identity/v3/projects => generated 354 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:48.424846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:48.427345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:48.481512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:48.525654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d78e3-420a-40df-9662-c0a672bf7b65 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.533376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.533975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4443f-cb0a-4caa-bc2c-7e8ced4f9688 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.534435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.534435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.534631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.544265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:get_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.545851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.557164 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3247/6465] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:33:48 2022] GET /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d => generated 859 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:48.557973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:48.562801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:48.600890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:48.634884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.636390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.636519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.636750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/9f20190ac54945a4875c687d3cde9c5c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.665312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9f20190ac54945a4875c687d3cde9c5c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.666402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bda62-55e4-4a42-b507-5ad534930242 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.667010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.676501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:48.677193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:48.677476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:48.677753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:48.733236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.746661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.785823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:48.790686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:48.809160 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3248/6466] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:48.811336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:48.866522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.888041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.912202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.929951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb73cea-fd6e-4b93-9eb2-cbd0f6eec834 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:48.946086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project 9f20190ac54945a4875c687d3cde9c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:48.946465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.947864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.968474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.970108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.977777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9f20190ac54945a4875c687d3cde9c5c', 'request_id': 'req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:48.988632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:48.996831 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3219/6467] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:48 2022] DELETE /identity/v3/domains/9f20190ac54945a4875c687d3cde9c5c => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:48.997829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.004618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.182516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7486e3933d741bfafbf0cde3ab74ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e965f9dbc44e6284d44a7167413ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.185069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.185796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.186540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.187439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:49.188720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.191103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.217820 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3249/6468] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:49.219003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.222002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.239063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc2e7-bf7e-4d8c-a51a-e4a27b0cb890 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.263540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.265224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.265515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.265836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.300827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.304639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b9697-9c4a-4521-a980-71409713b48a tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.330818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3220/6469] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:33:48 2022] GET /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles => generated 371 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:49.332153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.332480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.336612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.342585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b54ef7-e781-4dee-af88-13fcbcb3a32d tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.351235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.353326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.355146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.355696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0133f022d62f4baa8529441962330bc9/users/0f191c1cfcf248dda8459cb05c2cff59/roles/8c7326fd362549f5b90f041c4f1aa5d1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.358852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0133f022d62f4baa8529441962330bc9, user_id=0f191c1cfcf248dda8459cb05c2cff59, role_id=8c7326fd362549f5b90f041c4f1aa5d1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.362953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.372293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 8c7326fd362549f5b90f041c4f1aa5d1 was removed from user 0f191c1cfcf248dda8459cb05c2cff59 on domain 0133f022d62f4baa8529441962330bc9. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:49.372585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.373352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.376364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:49.378593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.396555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3250/6470] 10.222.0.78 () {58 vars in 1464 bytes} [Tue Oct 18 16:33:49 2022] DELETE /identity/v3/domains/0133f022d62f4baa8529441962330bc9/users/0f191c1cfcf248dda8459cb05c2cff59/roles/8c7326fd362549f5b90f041c4f1aa5d1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:49.396555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.398915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.408346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:49.481684 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3221/6471] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:49.483067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.485860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.535244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4b421-e6ab-4f6b-b6a8-f12fb506558c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.582219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1206f-745c-4cec-8757-0870b1fe9963 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.588009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7486e3933d741bfafbf0cde3ab74ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e965f9dbc44e6284d44a7167413ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.588985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.589483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.589922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] PATH_INFO: `/v3/projects/18a53bc83b224edab9817c93b84b0268` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.593659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=18a53bc83b224edab9817c93b84b0268)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.600129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.647773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.648489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.648837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.649151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/5295209717134f0dae7dd9a131da1fa2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.659081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d, role_id=5295209717134f0dae7dd9a131da1fa2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.661326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.674119 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3222/6472] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:33:49 2022] GET /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/5295209717134f0dae7dd9a131da1fa2 => generated 244 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:49.675131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.679232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.724028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:49.739116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a53bc83b224edab9817c93b84b0268', 'request_id': 'req-f41baf72-b21d-4b54-928d-2155c3a4b4a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.774027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a53bc83b224edab9817c93b84b0268', 'request_id': 'req-f41baf72-b21d-4b54-928d-2155c3a4b4a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.780620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a53bc83b224edab9817c93b84b0268', 'request_id': 'req-f41baf72-b21d-4b54-928d-2155c3a4b4a4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.800891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] The token cache is being invalidate because project 18a53bc83b224edab9817c93b84b0268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:49.801222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.801954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:49.804093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3251/6473] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:49 2022] DELETE /identity/v3/projects/18a53bc83b224edab9817c93b84b0268 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:49.804941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:49.806420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.812854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8234d89-360d-44ca-afce-7c62e36ef0d0 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.916651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41baf72-b21d-4b54-928d-2155c3a4b4a4 tempest-VolumeQuotaClassesTest-1665039355 tempest-VolumeQuotaClassesTest-1665039355-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:49.927799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.935095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.935095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.935095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.939736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:49.945357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:49.946161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:49.947378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:49.948222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles/8c7326fd362549f5b90f041c4f1aa5d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:49.951272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8c7326fd362549f5b90f041c4f1aa5d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:49.956634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:49.973351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:50.043961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.047512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:50.059464 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3252/6474] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:33:50.061497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.063492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role 8c7326fd362549f5b90f041c4f1aa5d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:50.063799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.064715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.065481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.075376 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3223/6475] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:49 2022] DELETE /identity/v3/roles/8c7326fd362549f5b90f041c4f1aa5d1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:50.075829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.080461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.255255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635853-1e47-457f-af52-6a3a2f573a96 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:50.261456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:50.262140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:50.262423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:50.262707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0133f022d62f4baa8529441962330bc9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:50.264244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0133f022d62f4baa8529441962330bc9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.267106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:50.285192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1bad2-c2fd-4990-bb4b-55c5c207b4c1 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:50.305136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.305962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.339883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:50.364489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.365361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.373657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3224/6476] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:50 2022] PATCH /identity/v3/domains/0133f022d62f4baa8529441962330bc9 => generated 278 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:50.374793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.378360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.413556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:50.414839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:50.415332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:50.416010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/5295209717134f0dae7dd9a131da1fa2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:50.425600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d, role_id=5295209717134f0dae7dd9a131da1fa2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.428539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:50.442599 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3253/6477] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:33:50 2022] HEAD /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/5295209717134f0dae7dd9a131da1fa2 => generated 0 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 16:33:50.444054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.446912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.476759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451148-41e7-4375-8e55-9e888c4152c9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:50.486965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:50.487539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:50.487817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:50.488077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] PATH_INFO: `/v3/users/214bec43bb354764b3db1f818efe7a66` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:50.493041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] RBAC: Authorizing `identity:delete_user(user_id=214bec43bb354764b3db1f818efe7a66)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.495617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:50.594988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:UPDATE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:50.619629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214bec43bb354764b3db1f818efe7a66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.620739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214bec43bb354764b3db1f818efe7a66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.637968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561f3e-4d5e-4d07-8a54-10fc22d21583 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:50.639306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214bec43bb354764b3db1f818efe7a66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.640140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214bec43bb354764b3db1f818efe7a66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.648771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:50.649908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:50.651139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:50.652026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] PATH_INFO: `/v3/users/e6ab6896fefb464b8932b5616a24f23f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:50.655314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ab6896fefb464b8932b5616a24f23f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.661378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214bec43bb354764b3db1f818efe7a66'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.662907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:50.694520 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3225/6478] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:50 2022] DELETE /identity/v3/users/214bec43bb354764b3db1f818efe7a66 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:50.695363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.701110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.769548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ab6896fefb464b8932b5616a24f23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.787057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ab6896fefb464b8932b5616a24f23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.787807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ab6896fefb464b8932b5616a24f23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.799135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ab6896fefb464b8932b5616a24f23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.800453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ab6896fefb464b8932b5616a24f23f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:50.861202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99028cb7-14e8-4d67-bc9d-7df8dd8e068c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:50.868067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3254/6479] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:50 2022] DELETE /identity/v3/users/e6ab6896fefb464b8932b5616a24f23f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:50.873771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:50.886344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:50.957361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:50.966662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:50.967319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:50.967599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:50.967874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0133f022d62f4baa8529441962330bc9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:50.992036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0133f022d62f4baa8529441962330bc9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:50.993712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.014329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d09a89-ba65-4f52-95ca-88685fcb66ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.022591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.023697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.024171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.024650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/aec89c797ec148018dc94e56d11cf4ee` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.041266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.041520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d, role_id=aec89c797ec148018dc94e56d11cf4ee)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.043720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.052843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0133f022d62f4baa8529441962330bc9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-90f83fed-86e9-421f-8e55-5c17005f4467 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Could not find role: aec89c797ec148018dc94e56d11cf4ee.: keystone.exception.RoleNotFound: Could not find role: aec89c797ec148018dc94e56d11cf4ee. Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:33:51.059378 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: aec89c797ec148018dc94e56d11cf4ee. Oct 18 16:33:51.060666 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:51.064649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3255/6480] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:33:50 2022] GET /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/aec89c797ec148018dc94e56d11cf4ee => generated 110 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:51.066068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37df47-62d1-43af-b61f-8a0ecc390c31 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.066347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37df47-62d1-43af-b61f-8a0ecc390c31 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.066611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37df47-62d1-43af-b61f-8a0ecc390c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.111785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4b37df47-62d1-43af-b61f-8a0ecc390c31 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:51.113409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4b37df47-62d1-43af-b61f-8a0ecc390c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.125672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:51.155271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.174322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.190772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.213913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project 0133f022d62f4baa8529441962330bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:51.214200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.218102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.239455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.241683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.257308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0133f022d62f4baa8529441962330bc9', 'request_id': 'req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.263879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3256/6481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:51.265306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.265531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.265943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.293027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:51.294339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3226/6482] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Oct 18 16:33:50 2022] DELETE /identity/v3/domains/0133f022d62f4baa8529441962330bc9 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:51.299445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.299641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.304763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.405591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5eed5-31e4-4651-b4e0-6c0da5a8f486 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.411412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.412880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.413438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.413836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/aec89c797ec148018dc94e56d11cf4ee` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.428929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d, role_id=aec89c797ec148018dc94e56d11cf4ee)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.429642 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3257/6483] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:51.430590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.430858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.435333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Could not find role: aec89c797ec148018dc94e56d11cf4ee.: keystone.exception.RoleNotFound: Could not find role: aec89c797ec148018dc94e56d11cf4ee. Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:33:51.453400 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: aec89c797ec148018dc94e56d11cf4ee. Oct 18 16:33:51.454639 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:51.458957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3227/6484] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:33:51 2022] HEAD /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d/roles/aec89c797ec148018dc94e56d11cf4ee => generated 0 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 18 16:33:51.458957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.462316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.556266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec7fa-0f48-444a-89fc-3b2e09570488 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.571568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.572343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.572632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.574306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.574306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.578295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.584628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f78c0-c3a7-487d-a320-3968d5df7215 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.592065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.593264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.593700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.594922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.597352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.600924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3228/6485] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:51 2022] GET /identity/v3/roles => generated 1893 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:51.602184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.621436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.623430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.636468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359ac6-8e9f-4a35-ba05-44cfefbc1be9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.637503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3258/6486] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:51.638422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.654227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.654984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.655264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.655538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.658047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c9016-31aa-401c-99d5-d483e369c7ae service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.662670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.663394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.663671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.663941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.673837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:51.677055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.679171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorizing `identity:delete_trust(trust_id=e8fd4149de9e479eaa58fac6dde94a9d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.679505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.681897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.707068 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3229/6487] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:51.708155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.735695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199226-5b39-4424-ae79-cd90eca399de service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.742197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.743149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.743434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.743717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/9a4c0a809df846398556e284ae0813c2/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.751076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e8fd4149de9e479eaa58fac6dde94a9d', 'request_id': 'req-fe7bae42-537c-4210-b7e1-c612482caca3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.759751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a4c0a809df846398556e284ae0813c2, user_id=79f89efaf40442a1994a3919c3fa5967, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:51.765048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e8fd4149de9e479eaa58fac6dde94a9d', 'request_id': 'req-fe7bae42-537c-4210-b7e1-c612482caca3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.765905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e8fd4149de9e479eaa58fac6dde94a9d', 'request_id': 'req-fe7bae42-537c-4210-b7e1-c612482caca3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:51.776253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:51.779050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3259/6488] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:33:51 2022] DELETE /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:51.783808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.787906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.815461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bae42-537c-4210-b7e1-c612482caca3 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:51.840396 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3230/6489] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:51 2022] PUT /identity/v3/projects/9a4c0a809df846398556e284ae0813c2/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:51.847017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:51.853471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:51.876952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:51.970499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a4439871de41c2b25c2db8349ba11a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e41fa2831dde492ca3c177bda4336f03', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1961867664', 'tempest-NotDelegatedRole-1321576614'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:51.971178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:51.971457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:51.971731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] PATH_INFO: `/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Could not find trust: e8fd4149de9e479eaa58fac6dde94a9d.: keystone.exception.TrustNotFound: Could not find trust: e8fd4149de9e479eaa58fac6dde94a9d. Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 16:33:51.991906 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e8fd4149de9e479eaa58fac6dde94a9d. Oct 18 16:33:51.992944 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:51.995267 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3260/6490] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:33:51 2022] GET /identity/v3/OS-TRUST/trusts/e8fd4149de9e479eaa58fac6dde94a9d => generated 111 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:51.999636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.007522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:52.085865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e788a74-1b46-4465-95c4-73fc909a7561 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.090835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.091456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.091735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.092010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.092740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.093904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.190019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77669f-d1a8-4487-aabb-b18aa6b9d487 tempest-TrustsV3TestJSON-845978326 tempest-user-1525417618] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.194516 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3231/6491] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Oct 18 16:33:51 2022] GET /identity/v3/auth/projects => generated 826 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:52.199142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.199919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.200631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.200973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.201336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/aec89c797ec148018dc94e56d11cf4ee` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.203547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aec89c797ec148018dc94e56d11cf4ee)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.208495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.216894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aeb1d-74af-42c4-9c3a-3e9c11f5a437 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.232138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.233138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.233445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.233759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/9a4c0a809df846398556e284ae0813c2/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.239615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9a4c0a809df846398556e284ae0813c2, user_id=79f89efaf40442a1994a3919c3fa5967, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.244154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.251857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role eb5fc6b45679476182540fe032952925 was removed from user 79f89efaf40442a1994a3919c3fa5967 on project 9a4c0a809df846398556e284ae0813c2. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:52.252974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.255297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.299025 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3232/6492] 10.222.0.78 () {58 vars in 1467 bytes} [Tue Oct 18 16:33:52 2022] DELETE /identity/v3/projects/9a4c0a809df846398556e284ae0813c2/users/79f89efaf40442a1994a3919c3fa5967/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:52.300013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.303497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:52.304762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role aec89c797ec148018dc94e56d11cf4ee has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:52.305087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.305766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.313850 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3261/6493] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:51 2022] DELETE /identity/v3/roles/aec89c797ec148018dc94e56d11cf4ee => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:52.317511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.320832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:52.446814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:52.476346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213027c-0d56-44c2-9bbc-944199c93c6a tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.496539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483455ee-38c4-4126-b42b-22f200f23b09 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.508347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.508935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.510274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.512294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/5295209717134f0dae7dd9a131da1fa2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.514485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5295209717134f0dae7dd9a131da1fa2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.519824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.618305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 5295209717134f0dae7dd9a131da1fa2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:52.618574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.619947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.627571 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3262/6494] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:52 2022] DELETE /identity/v3/roles/5295209717134f0dae7dd9a131da1fa2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:52.630564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:52.631404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.635088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:52.650728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.654397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.654742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.654951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.657032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.662760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.729655 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3233/6495] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:52 2022] POST /identity/v3/users => generated 321 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:52.731813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:52.737513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:52.774906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217da61-9806-4f6f-8f8d-6450ee6043af tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.824774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e7b47-1aa9-49d5-b778-28c63c4d8c40 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:52.836461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.837172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.838040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.839678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/b7a4439871de41c2b25c2db8349ba11a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.842399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b7a4439871de41c2b25c2db8349ba11a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.846742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.935387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:52.936216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:52.936529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:52.936824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:52.938179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:52.942110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:52.959579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a4439871de41c2b25c2db8349ba11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.973692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a4439871de41c2b25c2db8349ba11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.975301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a4439871de41c2b25c2db8349ba11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:52.998797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a4439871de41c2b25c2db8349ba11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.002590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a4439871de41c2b25c2db8349ba11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.032388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3234/6496] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:52 2022] POST /identity/v3/projects => generated 363 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:53.033390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.049348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.061636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3263/6497] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:52 2022] DELETE /identity/v3/users/b7a4439871de41c2b25c2db8349ba11a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:53.064963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.076071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.165023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:53.193921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121074-85a1-4bd5-85d7-c3d6257f5af0 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:53.294182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:53.295079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:53.295530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e404-40db-4571-845f-8848d9642c8f tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:53.295869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:53.296271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:53.297965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:53.305431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:53.318127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:53.320231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:53.320510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:53.322535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/e41fa2831dde492ca3c177bda4336f03` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:53.324617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e41fa2831dde492ca3c177bda4336f03)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:53.326210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:53.380913 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3235/6498] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:53 2022] POST /identity/v3/projects => generated 363 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:53.382045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.383916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.401553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:53.466488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41fa2831dde492ca3c177bda4336f03', 'request_id': 'req-db8ed387-16b1-4ed9-ac02-41c678168347'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.501414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41fa2831dde492ca3c177bda4336f03', 'request_id': 'req-db8ed387-16b1-4ed9-ac02-41c678168347'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.525970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41fa2831dde492ca3c177bda4336f03', 'request_id': 'req-db8ed387-16b1-4ed9-ac02-41c678168347'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.554133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project e41fa2831dde492ca3c177bda4336f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:53.554418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.557444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.559777 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3264/6499] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:53 2022] DELETE /identity/v3/projects/e41fa2831dde492ca3c177bda4336f03 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:53.560731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.566568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.582715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fbab-8987-4d9c-83ab-462148747f26 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:53.699289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ed387-16b1-4ed9-ac02-41c678168347 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:53.704920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:53.705801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:53.706010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:53.706283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] PATH_INFO: `/v3/projects/3bbf9c0633b549b39197862c060d3481` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:53.707700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbf9c0633b549b39197862c060d3481)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:53.709645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:53.721371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:53.725740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:53.727163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:53.727743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] PATH_INFO: `/v3/projects/4368656fc2204f209c552978a2863414` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:53.729136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4368656fc2204f209c552978a2863414)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:53.731280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:53.801476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbf9c0633b549b39197862c060d3481', 'request_id': 'req-7076bbc4-8212-4d78-81a0-1208c7247ffc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.814197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbf9c0633b549b39197862c060d3481', 'request_id': 'req-7076bbc4-8212-4d78-81a0-1208c7247ffc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.817369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:53.821351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4368656fc2204f209c552978a2863414', 'request_id': 'req-dbbb1979-8885-404a-b41e-a6f7320c7a1b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.835950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbf9c0633b549b39197862c060d3481', 'request_id': 'req-7076bbc4-8212-4d78-81a0-1208c7247ffc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.837385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4368656fc2204f209c552978a2863414', 'request_id': 'req-dbbb1979-8885-404a-b41e-a6f7320c7a1b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.848149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4368656fc2204f209c552978a2863414', 'request_id': 'req-dbbb1979-8885-404a-b41e-a6f7320c7a1b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.865492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] The token cache is being invalidate because project 4368656fc2204f209c552978a2863414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:53.866363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.866670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] The token cache is being invalidate because project 3bbf9c0633b549b39197862c060d3481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:53.867125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.867798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.868473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:53.870608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3265/6500] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:53 2022] DELETE /identity/v3/projects/3bbf9c0633b549b39197862c060d3481 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:53.871407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.876049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.876276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3236/6501] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:53 2022] DELETE /identity/v3/projects/4368656fc2204f209c552978a2863414 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:53.876276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:53.882616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:53.982464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:53.983385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076bbc4-8212-4d78-81a0-1208c7247ffc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:54.072949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1979-8885-404a-b41e-a6f7320c7a1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:54.099844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:54.100180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.100462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.100734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.101393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:54.103305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:54.172360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:54.174019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.174613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.178111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.179755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:54.190230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c2cc7-32b8-40a9-b7ca-c38ec85ef436 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:54.213077 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3237/6502] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:33:53 2022] POST /identity/v3/projects => generated 328 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:54.213077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:54.223272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:54.252558 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3266/6503] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:53 2022] POST /identity/v3/roles => generated 240 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:54.258494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.259942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.261581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.311642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7afdc-8d81-4d42-ab34-f8a4b013491e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:54.319187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:54.319399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:54.320341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:54.320599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.320904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.321244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] PATH_INFO: `/v3/users/a7486e3933d741bfafbf0cde3ab74ebe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.322566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7486e3933d741bfafbf0cde3ab74ebe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:54.324610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:54.334725 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3267/6504] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:54.335966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:54.472788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7486e3933d741bfafbf0cde3ab74ebe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:54.476769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7486e3933d741bfafbf0cde3ab74ebe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:54.507552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7486e3933d741bfafbf0cde3ab74ebe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:54.508770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7486e3933d741bfafbf0cde3ab74ebe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:54.539691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7486e3933d741bfafbf0cde3ab74ebe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:54.555081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b77da-557b-4afa-9126-5742cfc3b7aa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:54.572219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:54.573183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.573747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.574576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.575738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:54.582323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd178e-a206-484c-a9ce-567a895634ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:54.604071 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3238/6505] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:54 2022] DELETE /identity/v3/users/a7486e3933d741bfafbf0cde3ab74ebe => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:54.608451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:54.615714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:54.680922 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3268/6506] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:54 2022] POST /identity/v3/users => generated 416 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:54.701523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.702087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.710605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:54.763457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:54.776574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:54.783830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:54.819702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:54.894575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454b84-a956-4557-bd3a-a11764102c37 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:54.913418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:54.914717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:54.915419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:54.921106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/d5b4ac47f85b4a5c8e64fa6ae9bd7c53/users/81476d7c265345e1b836a2c72174a47b/roles/e0bef549f37a408ca5bf9ae26ad8cb18` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.010451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5b4ac47f85b4a5c8e64fa6ae9bd7c53, user_id=81476d7c265345e1b836a2c72174a47b, role_id=e0bef549f37a408ca5bf9ae26ad8cb18)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.021333 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3269/6507] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:55.024116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.027780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.028420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.064129 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3239/6508] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:54 2022] PUT /identity/v3/projects/d5b4ac47f85b4a5c8e64fa6ae9bd7c53/users/81476d7c265345e1b836a2c72174a47b/roles/e0bef549f37a408ca5bf9ae26ad8cb18 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:55.065644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.162890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b750-6222-4852-92d1-10b893ddee5e tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.167894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.168908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.169365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.170068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.170726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:55.171027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.173827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.195766 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3240/6509] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:55.197780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.206405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356460c-ab64-4a83-bb4f-94c126356879 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.307252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9fdc-0de6-478d-966d-3ba92ab8eb1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.312161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.313665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.314305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.314788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.315899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.318367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.323224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.324605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.324888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.325687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/111ea3d65ec9414786655ee9bdabed37/users/81476d7c265345e1b836a2c72174a47b/roles/e0bef549f37a408ca5bf9ae26ad8cb18` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.329469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=111ea3d65ec9414786655ee9bdabed37, user_id=81476d7c265345e1b836a2c72174a47b, role_id=e0bef549f37a408ca5bf9ae26ad8cb18)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.333297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.342341 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3270/6510] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/roles => generated 244 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:55.342341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.356660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a933c4c-17fe-4c0c-927a-9808ac689fd3 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.364560 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3241/6511] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:55 2022] PUT /identity/v3/projects/111ea3d65ec9414786655ee9bdabed37/users/81476d7c265345e1b836a2c72174a47b/roles/e0bef549f37a408ca5bf9ae26ad8cb18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:55.364560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.365325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.431447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:55.457955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.458774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.459140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.459485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.460190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.462402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.485693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:55.495314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d3d2e-58a3-4756-9561-903883aba2fe tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.502003 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3271/6512] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:55.502167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.503095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.503432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.503769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] PATH_INFO: `/v3/projects/e2e965f9dbc44e6284d44a7167413ba7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.505561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e965f9dbc44e6284d44a7167413ba7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.506202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.507745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.597163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb76b4-36b5-42a7-a069-73c1a075e28a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.597968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e965f9dbc44e6284d44a7167413ba7', 'request_id': 'req-24600a1a-bfb6-4345-ac7a-3592d053d1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:55.611258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e965f9dbc44e6284d44a7167413ba7', 'request_id': 'req-24600a1a-bfb6-4345-ac7a-3592d053d1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:55.620385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e965f9dbc44e6284d44a7167413ba7', 'request_id': 'req-24600a1a-bfb6-4345-ac7a-3592d053d1a3'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:55.646744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] The token cache is being invalidate because project e2e965f9dbc44e6284d44a7167413ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:55.647169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:55.648302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-24600a1a-bfb6-4345-ac7a-3592d053d1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:55.650202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3242/6513] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:55 2022] DELETE /identity/v3/projects/e2e965f9dbc44e6284d44a7167413ba7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:55.655244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.655594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.655949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.693978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] MFA Rules not processed for user `81476d7c265345e1b836a2c72174a47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:55.694845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.704060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3243/6514] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:33:55.706439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.706602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.707470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.707751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.708027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.709366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.709835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.713678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b8f76-62b3-4626-8cc7-9153005a37ad tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.747104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3272/6515] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/roles => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:55.748384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab58-00f4-440d-a61f-ba2bf8be62e6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.748666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab58-00f4-440d-a61f-ba2bf8be62e6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.748937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ab58-00f4-440d-a61f-ba2bf8be62e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.794252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d1f0ab58-00f4-440d-a61f-ba2bf8be62e6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:55.796550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1f0ab58-00f4-440d-a61f-ba2bf8be62e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.889673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e54b8a-1017-4d54-b6f0-e00db1b46f3d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:55.891998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3273/6516] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:55.893533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.894300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.894918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.902635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:55.903272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:55.904467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:55.904749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:55.906681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:55.914593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:55.915611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] MFA Rules not processed for user `81476d7c265345e1b836a2c72174a47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:55.917310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:55.960754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:55.965615 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3244/6517] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:55.971021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:55.979050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:56.003190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb6ac5-f349-41f6-8723-d99f94379c1b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.008790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.009950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.010449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.010978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9361713718ad435f968c60f8707d5399/users/42ffe35c0d0c44f08dcd4ea9849848a9/roles/1e6396aff17847f490a1044e3bddd1eb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.040256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9361713718ad435f968c60f8707d5399, user_id=42ffe35c0d0c44f08dcd4ea9849848a9, role_id=1e6396aff17847f490a1044e3bddd1eb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.043639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1afe-dd66-474d-935e-128fb09ddec0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.064062 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3245/6518] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:55 2022] PUT /identity/v3/projects/9361713718ad435f968c60f8707d5399/users/42ffe35c0d0c44f08dcd4ea9849848a9/roles/1e6396aff17847f490a1044e3bddd1eb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:56.065860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3274/6519] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 16:33:56.067236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.067773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.068258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.071674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.096836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:56.098626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:56.104385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e485fd-6704-4469-829f-06b7ff98a452 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.162330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:56.213620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.214201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.214537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.214793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.215730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.218436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.224303 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3246/6520] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:56.227590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.235878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3275/6521] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:56 2022] GET /identity/v3/roles => generated 2123 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:56.236936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.239910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:56.375781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02480-44cf-4235-9951-79a2bc440205 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.383524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.385634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.385923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.387214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b34494-b3a1-44ca-9c21-c4d96bac7e89 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.387561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9361713718ad435f968c60f8707d5399/users/42ffe35c0d0c44f08dcd4ea9849848a9/roles/66ab0432d87a477a94c59cd8d800d99c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.392875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9361713718ad435f968c60f8707d5399, user_id=42ffe35c0d0c44f08dcd4ea9849848a9, role_id=66ab0432d87a477a94c59cd8d800d99c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.394357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.395202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.395641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.396093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.397976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.429495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3247/6522] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:56 2022] PUT /identity/v3/projects/9361713718ad435f968c60f8707d5399/users/42ffe35c0d0c44f08dcd4ea9849848a9/roles/66ab0432d87a477a94c59cd8d800d99c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:56.429495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.474045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.477019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.490728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:56.507751 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3276/6523] 10.222.0.78 () {56 vars in 1308 bytes} [Tue Oct 18 16:33:56 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:56.508814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.535719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049284e-84c8-472c-8e2f-1cb712a714b9 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.551476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.552153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.552524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.553105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.553559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.555492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.555613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a30c1-e056-4c17-a0b6-f430a966965e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.563776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.564680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.565023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.565650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.566608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:33:56.566955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.569033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf624c19-6494-4482-bd8a-23dd502989ad admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.570335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3277/6524] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:56 2022] GET /identity/v3/roles => generated 2123 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:56.571380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.602511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3248/6525] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:33:56.602511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.602511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.602511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.622035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] MFA Rules not processed for user `81476d7c265345e1b836a2c72174a47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:56.623888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:56.722481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3249/6526] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:56 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 18 16:33:56.722481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.722792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbd509-008d-4898-9022-121d20bb5688 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.729842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.735368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.741213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7d28-c2aa-4694-9641-2b649f0213e2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.742016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.742371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.743177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.745138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.748435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.749561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.750086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.750723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] PATH_INFO: `/v3/projects/f5a5e1ebe0b24e73809175bf07efae59/users/5a73aa2441a5447bb50736ea97029965/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.755828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:56.778999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a5e1ebe0b24e73809175bf07efae59, user_id=5a73aa2441a5447bb50736ea97029965, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.797889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.798077 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3278/6527] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:56 2022] GET /identity/v3/users => generated 8912 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:56.799022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.825707 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3250/6528] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:56 2022] PUT /identity/v3/projects/f5a5e1ebe0b24e73809175bf07efae59/users/5a73aa2441a5447bb50736ea97029965/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:56.826881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:56.827127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28960c80-1455-4c2c-be27-a2e63059f66b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.927636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.928391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.929741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d3169-ae1c-4c96-8237-a4bae2c8444b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:56.941686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:56.942400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:56.942687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.943009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/roles/e0bef549f37a408ca5bf9ae26ad8cb18` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.944447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:56.944756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e0bef549f37a408ca5bf9ae26ad8cb18)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.944871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:56.946877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:56.950345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:56.955495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881994b-259f-4c58-82dd-182f3abf7ba8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.005522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invalidating the token cache because role e0bef549f37a408ca5bf9ae26ad8cb18 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:57.005831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.006511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4ab65746-2aad-4c07-91ac-a954961914bb tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.009169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3251/6529] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:56 2022] DELETE /identity/v3/roles/e0bef549f37a408ca5bf9ae26ad8cb18 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:57.010582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.010873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.011203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.021072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3279/6530] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:56 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:57.029148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.029579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.030499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.064718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] MFA Rules not processed for user `42ffe35c0d0c44f08dcd4ea9849848a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:57.066593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.082401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] MFA Rules not processed for user `5a73aa2441a5447bb50736ea97029965`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:57.085327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.168355 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3252/6531] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:57.170004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.172967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.227055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:57.229582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:57.263595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3280/6532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:57.266208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.267984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.302002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fcc58-0d83-447a-97e0-cca1cb8d1394 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.313632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.314721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.315010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.315447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/111ea3d65ec9414786655ee9bdabed37` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.316884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=111ea3d65ec9414786655ee9bdabed37)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.319033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.415346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848ba9e-b379-4417-990e-57f933342d0b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.425401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111ea3d65ec9414786655ee9bdabed37', 'request_id': 'req-82ca1552-5d53-469b-a42b-d187b38acea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.436163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111ea3d65ec9414786655ee9bdabed37', 'request_id': 'req-82ca1552-5d53-469b-a42b-d187b38acea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.457696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111ea3d65ec9414786655ee9bdabed37', 'request_id': 'req-82ca1552-5d53-469b-a42b-d187b38acea7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.472154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project 111ea3d65ec9414786655ee9bdabed37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:57.472441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.473203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-82ca1552-5d53-469b-a42b-d187b38acea7 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:57.475046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3253/6533] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:57 2022] DELETE /identity/v3/projects/111ea3d65ec9414786655ee9bdabed37 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:57.476486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.476764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.477125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.534255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] MFA Rules not processed for user `42ffe35c0d0c44f08dcd4ea9849848a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:57.537814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.540682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.541431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.541720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.541988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.543075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.545270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.579220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3281/6534] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:57 2022] POST /identity/v3/users => generated 291 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:57.580281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.583329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.647926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3254/6535] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:57 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:57.649036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.650341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.662049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b165-7967-4c83-98c2-187e4e841614 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.667907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.668833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.669373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.670196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.672627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.748836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:57.776516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.778514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb8beb-083a-4464-9771-7d3704ca1cef None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.779760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.788459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.789442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.789876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.790315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/111ea3d65ec9414786655ee9bdabed37` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.799421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=111ea3d65ec9414786655ee9bdabed37)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.801660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.809943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3282/6536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:57.810864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.817116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Could not find project: 111ea3d65ec9414786655ee9bdabed37.: keystone.exception.ProjectNotFound: Could not find project: 111ea3d65ec9414786655ee9bdabed37. Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 18 16:33:57.830685 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 111ea3d65ec9414786655ee9bdabed37. Oct 18 16:33:57.831873 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:57.838045 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3255/6537] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:57 2022] DELETE /identity/v3/projects/111ea3d65ec9414786655ee9bdabed37 => generated 113 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:57.839191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.846116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:57.859966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768a791-b242-44a6-b527-50121b42a49b tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.860331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef431-513c-4444-8252-3083e002dee7 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.866090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42ffe35c0d0c44f08dcd4ea9849848a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9361713718ad435f968c60f8707d5399', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-118579750', 'tempest-DelegatedRole-1479373061'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.866542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.867023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.867398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.868269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] RBAC: Authorizing `identity:create_trust()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.868873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.869674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.869822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.870396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.870815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.871599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.873505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.887429 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3283/6538] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:57 2022] GET /identity/v3/roles => generated 1892 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:57.888803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:57.905208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d9fea-6af8-4695-bea7-d5a870048b33 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:57.917743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:57.918913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:57.919618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:57.920173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/projects/d5b4ac47f85b4a5c8e64fa6ae9bd7c53` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:57.922863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5b4ac47f85b4a5c8e64fa6ae9bd7c53)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:57.928101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 18 16:33:57.999232 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 18 16:33:58.001040 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3256/6539] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:33:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 162 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 18 16:33:58.002569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.021395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e48255-f103-4a6e-b5f4-714d490e5f5f tempest-TrustsV3TestJSON-100459666 tempest-user-1313467909] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.044148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b4ac47f85b4a5c8e64fa6ae9bd7c53', 'request_id': 'req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.060679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b4ac47f85b4a5c8e64fa6ae9bd7c53', 'request_id': 'req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.096781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b4ac47f85b4a5c8e64fa6ae9bd7c53', 'request_id': 'req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.134866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] The token cache is being invalidate because project d5b4ac47f85b4a5c8e64fa6ae9bd7c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:58.135567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.136539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.138711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3284/6540] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:57 2022] DELETE /identity/v3/projects/d5b4ac47f85b4a5c8e64fa6ae9bd7c53 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:58.140025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.148242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.170607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.172274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.172630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.173121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.175362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.180823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.209389 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3257/6541] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:33:58 2022] GET /identity/v3/roles => generated 1892 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:33:58.210627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.225050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.332029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32402-38c6-4af8-a9bf-66c79ecdf7f5 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.341955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.342924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.343354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.343811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/66ab0432d87a477a94c59cd8d800d99c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.346494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=66ab0432d87a477a94c59cd8d800d99c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.351861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.407038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2773919-cbfe-468c-9aa3-79535bce0341 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.417132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 66ab0432d87a477a94c59cd8d800d99c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:58.417425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.418741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.418972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.420858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.422002 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3285/6542] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:58 2022] DELETE /identity/v3/roles/66ab0432d87a477a94c59cd8d800d99c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:58.423062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.424480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.425160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.425502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/users/81476d7c265345e1b836a2c72174a47b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.428611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorizing `identity:delete_user(user_id=81476d7c265345e1b836a2c72174a47b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.430690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.473825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:58.531286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:58.540751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11363b14-e198-4f56-a527-cbe43d5d31fd tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.550391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.550795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81476d7c265345e1b836a2c72174a47b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.551192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.551456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.551727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] PATH_INFO: `/v3/projects/57219e9b82c443f3a13a0f6ca49f4994/users/2b093292edb647b8866ab44d70fdf1b6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.552895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81476d7c265345e1b836a2c72174a47b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.573694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57219e9b82c443f3a13a0f6ca49f4994, user_id=2b093292edb647b8866ab44d70fdf1b6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.575621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81476d7c265345e1b836a2c72174a47b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.576527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.579508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81476d7c265345e1b836a2c72174a47b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.591826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81476d7c265345e1b836a2c72174a47b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.600438 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3286/6543] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:33:58 2022] PUT /identity/v3/projects/57219e9b82c443f3a13a0f6ca49f4994/users/2b093292edb647b8866ab44d70fdf1b6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:58.611362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.614492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.620505 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3258/6544] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:58 2022] DELETE /identity/v3/users/81476d7c265345e1b836a2c72174a47b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:58.621795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:58.623598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.724715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02570d1-38a4-4a90-af99-4e8ed77af7a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.735899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937fbf8-92ee-4f82-8674-377fa2183790 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:58.747381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.748763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.749348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.750488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/1e6396aff17847f490a1044e3bddd1eb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.753401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1e6396aff17847f490a1044e3bddd1eb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.755629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.815858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:58.816892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.817454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.818506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] PATH_INFO: `/v3/users/5a73aa2441a5447bb50736ea97029965` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.820312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a73aa2441a5447bb50736ea97029965)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:58.823208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:58.839896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 1e6396aff17847f490a1044e3bddd1eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:33:58.840230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.841983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38d834f3-6177-4457-b882-48be7b320489 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.854237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3259/6545] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:58 2022] DELETE /identity/v3/roles/1e6396aff17847f490a1044e3bddd1eb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:58.856777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:58.858553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:58.860159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:58.946520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a73aa2441a5447bb50736ea97029965'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.957575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] MFA Rules not processed for user `2b093292edb647b8866ab44d70fdf1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:58.961303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a73aa2441a5447bb50736ea97029965'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.961964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a73aa2441a5447bb50736ea97029965'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.963686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:58.972246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:58.979740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a73aa2441a5447bb50736ea97029965'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:58.980568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a73aa2441a5447bb50736ea97029965'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.007485 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3287/6546] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:58 2022] DELETE /identity/v3/users/5a73aa2441a5447bb50736ea97029965 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:59.008794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.013096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.090943 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3260/6547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:59.092088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.094658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.101770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b76dc-1d52-4745-903f-5af0af96f4f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.111225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.112066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.112453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.112829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0863ba54f0414b359db85661cd1d1c26` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.122893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:59.138318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-f433c29e-9da3-439a-a2f0-bddad9364f97 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Could not find domain: 0863ba54f0414b359db85661cd1d1c26.: keystone.exception.DomainNotFound: Could not find domain: 0863ba54f0414b359db85661cd1d1c26. Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0863ba54f0414b359db85661cd1d1c26. Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:59.144173 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:59.145902 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0863ba54f0414b359db85661cd1d1c26. Oct 18 16:33:59.147242 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.150200 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3288/6548] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:59 2022] PATCH /identity/v3/domains/0863ba54f0414b359db85661cd1d1c26 => generated 112 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:59.150200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.150200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.150200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.170653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:33:59.172573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.266813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef446-e0f4-415d-ac91-fb159d30b28e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.286973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3289/6549] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:33:59.288543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.290472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.310296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e39b2-3cea-4c68-a5b0-bcf2924c9ff4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.318089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.319247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.319982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.321239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.322239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:59.325347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:59.392020 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3290/6550] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:33:59 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:59.394164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.398239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.398902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.399181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.399458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/42ffe35c0d0c44f08dcd4ea9849848a9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.401435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=42ffe35c0d0c44f08dcd4ea9849848a9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:59.403387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:59.510347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ffe35c0d0c44f08dcd4ea9849848a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.511681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ffe35c0d0c44f08dcd4ea9849848a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.511964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:59.527248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ffe35c0d0c44f08dcd4ea9849848a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.529523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ffe35c0d0c44f08dcd4ea9849848a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.537132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5458b10-b1fd-42a5-a8aa-acb90230fdca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.544467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ffe35c0d0c44f08dcd4ea9849848a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:33:59.558343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.558602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.558835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.559078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.581504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Could not find domain: 0fd21c92e8f945348b1542ba7a9ba6e8.: keystone.exception.DomainNotFound: Could not find domain: 0fd21c92e8f945348b1542ba7a9ba6e8. Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0fd21c92e8f945348b1542ba7a9ba6e8. Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:33:59.590335 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:33:59.591720 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application with Lock( Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0fd21c92e8f945348b1542ba7a9ba6e8. Oct 18 16:33:59.592707 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:33:59.596621 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3291/6551] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:59 2022] PATCH /identity/v3/domains/0fd21c92e8f945348b1542ba7a9ba6e8 => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:33:59.597942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.600727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.614337 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3261/6552] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:33:59 2022] DELETE /identity/v3/users/42ffe35c0d0c44f08dcd4ea9849848a9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:33:59.615209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.618953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.717163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4b00f-2b45-46ce-b0e9-fe44c14a7b75 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.730840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:33:59.794880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c77b2-fd6b-4e33-9125-27893e672cfa tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:33:59.808008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.809046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.809046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.809942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.810469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:59.812958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:59.877286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3262/6553] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:33:59 2022] POST /identity/v3/users => generated 298 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:33:59.878799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.882180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:33:59.882400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.882828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:33:59.883106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:33:59.883379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:33:59.895805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:33:59.924903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:33:59.927393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:33:59.973278 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3292/6554] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:33:59.978434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:33:59.990000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:00.021930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a270b-273e-4a9d-b2f0-017deae02513 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.052762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.055304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.057217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.058696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/9f20190ac54945a4875c687d3cde9c5c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.081147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Could not find domain: 9f20190ac54945a4875c687d3cde9c5c.: keystone.exception.DomainNotFound: Could not find domain: 9f20190ac54945a4875c687d3cde9c5c. Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9f20190ac54945a4875c687d3cde9c5c. Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:00.096226 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:00.097938 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9f20190ac54945a4875c687d3cde9c5c. Oct 18 16:34:00.098956 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.100009 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3263/6555] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:33:59 2022] PATCH /identity/v3/domains/9f20190ac54945a4875c687d3cde9c5c => generated 112 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:00.100624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.116750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07604e7a-2888-4e2e-9f02-a6502394dd50 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.130196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.130937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.132599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.132873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.133855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:00.139289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:00.175362 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3264/6556] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:00.177771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.207029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d272a3-177b-423c-b81d-0cf916c92753 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.220773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0931-547f-48f9-a4ca-8d776a7d9a21 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.230977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79f89efaf40442a1994a3919c3fa5967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '107a453859b74efdac3e9214780b82bf', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.232829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.233539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.233841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.233987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.234295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/9361713718ad435f968c60f8707d5399` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.234862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.235505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] PATH_INFO: `/v3/domains/0133f022d62f4baa8529441962330bc9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.241350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9361713718ad435f968c60f8707d5399)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:00.244080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:00.258252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Could not find domain: 0133f022d62f4baa8529441962330bc9.: keystone.exception.DomainNotFound: Could not find domain: 0133f022d62f4baa8529441962330bc9. Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0133f022d62f4baa8529441962330bc9. Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:00.263472 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:00.264752 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application with Lock( Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._enter() Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.creator() Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application created_value = creator( Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0133f022d62f4baa8529441962330bc9. Oct 18 16:34:00.266471 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:00.276373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3265/6557] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Oct 18 16:34:00 2022] PATCH /identity/v3/domains/0133f022d62f4baa8529441962330bc9 => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:00.278623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.315029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22e264-f9c8-4ac2-b4f5-1899222aec03 tempest-TokensV3TestJSON-512354802 tempest-TokensV3TestJSON-512354802-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.345657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9361713718ad435f968c60f8707d5399', 'request_id': 'req-73ad84e1-5114-49ef-ad25-e756d1f0b028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.348737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:00.355576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9361713718ad435f968c60f8707d5399', 'request_id': 'req-73ad84e1-5114-49ef-ad25-e756d1f0b028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.376978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9361713718ad435f968c60f8707d5399', 'request_id': 'req-73ad84e1-5114-49ef-ad25-e756d1f0b028'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.395423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project 9361713718ad435f968c60f8707d5399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:00.395726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.401477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.409566 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3293/6558] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:33:59 2022] DELETE /identity/v3/projects/9361713718ad435f968c60f8707d5399 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:00.411306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.413025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:00.458858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.460249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.460595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.460955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] PATH_INFO: `/v3/projects/87f420f3a99f4b24bcb0a450632973f7/users/e52e5b62b6ae46be875afc38b9bafc1f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.490484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f420f3a99f4b24bcb0a450632973f7, user_id=e52e5b62b6ae46be875afc38b9bafc1f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:00.494473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:00.527225 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3266/6559] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:00 2022] PUT /identity/v3/projects/87f420f3a99f4b24bcb0a450632973f7/users/e52e5b62b6ae46be875afc38b9bafc1f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:00.528768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.533140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:00.567891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad84e1-5114-49ef-ad25-e756d1f0b028 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.665698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:00.695433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.696093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.696372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.696643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] PATH_INFO: `/v3/users/000242da1af84511afe3fe5a40e88032` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.701969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000242da1af84511afe3fe5a40e88032)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:00.704083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:00.738299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f5e8a-8ef2-4009-bd90-3ce5cb17fbea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:00.752974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:00.753879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:00.754203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:00.754531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:00.755220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:00.768603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:00.826802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000242da1af84511afe3fe5a40e88032'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.828565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3267/6560] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:34:00 2022] POST /identity/v3/projects => generated 329 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:00.829943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.839515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:00.848765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000242da1af84511afe3fe5a40e88032'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.850142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000242da1af84511afe3fe5a40e88032'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.861274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000242da1af84511afe3fe5a40e88032'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.862263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000242da1af84511afe3fe5a40e88032'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:00.919827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3294/6561] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:00 2022] DELETE /identity/v3/users/000242da1af84511afe3fe5a40e88032 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:00.926372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:00.942133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.001885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:01.163481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ccfac-ca90-4a0f-81d8-4bccd0fb9ba6 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:01.214413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4e37-84e4-4d2b-8e04-5cb2ecdf9f95 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:01.234988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:01.235691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.235950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.236333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.237034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:01.238994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6d5e-8dec-456d-8b8b-4ed63f0d02a0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:01.337243 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3295/6562] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:00 2022] POST /identity/v3/users => generated 416 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:01.338637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.338923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.339196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.351362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:01.351995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.352278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.352531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.353846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:01.355492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:01.382122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:01.383416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.397400 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3268/6563] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:01.403660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:01.408374 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3296/6564] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:01.408374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:01.410248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.444120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70f52-12b0-4e9f-b2fe-d88c960807da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:01.448404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c7fc4-b99b-4a2f-9319-34aa2268ca92 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:01.464701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:01.465742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.466284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.466742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] PATH_INFO: `/v3/projects/f5a5e1ebe0b24e73809175bf07efae59` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.468227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a5e1ebe0b24e73809175bf07efae59)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:01.470502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:01.479738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:01.486375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.487199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.487484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.501992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:01.504322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:01.534934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3297/6565] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:34:01 2022] POST /identity/v3/roles => generated 243 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:01.536169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:01.540510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.587300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf934-0ba4-4205-a3bd-20a9040ee36d tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:01.636612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a5e1ebe0b24e73809175bf07efae59', 'request_id': 'req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:01.655899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:01.667701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a5e1ebe0b24e73809175bf07efae59', 'request_id': 'req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:01.680343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a5e1ebe0b24e73809175bf07efae59', 'request_id': 'req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:01.705920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] The token cache is being invalidate because project f5a5e1ebe0b24e73809175bf07efae59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:01.706334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:01.707040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:01.709525 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3269/6566] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:01 2022] DELETE /identity/v3/projects/f5a5e1ebe0b24e73809175bf07efae59 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:01.713012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:01.714537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.743212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:01.743916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:01.744351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:01.744625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] PATH_INFO: `/v3/projects/87f420f3a99f4b24bcb0a450632973f7/users/e52e5b62b6ae46be875afc38b9bafc1f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:01.747332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f420f3a99f4b24bcb0a450632973f7, user_id=e52e5b62b6ae46be875afc38b9bafc1f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:01.750028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:01.772109 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3298/6567] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:01 2022] PUT /identity/v3/projects/87f420f3a99f4b24bcb0a450632973f7/users/e52e5b62b6ae46be875afc38b9bafc1f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:01.773596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:01.775444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:01.918248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f9565-79dc-4bce-8b1b-a8ba8f9d634e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:02.022594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261925-2d4c-465c-9381-d9163ba848e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:02.035363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:02.036058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.036343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.036617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.037961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:02.039589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3853c8-2249-4a50-be04-755b9b86db26 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:02.097568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3299/6568] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:34:01 2022] POST /identity/v3/roles => generated 246 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:02.100824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cca87-11fd-4bb8-8461-ac5844a703e0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.101480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cca87-11fd-4bb8-8461-ac5844a703e0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.112266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:02.112555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cca87-11fd-4bb8-8461-ac5844a703e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.113717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.114021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.114560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.121500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.133731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:02.170470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-781cca87-11fd-4bb8-8461-ac5844a703e0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:02.171843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-781cca87-11fd-4bb8-8461-ac5844a703e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.279715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3300/6569] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:02.281987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a47d1-48dd-46a1-89eb-d7e921cdd079 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.282532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a47d1-48dd-46a1-89eb-d7e921cdd079 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.283099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a47d1-48dd-46a1-89eb-d7e921cdd079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.329141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-de0a47d1-48dd-46a1-89eb-d7e921cdd079 None None] MFA Rules not processed for user `e52e5b62b6ae46be875afc38b9bafc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:02.330802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-de0a47d1-48dd-46a1-89eb-d7e921cdd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.379997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:02.381379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:02.415018 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3270/6570] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:02.415797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:02.428563 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3301/6571] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:02.430286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561786c-d744-4991-b258-921e78aaa430 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.431461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561786c-d744-4991-b258-921e78aaa430 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.431926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561786c-d744-4991-b258-921e78aaa430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.449888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52394aeb-3593-46c9-9b8e-87b1446b9f75 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:02.459871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:02.460551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.460834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.461276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff/users/9b81f6db91254c87b03302a43a8ca164/roles/e93d9d10f79a48bc9033069816d2244c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.469754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a561786c-d744-4991-b258-921e78aaa430 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:02.471777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a561786c-d744-4991-b258-921e78aaa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.494251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3302/6572] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:02.495711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561786c-d744-4991-b258-921e78aaa430 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:02.502983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a561786c-d744-4991-b258-921e78aaa430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.509199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=68614f0e24814f7e9a9ad7165aaca2ff, user_id=9b81f6db91254c87b03302a43a8ca164, role_id=e93d9d10f79a48bc9033069816d2244c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:02.511962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:02.539141 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3271/6573] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:02 2022] PUT /identity/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff/users/9b81f6db91254c87b03302a43a8ca164/roles/e93d9d10f79a48bc9033069816d2244c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:02.542541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:02.641561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:02.724918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561786c-d744-4991-b258-921e78aaa430 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:02.842213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96348ffa-cf3e-4114-8e6d-f8299614f811 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:02.883862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:02.885958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.887562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:02.891632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.891971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.898754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:02.899068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:02.904597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:02.916175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:02.919050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:02.919923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:02.920887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:02.928910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:02.955390 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3272/6574] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:02.958733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.067365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.069686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.089835 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3303/6575] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:03.092686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.114504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156346ba-9601-4b25-9cc6-72b40ab05a7a service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:03.123895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:03.124584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:03.124873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:03.125315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:03.126171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.128658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.240013 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3304/6576] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:03 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:03.241717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.326528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2ab9-3c47-4c0a-98bb-09220bd75d3d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:03.476378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e790b-837d-4759-afe8-52c43123f0b9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:03.503320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:03.504751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:03.505767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:03.505767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:03.508958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.514335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.587368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:03.593824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:03.594379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:03.595870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff/users/9b81f6db91254c87b03302a43a8ca164/roles/d3402e110ca2445a9ca5f17ee1044c11` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:03.600953 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3305/6577] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:03 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:03.602127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.603916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=68614f0e24814f7e9a9ad7165aaca2ff, user_id=9b81f6db91254c87b03302a43a8ca164, role_id=d3402e110ca2445a9ca5f17ee1044c11)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.614144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.644076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4a2bc-1f25-42d3-93cb-5059e346ca69 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:03.680547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3273/6578] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:02 2022] PUT /identity/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff/users/9b81f6db91254c87b03302a43a8ca164/roles/d3402e110ca2445a9ca5f17ee1044c11 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:03.682919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.867522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35768524-232c-4254-8076-a3131470c5f7 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:03.884169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:03.887274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:03.889781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:03.891011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:03.895119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.896808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:03.902720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:03.903390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347edc-babc-4d01-90c2-1a455862399a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.904263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:03.904709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:03.907239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:03.907505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:03.920817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:03.934920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:03.985448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3306/6579] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:03 2022] GET /identity/v3/roles => generated 1891 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:03.986643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:03.997014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec44f-3d5e-4ec0-99ed-b7ef80b3c6b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:04.002264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:04.004168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.004684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.005210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.006079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:04.007905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:04.022862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3307/6580] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:03 2022] GET /identity/v3/roles => generated 1891 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:04.028264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:04.037341 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3274/6581] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:03 2022] GET /identity/v3/users => generated 8896 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:04.043856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7e7f-6021-491d-903f-b72a3ddebb96 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.048537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7e7f-6021-491d-903f-b72a3ddebb96 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.049704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7e7f-6021-491d-903f-b72a3ddebb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.053460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4991e-7063-46e1-9eea-8d028df33e73 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:04.059441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:04.060309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.060472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.060918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] PATH_INFO: `/v3/projects/40c7b1a1fe8e40d690c27ccc87185d53/users/0bd4e1ec258d40b4831ab4fa90e01889/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.087663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c7b1a1fe8e40d690c27ccc87185d53, user_id=0bd4e1ec258d40b4831ab4fa90e01889, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:04.096352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:04.165765 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3308/6582] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:04 2022] PUT /identity/v3/projects/40c7b1a1fe8e40d690c27ccc87185d53/users/0bd4e1ec258d40b4831ab4fa90e01889/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:04.171148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:04.174590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c41e7e7f-6021-491d-903f-b72a3ddebb96 None None] MFA Rules not processed for user `9b81f6db91254c87b03302a43a8ca164`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:04.175924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c41e7e7f-6021-491d-903f-b72a3ddebb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.176251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.340954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98d97a-3df6-4151-a39a-40f34d5e7c0e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:04.344051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3275/6583] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:04.354493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df195-110e-4fc3-9224-b8f0949d07f0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.354882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df195-110e-4fc3-9224-b8f0949d07f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.361359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2df195-110e-4fc3-9224-b8f0949d07f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.366969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:04.367670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.367917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.368191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] PATH_INFO: `/v3/projects/9a4c0a809df846398556e284ae0813c2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.372782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4c0a809df846398556e284ae0813c2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:04.375825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:04.420681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fd2df195-110e-4fc3-9224-b8f0949d07f0 None None] MFA Rules not processed for user `0bd4e1ec258d40b4831ab4fa90e01889`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:04.423007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fd2df195-110e-4fc3-9224-b8f0949d07f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.515926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4c0a809df846398556e284ae0813c2', 'request_id': 'req-d53a01f3-75fc-47fd-962e-d3469d001781'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.534500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4c0a809df846398556e284ae0813c2', 'request_id': 'req-d53a01f3-75fc-47fd-962e-d3469d001781'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.546338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4c0a809df846398556e284ae0813c2', 'request_id': 'req-d53a01f3-75fc-47fd-962e-d3469d001781'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.568185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] The token cache is being invalidate because project 9a4c0a809df846398556e284ae0813c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:04.568604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3276/6584] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:04.569241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.569932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.570219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.570493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.572235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.574234 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3309/6585] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:04 2022] DELETE /identity/v3/projects/9a4c0a809df846398556e284ae0813c2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:04.575302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:04.584949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.613840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] MFA Rules not processed for user `9b81f6db91254c87b03302a43a8ca164`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:04.614550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.742138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:04.773720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a01f3-75fc-47fd-962e-d3469d001781 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:04.785758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:04.786632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.787007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.787378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.788121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:04.791493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec1f54-61fc-40de-b66f-5b3ab32baacb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:04.792212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3277/6586] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:04.794424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:04.796120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.819494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688b84-b8dc-4c27-b6bf-de929b6d5d88 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:04.827742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:04.827963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.828164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.828496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] PATH_INFO: `/v3/users/79f89efaf40442a1994a3919c3fa5967` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.830943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f89efaf40442a1994a3919c3fa5967)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:04.834377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:04.845230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:04.852243 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3310/6587] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:04 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:04.853894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:04.854283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:04.854653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:04.899655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] MFA Rules not processed for user `4064b8b6e24149d48f3ab0699e61c175`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:04.907536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:04.934060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f89efaf40442a1994a3919c3fa5967'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.934791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f89efaf40442a1994a3919c3fa5967'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.945307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f89efaf40442a1994a3919c3fa5967'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.946067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f89efaf40442a1994a3919c3fa5967'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:04.962085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f89efaf40442a1994a3919c3fa5967'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:05.048526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3278/6588] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:04 2022] DELETE /identity/v3/users/79f89efaf40442a1994a3919c3fa5967 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:05.068843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.075517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:05.143859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3311/6589] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:05.145276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.148129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:05.280563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad768-c42d-4dcd-970e-f117626eabb8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.286710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.287684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.288117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.290550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.291533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:create_trust()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.293305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb00b-b2d3-474a-b16a-8874d2c9b4df tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.357455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e57ff-dec0-411a-a004-8716bea940f0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.476583 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3279/6590] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:34:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:05.482936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.483224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.483500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.550752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.551369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.551667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.551941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.552597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.552730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] MFA Rules not processed for user `4064b8b6e24149d48f3ab0699e61c175`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:05.554603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.561230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:05.598164 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3312/6591] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:05 2022] POST /identity/v3/users => generated 291 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:05.600093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.629197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119c6a-11ed-4845-b48f-a541a81eaab7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.635721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:05.639237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.640416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.640859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.641873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.659785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:05.665731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:get_trust(trust_id=7471aed315134ee89b006f536c94ba25)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.668333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.688243 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3313/6592] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:34:05 2022] GET /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25 => generated 833 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:05.689268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.708257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77b14-63c3-4d69-bfa3-a043516602b2 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.717667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.718886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.719193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.719822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.720251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.722583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.744436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3280/6593] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:05.744436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.748211 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3314/6594] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:05 2022] GET /identity/v3/roles => generated 1891 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:05.759742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.771354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1045c-9da3-442e-bdb1-998d868b5568 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.781284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.781981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.784041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097ae33-ba0c-4327-b6c5-67348d0dd9a3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.785010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.785306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.794650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.796456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.798789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.799071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.800001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.801751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.802798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7471aed315134ee89b006f536c94ba25)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.804267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.829535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3281/6595] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:34:05 2022] GET /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles => generated 370 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:05.831226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.845293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3315/6596] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:05 2022] GET /identity/v3/roles => generated 1891 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:05.851217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.868120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c367a-7b80-4104-a294-59fcfb299c00 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.884025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.890647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.892116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.892520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/e93d9d10f79a48bc9033069816d2244c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.903213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7471aed315134ee89b006f536c94ba25, role_id=e93d9d10f79a48bc9033069816d2244c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.903696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a57232-89be-49be-a53e-b80323160457 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.911799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:05.929703 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3282/6597] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:34:05 2022] GET /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/e93d9d10f79a48bc9033069816d2244c => generated 243 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:05.930784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:05.946271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.947030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.947444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.949774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0a7a1-43bb-48d6-804b-12f38cddb46d tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:05.949916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] PATH_INFO: `/v3/projects/3cc0a846647b4624bfece2bde38207c7/users/3140e35b5144465688f36362e8827699/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.957131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:05.969486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:05.970178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:05.971126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/e93d9d10f79a48bc9033069816d2244c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:05.988841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7471aed315134ee89b006f536c94ba25, role_id=e93d9d10f79a48bc9033069816d2244c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:05.990370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.017962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc0a846647b4624bfece2bde38207c7, user_id=3140e35b5144465688f36362e8827699, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.028894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5975375-8e75-4582-b6c3-cb1beba3473c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.037413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3283/6598] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:34:05 2022] HEAD /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/e93d9d10f79a48bc9033069816d2244c => generated 0 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 16:34:06.043411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.070845 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3316/6599] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:05 2022] PUT /identity/v3/projects/3cc0a846647b4624bfece2bde38207c7/users/3140e35b5144465688f36362e8827699/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:06.073580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5e1f2-fa71-4070-8a94-66fa26d473c3 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.083199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.083985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.084314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.139803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] MFA Rules not processed for user `3140e35b5144465688f36362e8827699`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:06.142033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:06.205992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.206999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.207133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.207508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/d3402e110ca2445a9ca5f17ee1044c11` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.225559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7471aed315134ee89b006f536c94ba25, role_id=d3402e110ca2445a9ca5f17ee1044c11)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.228484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Could not find role: d3402e110ca2445a9ca5f17ee1044c11.: keystone.exception.RoleNotFound: Could not find role: d3402e110ca2445a9ca5f17ee1044c11. Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:34:06.258814 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d3402e110ca2445a9ca5f17ee1044c11. Oct 18 16:34:06.260063 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:06.265428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3284/6600] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:34:06 2022] GET /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/d3402e110ca2445a9ca5f17ee1044c11 => generated 110 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:06.266815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.313056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e762e-992d-486c-b769-d60e925cf537 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.329667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.330425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.330932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.331399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/d3402e110ca2445a9ca5f17ee1044c11` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.342257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7471aed315134ee89b006f536c94ba25, role_id=d3402e110ca2445a9ca5f17ee1044c11)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.343932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Could not find role: d3402e110ca2445a9ca5f17ee1044c11.: keystone.exception.RoleNotFound: Could not find role: d3402e110ca2445a9ca5f17ee1044c11. Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:34:06.368182 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d3402e110ca2445a9ca5f17ee1044c11. Oct 18 16:34:06.369923 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:06.381145 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3285/6601] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:34:06 2022] HEAD /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25/roles/d3402e110ca2445a9ca5f17ee1044c11 => generated 0 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 18 16:34:06.382346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.388817 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3317/6602] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:06.389248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.401387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a7083-51d7-4d3b-886d-b51b335ac3e7 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.418802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.419470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.419753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.420032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.439858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorizing `identity:delete_trust(trust_id=7471aed315134ee89b006f536c94ba25)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.441620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.479979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7471aed315134ee89b006f536c94ba25', 'request_id': 'req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:06.480773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7471aed315134ee89b006f536c94ba25', 'request_id': 'req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:06.481444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7471aed315134ee89b006f536c94ba25', 'request_id': 'req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:06.503734 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3286/6603] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:34:06 2022] DELETE /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:06.507799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.509226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:06.536399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452064c-3d31-4339-8f29-2de56363eec3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.537785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b167e-8f1c-49c1-b98c-53e11bacebe0 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.549834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.550086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b81f6db91254c87b03302a43a8ca164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68614f0e24814f7e9a9ad7165aaca2ff', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-246943317', 'tempest-DelegatedRole-825855457'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.550699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.550832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.551260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.551357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.551449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] PATH_INFO: `/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.551712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.552478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.554585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Could not find trust: 7471aed315134ee89b006f536c94ba25.: keystone.exception.TrustNotFound: Could not find trust: 7471aed315134ee89b006f536c94ba25. Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 16:34:06.570056 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7471aed315134ee89b006f536c94ba25. Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:06.571267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3287/6604] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:34:06 2022] GET /identity/v3/OS-TRUST/trusts/7471aed315134ee89b006f536c94ba25 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:06.577098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.579125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:06.599517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:06.614149 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3318/6605] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:06 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:06.616925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.618972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:06.678369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:06.751829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252b61-32ae-4cb7-bb87-b1820e232222 tempest-TrustsV3TestJSON-1251905661 tempest-user-1845248578] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.785908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529c3cc-fa7e-47e7-9517-9dab004cd59e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.799532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.800884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.801316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.801689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.802528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.804607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.852213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3319/6606] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:06 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:06.856364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.878220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc6b79-6af4-4075-a109-b50631e90ffa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.883504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.885748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.886029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.886310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/d3402e110ca2445a9ca5f17ee1044c11` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.889413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d3402e110ca2445a9ca5f17ee1044c11)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.892579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.903191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.904665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.909334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.909764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.910671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:06.913192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:06.943150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3320/6607] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:06 2022] GET /identity/v3/roles => generated 1891 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:06.946280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:06.974030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad1ec9-cb99-4195-989f-0a392a689960 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:06.982311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:06.983171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:06.983563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:06.984021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] PATH_INFO: `/v3/projects/00937672214b4f65a6ee46361a8cfae8/users/27fb6aa9cdc74ddc824bec8c042b4783/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:06.985845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role d3402e110ca2445a9ca5f17ee1044c11 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:06.986471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:06.987717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:06.994167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3288/6608] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:06 2022] DELETE /identity/v3/roles/d3402e110ca2445a9ca5f17ee1044c11 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:06.996564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.000387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.030341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00937672214b4f65a6ee46361a8cfae8, user_id=27fb6aa9cdc74ddc824bec8c042b4783, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.034509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.062534 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3321/6609] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:06 2022] PUT /identity/v3/projects/00937672214b4f65a6ee46361a8cfae8/users/27fb6aa9cdc74ddc824bec8c042b4783/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:07.067047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.069283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.151883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285bf40-0396-4d84-806b-eff43d1f246b tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.217332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:07.245167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911db4-9e90-4bf8-b65f-dcbca6835380 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.265866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.267040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.267323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.268081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.268721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.270387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.302691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3322/6610] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:07 2022] GET /identity/v3/roles => generated 1654 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:07.305916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.308315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.309656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.310503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.310950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.312867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/e93d9d10f79a48bc9033069816d2244c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.315088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e93d9d10f79a48bc9033069816d2244c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.354819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.367115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c355-665b-4aae-a88b-588a6eaeb703 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.383565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.387590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.389734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.390196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] PATH_INFO: `/v3/projects/107a453859b74efdac3e9214780b82bf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.391655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107a453859b74efdac3e9214780b82bf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.394809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.456004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role e93d9d10f79a48bc9033069816d2244c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:07.456491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.458706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.463602 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3289/6611] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:06 2022] DELETE /identity/v3/roles/e93d9d10f79a48bc9033069816d2244c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:07.464447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.470344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.526301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107a453859b74efdac3e9214780b82bf', 'request_id': 'req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.533977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107a453859b74efdac3e9214780b82bf', 'request_id': 'req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.553875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107a453859b74efdac3e9214780b82bf', 'request_id': 'req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.564374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:07.570923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4980c78-508c-4a33-93a8-14cbc5f87701 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.583270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] The token cache is being invalidate because project 107a453859b74efdac3e9214780b82bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:07.583718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.585403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.587937 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3323/6612] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:07 2022] DELETE /identity/v3/projects/107a453859b74efdac3e9214780b82bf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:07.589555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.593532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.666841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.668054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.668581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.669514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] PATH_INFO: `/v3/projects/00937672214b4f65a6ee46361a8cfae8/users/27fb6aa9cdc74ddc824bec8c042b4783/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.673923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=00937672214b4f65a6ee46361a8cfae8, user_id=27fb6aa9cdc74ddc824bec8c042b4783, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.677049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.704890 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3290/6613] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:07 2022] PUT /identity/v3/projects/00937672214b4f65a6ee46361a8cfae8/users/27fb6aa9cdc74ddc824bec8c042b4783/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:07.710193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.719696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.751697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456b5ae-608d-4789-87ce-6d93a8f7b7d3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.799982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:07.857666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c826a-8e8f-499e-a6ec-9fc808e26fda admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:07.863916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.864754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.865075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.865430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/9b81f6db91254c87b03302a43a8ca164` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.867460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9b81f6db91254c87b03302a43a8ca164)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.869735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.878732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:07.879834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:07.879834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:07.879834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:07.885392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:07.914031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:07.915491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:07.926270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b81f6db91254c87b03302a43a8ca164'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.926739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b81f6db91254c87b03302a43a8ca164'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.935902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b81f6db91254c87b03302a43a8ca164'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.935902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b81f6db91254c87b03302a43a8ca164'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.951044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3324/6614] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:07.951486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961ba745-caf8-41be-80c1-034d72226033 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b81f6db91254c87b03302a43a8ca164'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:07.951951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:07.954420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.005576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3291/6615] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:07 2022] DELETE /identity/v3/users/9b81f6db91254c87b03302a43a8ca164 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:08.005576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.005576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.005576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.042662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] MFA Rules not processed for user `27fb6aa9cdc74ddc824bec8c042b4783`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:08.044014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.076335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fd8b7-9585-4257-a4de-b925133b0439 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:08.189290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3292/6616] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:08.193031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:08.193031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.217905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:08.220087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.220607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.221089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] PATH_INFO: `/v3/users/0f191c1cfcf248dda8459cb05c2cff59` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.223192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f191c1cfcf248dda8459cb05c2cff59)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:08.226202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:08.229921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:08.262475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:08.330274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.346529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1272c-1054-4945-be4e-6cf2609483e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:08.351806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.352738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.355476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:08.356654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.356874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.357279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.360387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68614f0e24814f7e9a9ad7165aaca2ff)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:08.363738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:08.386044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.387371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f191c1cfcf248dda8459cb05c2cff59'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.438308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3325/6617] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:07 2022] DELETE /identity/v3/users/0f191c1cfcf248dda8459cb05c2cff59 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:08.443543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:08.447256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.480509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68614f0e24814f7e9a9ad7165aaca2ff', 'request_id': 'req-85256fdc-13fe-463b-8b07-3262f1cf992a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.501659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68614f0e24814f7e9a9ad7165aaca2ff', 'request_id': 'req-85256fdc-13fe-463b-8b07-3262f1cf992a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.518239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68614f0e24814f7e9a9ad7165aaca2ff', 'request_id': 'req-85256fdc-13fe-463b-8b07-3262f1cf992a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.543451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project 68614f0e24814f7e9a9ad7165aaca2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:08.543724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.546053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:08.551423 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3293/6618] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:08 2022] DELETE /identity/v3/projects/68614f0e24814f7e9a9ad7165aaca2ff => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:08.561670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:08.566119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.639229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad52f-ff1e-4dda-992b-4452869b0ccb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:08.754657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256fdc-13fe-463b-8b07-3262f1cf992a tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:08.760763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:08.761952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.762429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.762886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.763795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:08.766344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:08.770588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:08.784421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.784695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.786065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.794910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:08.809179 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3294/6619] 10.222.0.78 () {60 vars in 1152 bytes} [Tue Oct 18 16:34:08 2022] POST /identity/v3/projects => generated 329 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:08.813467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:08.915211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:08.951948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d905-7fd2-4d56-8f0f-0a0e933e104e tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:08.962923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:08.965708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:08.966383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:08.967731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:08.968640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:08.974604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:08.976733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:08.992507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:08.996020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.019366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3326/6620] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:09.024388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3295/6621] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:08 2022] POST /identity/v3/users => generated 416 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:09.029512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.051524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdcba5-d171-45ff-8ab5-e2a47d85ccd1 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.058573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.060628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.061188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.061801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.064224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.067785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.109898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.115019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3327/6622] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:34:09 2022] POST /identity/v3/roles => generated 243 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:09.162188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b76f3-0313-4fcf-8f88-8129e0583807 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.189784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.190719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.191049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.191546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.194723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.202362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.257807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.263873 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3296/6623] 10.222.0.78 () {60 vars in 1143 bytes} [Tue Oct 18 16:34:09 2022] POST /identity/v3/roles => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:09.264445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:09.268403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.297677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a300fc8-b29d-4316-aa66-3f6c1e0c7082 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.326729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.327968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.328303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.328631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/a88ad50d42144bff88a843c431a47581/users/3135ed404b134b1696cffd6fe6ac7827/roles/06f2d17cfffb4457a98594f742b45596` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.386489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a88ad50d42144bff88a843c431a47581, user_id=3135ed404b134b1696cffd6fe6ac7827, role_id=06f2d17cfffb4457a98594f742b45596)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.389442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.426038 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3297/6624] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:09 2022] PUT /identity/v3/projects/a88ad50d42144bff88a843c431a47581/users/3135ed404b134b1696cffd6fe6ac7827/roles/06f2d17cfffb4457a98594f742b45596 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:09.430780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.493766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c67f2-9172-4375-b96f-fe7101cc4cd0 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.592377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167b035-af4c-453f-8e03-5a34e5adea95 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.602730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.603651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.604055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.605475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/a88ad50d42144bff88a843c431a47581/users/3135ed404b134b1696cffd6fe6ac7827/roles/c66d76badc104052ab3b76a3d2530a0d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.614084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a88ad50d42144bff88a843c431a47581, user_id=3135ed404b134b1696cffd6fe6ac7827, role_id=c66d76badc104052ab3b76a3d2530a0d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.621843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.623710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.626634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.626918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.627193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] PATH_INFO: `/v3/projects/be569c2de8ca4abaac5a4dac09d4c86a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.629148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be569c2de8ca4abaac5a4dac09d4c86a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.632717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.651260 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3298/6625] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:09 2022] PUT /identity/v3/projects/a88ad50d42144bff88a843c431a47581/users/3135ed404b134b1696cffd6fe6ac7827/roles/c66d76badc104052ab3b76a3d2530a0d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:09.656047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:09.741741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be569c2de8ca4abaac5a4dac09d4c86a', 'request_id': 'req-35f4b69c-1332-4090-aa80-00e95f894130'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:09.755910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be569c2de8ca4abaac5a4dac09d4c86a', 'request_id': 'req-35f4b69c-1332-4090-aa80-00e95f894130'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:09.773185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be569c2de8ca4abaac5a4dac09d4c86a', 'request_id': 'req-35f4b69c-1332-4090-aa80-00e95f894130'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:09.781951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa6932-5bd0-4188-856b-b3fc3ce83130 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:09.805167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] The token cache is being invalidate because project be569c2de8ca4abaac5a4dac09d4c86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:09.805923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:09.808618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-35f4b69c-1332-4090-aa80-00e95f894130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:09.811416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3328/6626] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:09 2022] DELETE /identity/v3/projects/be569c2de8ca4abaac5a4dac09d4c86a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:09.825176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5901d-3356-41bb-a750-bc162dee0894 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.825574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5901d-3356-41bb-a750-bc162dee0894 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.825927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5901d-3356-41bb-a750-bc162dee0894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.882206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:09.887263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f1a5901d-3356-41bb-a750-bc162dee0894 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:09.894099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1a5901d-3356-41bb-a750-bc162dee0894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:09.912567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:09.914420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.914788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.915173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:09.915914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:09.919048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8fea-fa00-4aa3-ab30-4231e92d6bbf tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:09.949054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:09.986503 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3299/6627] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:09 2022] GET /identity/v3/users => generated 8910 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:09.990869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:09.991168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:09.991425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.044869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] MFA Rules not processed for user `3135ed404b134b1696cffd6fe6ac7827`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:10.047185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:10.070106 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3329/6628] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:10.080453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.080818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.083212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.119007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:10.120230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:10.130268 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3330/6629] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:10.131133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.136624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:10.261804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511f95-18d6-45c4-8a15-b254fb713ed5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.268720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.269661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.269661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.269904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.271704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:10.287899 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3300/6630] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:10.292287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.292551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.294040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605a75e-8761-4bbd-9979-7063a871d912 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.314330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3331/6631] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:10.316372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.316661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.316933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.326384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45980712-b248-4e2a-8b51-28276cc0c098 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.333981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.335077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.335649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.336177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.337231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:10.337762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.339846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.364504 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3301/6632] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:10.365714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.379615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2165-d349-4745-9128-9e4660f82d5f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.385120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] MFA Rules not processed for user `3135ed404b134b1696cffd6fe6ac7827`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:10.386470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:10.387898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.388736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.389234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.389789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.391556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.393760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.410651 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3332/6633] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:10.415882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.437315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00eedc-9555-45d8-a346-d00ea2884d59 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.457935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3302/6634] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:10 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:10.458624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.459270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.459669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.472797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.475479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.482029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:create_trust()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.483247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.711767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9c917-418a-470e-b68f-22ab31517dc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.728026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.730422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.730705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.730978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.731627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.736650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.742031 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3333/6635] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Oct 18 16:34:10 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:10.745941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.765871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87421fbc-e5d2-4142-8647-a43f56219881 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.782744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3303/6636] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:10 2022] POST /identity/v3/users => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:10.786945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.788284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:10.808231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e518-0904-486d-aede-a245f1a53992 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.823601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.824438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.824849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.825140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.825824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.827644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.855814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3304/6637] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/roles => generated 1892 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:10.856773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.879186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124d30d-930e-411a-a08d-6218972a29b0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.894800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.895480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.896913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.896913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] PATH_INFO: `/v3/projects/749183aaa57441b3a6275431366b7c13/users/5183f3f51ed94dfbbb857e55b249c0e0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.898778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.899427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.899699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.899966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:10.903516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:10.915718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:get_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.917946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.935871 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3334/6638] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb => generated 834 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:34:10.939764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.942397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749183aaa57441b3a6275431366b7c13, user_id=5183f3f51ed94dfbbb857e55b249c0e0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:10.951974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:10.963738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ee4a-c9ac-45d4-86b7-37b4e2fc07d6 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:10.977619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:10.981226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3305/6639] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:10 2022] PUT /identity/v3/projects/749183aaa57441b3a6275431366b7c13/users/5183f3f51ed94dfbbb857e55b249c0e0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:10.982179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:10.982937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:10.983197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:10.983474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.003797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.007591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.031029 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3335/6640] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:11.035377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.060050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318008db-0831-41ad-af8b-16bb30191e29 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.177154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aa27-c217-4d9a-a6f0-a6f1ea507269 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.195556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.196688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.197275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.197708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.198758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.204788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.225590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.226415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.227518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.230304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/06f2d17cfffb4457a98594f742b45596` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.247886 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3306/6641] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:10 2022] GET /identity/v3/roles => generated 1892 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:11.249745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.261847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb, role_id=06f2d17cfffb4457a98594f742b45596)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.264411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.273817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce4b7-d9c7-435a-8d68-4e8335c7d157 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.283830 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3336/6642] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:34:11 2022] GET /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/06f2d17cfffb4457a98594f742b45596 => generated 243 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:11.285659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.288656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.289403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.289811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.290097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] PATH_INFO: `/v3/projects/749183aaa57441b3a6275431366b7c13/users/5183f3f51ed94dfbbb857e55b249c0e0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.295033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] RBAC: Authorizing `identity:create_grant(project_id=749183aaa57441b3a6275431366b7c13, user_id=5183f3f51ed94dfbbb857e55b249c0e0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.301762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df7200-cab0-44c0-a5f8-7e697ae5485b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.307217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613fe41-df1d-4961-a486-04219590ebed tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.326428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3307/6643] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:11 2022] PUT /identity/v3/projects/749183aaa57441b3a6275431366b7c13/users/5183f3f51ed94dfbbb857e55b249c0e0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:11.337919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.338213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.338492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.408948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] MFA Rules not processed for user `5183f3f51ed94dfbbb857e55b249c0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:11.410385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:11.466488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.467412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.467651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.468059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/06f2d17cfffb4457a98594f742b45596` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.485082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb, role_id=06f2d17cfffb4457a98594f742b45596)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.486660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.507335 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3337/6644] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:34:11 2022] HEAD /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/06f2d17cfffb4457a98594f742b45596 => generated 0 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 18 16:34:11.515580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.533575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68d4c9-0ef7-4da3-9a14-dc2530d97839 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.560305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.561155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.563755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.564503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/c66d76badc104052ab3b76a3d2530a0d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.573306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb, role_id=c66d76badc104052ab3b76a3d2530a0d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.575236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.583422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Could not find role: c66d76badc104052ab3b76a3d2530a0d.: keystone.exception.RoleNotFound: Could not find role: c66d76badc104052ab3b76a3d2530a0d. Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:34:11.596740 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c66d76badc104052ab3b76a3d2530a0d. Oct 18 16:34:11.598307 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:34:11.598307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3338/6645] 10.222.0.78 () {58 vars in 1368 bytes} [Tue Oct 18 16:34:11 2022] GET /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/c66d76badc104052ab3b76a3d2530a0d => generated 110 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:11.602917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.632821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fadd-8b2f-4b62-aad5-d6c2998aa85b tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.639346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.642792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `HEAD` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.648566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.649236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/c66d76badc104052ab3b76a3d2530a0d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.665478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb, role_id=c66d76badc104052ab3b76a3d2530a0d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.670090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.676908 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3308/6646] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:11.681439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Could not find role: c66d76badc104052ab3b76a3d2530a0d.: keystone.exception.RoleNotFound: Could not find role: c66d76badc104052ab3b76a3d2530a0d. Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 16:34:11.727855 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c66d76badc104052ab3b76a3d2530a0d. Oct 18 16:34:11.729165 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:34:11.735467 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3339/6647] 10.222.0.78 () {58 vars in 1369 bytes} [Tue Oct 18 16:34:11 2022] HEAD /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb/roles/c66d76badc104052ab3b76a3d2530a0d => generated 0 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 18 16:34:11.742134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.782822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c3060-4331-4947-9d9e-9826a543cf35 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.802136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.802904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.803131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.803446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.823135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:11.823378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorizing `identity:delete_trust(trust_id=ba0e08a8986b46f7a8634e8be49495fb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.828226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.846837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5627e-380a-4016-8b05-f1b6e10959a9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:11.860535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:11.861276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:11.861613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:11.861893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:11.862608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:11.868286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:11.876172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ba0e08a8986b46f7a8634e8be49495fb', 'request_id': 'req-c4c03f3d-1270-44be-83dc-0eb78211ca2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:11.888887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ba0e08a8986b46f7a8634e8be49495fb', 'request_id': 'req-c4c03f3d-1270-44be-83dc-0eb78211ca2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:11.894021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ba0e08a8986b46f7a8634e8be49495fb', 'request_id': 'req-c4c03f3d-1270-44be-83dc-0eb78211ca2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:11.917794 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3340/6648] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Oct 18 16:34:11 2022] DELETE /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:11.923309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:11.925166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.000707 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3309/6649] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:11 2022] POST /identity/v3/projects => generated 391 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:12.003410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c03f3d-1270-44be-83dc-0eb78211ca2d tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.007452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.031314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.149865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3135ed404b134b1696cffd6fe6ac7827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a88ad50d42144bff88a843c431a47581', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-704863162', 'tempest-NotDelegatedRole-1544453530'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.150563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.151060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.151178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] PATH_INFO: `/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Could not find trust: ba0e08a8986b46f7a8634e8be49495fb.: keystone.exception.TrustNotFound: Could not find trust: ba0e08a8986b46f7a8634e8be49495fb. Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 18 16:34:12.167630 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ba0e08a8986b46f7a8634e8be49495fb. Oct 18 16:34:12.168687 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:34:12.183313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3341/6650] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Oct 18 16:34:11 2022] GET /identity/v3/OS-TRUST/trusts/ba0e08a8986b46f7a8634e8be49495fb => generated 111 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 18 16:34:12.184286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.191261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.212837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588308de-c9b6-4bd8-9981-e67d872812a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.229188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.230056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.230522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.230987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.237906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.239994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:12.301933 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3310/6651] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:12 2022] POST /identity/v3/users => generated 296 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:12.302608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.330856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5da46e-82c3-4351-b5ff-79ee0873909f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.355732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.356381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.356678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.356955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.357654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.359960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:12.396207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f81ff-bdf3-49ee-aedc-214b52f8a5f2 tempest-TrustsV3TestJSON-1640466712 tempest-user-1847532917] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.397816 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3311/6652] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:12 2022] GET /identity/v3/roles => generated 1892 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:12.401461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.412423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.413115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.413500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.413782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/c66d76badc104052ab3b76a3d2530a0d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.415256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c66d76badc104052ab3b76a3d2530a0d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.416928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:12.424054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535ffe5-424d-4cd4-8faf-b9e3c43ce09b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.434470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.435153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.435451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.435706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.438098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.440429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:12.480493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3312/6653] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:12 2022] GET /identity/v3/roles => generated 1892 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:12.481465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.521630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7397a4-09ec-494c-810f-497fdce1d1ea admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.527017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role c66d76badc104052ab3b76a3d2530a0d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:12.528136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:12.534086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:12.565674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3342/6654] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:12 2022] DELETE /identity/v3/roles/c66d76badc104052ab3b76a3d2530a0d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:12.566588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.569104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.569592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.569592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.569821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] PATH_INFO: `/v3/projects/88c3aadcfdf54815a3590624d4a482d2/users/e0b014dd73da43d0b3e98b0591715dfe/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.573267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.594784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c3aadcfdf54815a3590624d4a482d2, user_id=e0b014dd73da43d0b3e98b0591715dfe, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.597599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4772d-27bd-49af-9065-364ca1072d6e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:12.622987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:12.629157 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3313/6655] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:12 2022] PUT /identity/v3/projects/88c3aadcfdf54815a3590624d4a482d2/users/e0b014dd73da43d0b3e98b0591715dfe/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:12.640890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.641351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.641741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.735875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] MFA Rules not processed for user `e0b014dd73da43d0b3e98b0591715dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:12.737993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.776026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f92d8d-ebcf-48ff-b3d2-1046c27378c2 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:12.873348 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3314/6656] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:12.882374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:12.883786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:12.902582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:12.926908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:12.927874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:12.946779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:12.947140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/roles/06f2d17cfffb4457a98594f742b45596` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:12.950141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_role(role_id=06f2d17cfffb4457a98594f742b45596)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:12.951759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:13.029551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invalidating the token cache because role 06f2d17cfffb4457a98594f742b45596 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:13.029858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.033059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.035677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1fd6-ce5b-4c1f-97b0-67bc80a99bf0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:13.037357 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3343/6657] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:12 2022] DELETE /identity/v3/roles/06f2d17cfffb4457a98594f742b45596 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:13.041203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:13.045031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:13.141139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:13.142261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:13.142756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:13.143217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:13.145735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:13.183802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0840dfa-3606-4d3b-83a9-50b06f7caf67 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:13.199012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:13.199725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:13.200006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:13.200275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/users/3135ed404b134b1696cffd6fe6ac7827` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:13.201832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3135ed404b134b1696cffd6fe6ac7827)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:13.203813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:13.265945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:13.315883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3135ed404b134b1696cffd6fe6ac7827'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.330010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3135ed404b134b1696cffd6fe6ac7827'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.333946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3135ed404b134b1696cffd6fe6ac7827'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.335654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:13.342304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:13.356828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3135ed404b134b1696cffd6fe6ac7827'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.363431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3135ed404b134b1696cffd6fe6ac7827'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.387249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3315/6658] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:13.401614 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3344/6659] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:13 2022] DELETE /identity/v3/users/3135ed404b134b1696cffd6fe6ac7827 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:13.406380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:13.420093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e00b-5426-4af2-a4e0-30d9e6cfa36f service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:13.541305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '021665a90920422f893bafe02b9936db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a03aa5df7e443179b4efac3be945de9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:13.541951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:13.542227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:13.542500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] PATH_INFO: `/v3/projects/a88ad50d42144bff88a843c431a47581` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:13.545737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a88ad50d42144bff88a843c431a47581)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:13.548387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:13.614219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:13.692178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88ad50d42144bff88a843c431a47581', 'request_id': 'req-308f6922-a799-487c-bbce-d909aa5ddf6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.706407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88ad50d42144bff88a843c431a47581', 'request_id': 'req-308f6922-a799-487c-bbce-d909aa5ddf6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.724232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88ad50d42144bff88a843c431a47581', 'request_id': 'req-308f6922-a799-487c-bbce-d909aa5ddf6c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.748063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] The token cache is being invalidate because project a88ad50d42144bff88a843c431a47581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:13.751995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.752890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-308f6922-a799-487c-bbce-d909aa5ddf6c tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:13.756316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3316/6660] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:13 2022] DELETE /identity/v3/projects/a88ad50d42144bff88a843c431a47581 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:13.763113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:13.765839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:13.948108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb818f7e-4c61-492e-bb0a-d24d45425507 tempest-TrustsV3TestJSON-485378622 tempest-TrustsV3TestJSON-485378622-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:14.087387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:14.093257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:14.095072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:14.095511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] PATH_INFO: `/v3/users/e41015ec5a9243eab336e9ebce77f017` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:14.099364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41015ec5a9243eab336e9ebce77f017)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:14.103903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:14.257307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41015ec5a9243eab336e9ebce77f017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:14.262568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:14.270209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41015ec5a9243eab336e9ebce77f017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:14.271420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41015ec5a9243eab336e9ebce77f017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:14.293043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41015ec5a9243eab336e9ebce77f017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:14.294024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41015ec5a9243eab336e9ebce77f017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:14.342051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3345/6661] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:13 2022] DELETE /identity/v3/users/e41015ec5a9243eab336e9ebce77f017 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:14.346919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:14.347410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:14.347508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:14.404930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:14.404930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:14.690399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3317/6662] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:14.772068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:14.773714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:14.993274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f3695-2d76-4950-96ee-960c17fa0b9e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:14.999234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:15.000053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:15.000262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:15.000491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:15.022032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:15.023219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902cb1b-fb7c-413e-90df-ea66163e92e5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:15.045252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3346/6663] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:15.157247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:15.158905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:15.179680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6ba30-02c5-4196-b3a7-4620a1e17f39 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:15.193502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:15.194442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:15.194872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:15.195317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] PATH_INFO: `/v3/users/5183f3f51ed94dfbbb857e55b249c0e0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:15.196625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5183f3f51ed94dfbbb857e55b249c0e0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:15.198764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:15.301646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5183f3f51ed94dfbbb857e55b249c0e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:15.302589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5183f3f51ed94dfbbb857e55b249c0e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:15.324548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5183f3f51ed94dfbbb857e55b249c0e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:15.325615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5183f3f51ed94dfbbb857e55b249c0e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:15.342179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5183f3f51ed94dfbbb857e55b249c0e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:15.365580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3318/6664] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:15 2022] DELETE /identity/v3/users/5183f3f51ed94dfbbb857e55b249c0e0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:15.370044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:15.370650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:15.371073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:15.396804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:15.398571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:15.526250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3347/6665] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:15.545642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:15.547287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:15.588218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:15.688421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dee5b-c671-41ca-8b0a-e10807d47bc2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:15.696856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:15.697667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:15.697978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:15.698249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:15.725246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:15.726696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:15.745645 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3319/6666] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:15.746829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:15.750604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:15.774363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0d00-af88-4803-9e00-d8689fbdb3b7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:15.784620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:15.788462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:15.788462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:15.788462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:15.797627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:16.027699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:16.029238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:16.047087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:16.092437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3348/6667] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:16.867856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:16.870004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.040416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:17.043311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.064591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f844-1639-4a78-b546-d8cfbc13ef3c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:17.073540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb37d4-1f9c-4878-8206-6cb22a0defd2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:17.078727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:17.079489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:17.079771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:17.080042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:17.080186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:17.081143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:17.081730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:17.082461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] PATH_INFO: `/v3/projects/156d657258ca406cbb8088fcf69951f5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:17.084006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=156d657258ca406cbb8088fcf69951f5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:17.085218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.090574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:17.118957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:17.122308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:17.157557 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3320/6668] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:17.194814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156d657258ca406cbb8088fcf69951f5', 'request_id': 'req-cba4dfba-566c-4c54-a4a1-99ff4041ae57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.205651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156d657258ca406cbb8088fcf69951f5', 'request_id': 'req-cba4dfba-566c-4c54-a4a1-99ff4041ae57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.243844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156d657258ca406cbb8088fcf69951f5', 'request_id': 'req-cba4dfba-566c-4c54-a4a1-99ff4041ae57'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.260033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:17.261758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.271419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] The token cache is being invalidate because project 156d657258ca406cbb8088fcf69951f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:17.272170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.273669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.279057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3349/6669] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:17 2022] DELETE /identity/v3/projects/156d657258ca406cbb8088fcf69951f5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:17.284384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:17.295412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.315125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752d18f-897a-4445-a90d-4f4e8ba601cd service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:17.594383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4dfba-566c-4c54-a4a1-99ff4041ae57 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:17.595514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:17.597213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:17.599499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:17.600854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] PATH_INFO: `/v3/projects/749183aaa57441b3a6275431366b7c13` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:17.603888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749183aaa57441b3a6275431366b7c13)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:17.613470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:17.614306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:17.617491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:17.618077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:17.618538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] PATH_INFO: `/v3/users/021665a90920422f893bafe02b9936db` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:17.623744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] RBAC: Authorizing `identity:delete_user(user_id=021665a90920422f893bafe02b9936db)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:17.626425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:17.723448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749183aaa57441b3a6275431366b7c13', 'request_id': 'req-4a616936-c6a0-4af7-9b7e-e77485f621c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.736837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:17.756625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749183aaa57441b3a6275431366b7c13', 'request_id': 'req-4a616936-c6a0-4af7-9b7e-e77485f621c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.782418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749183aaa57441b3a6275431366b7c13', 'request_id': 'req-4a616936-c6a0-4af7-9b7e-e77485f621c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.783558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021665a90920422f893bafe02b9936db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.803036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021665a90920422f893bafe02b9936db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.803877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021665a90920422f893bafe02b9936db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.821221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] The token cache is being invalidate because project 749183aaa57441b3a6275431366b7c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:17.821524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.824466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.824966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021665a90920422f893bafe02b9936db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.826471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021665a90920422f893bafe02b9936db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:17.837845 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3321/6670] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:17 2022] DELETE /identity/v3/projects/749183aaa57441b3a6275431366b7c13 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:17.848116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:17.853406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:17.868000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:17.898116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3350/6671] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:17 2022] DELETE /identity/v3/users/021665a90920422f893bafe02b9936db => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:18.056630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a616936-c6a0-4af7-9b7e-e77485f621c2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:18.236647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:18.237253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:18.237532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:18.237804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] PATH_INFO: `/v3/users/e0b014dd73da43d0b3e98b0591715dfe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:18.243091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b014dd73da43d0b3e98b0591715dfe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:18.246547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:18.393652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b014dd73da43d0b3e98b0591715dfe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:18.394331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b014dd73da43d0b3e98b0591715dfe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:18.402428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b014dd73da43d0b3e98b0591715dfe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:18.413728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b014dd73da43d0b3e98b0591715dfe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:18.423961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b014dd73da43d0b3e98b0591715dfe'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:18.480732 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3322/6672] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:17 2022] DELETE /identity/v3/users/e0b014dd73da43d0b3e98b0591715dfe => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:18.697301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:18.699162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:18.831573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:18.835844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:18.851139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:18.965590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8bdd9-9522-418c-b0d2-2481252c3add admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:19.065059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78589465-0ea9-4338-be96-cf0439167bcd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:19.070323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:19.071114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.071488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.071909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] PATH_INFO: `/v3/projects/5a03aa5df7e443179b4efac3be945de9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.073527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a03aa5df7e443179b4efac3be945de9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:19.075887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:19.121256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:19.122103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.122524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.122870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.126830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.147689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:19.149386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f92cd-3256-47a5-838d-0491d3654abc service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:19.175978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3351/6673] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:19.178208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a03aa5df7e443179b4efac3be945de9', 'request_id': 'req-30f91053-3168-4ef3-a9d0-d89ae6348f34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.190318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a03aa5df7e443179b4efac3be945de9', 'request_id': 'req-30f91053-3168-4ef3-a9d0-d89ae6348f34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.201463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a03aa5df7e443179b4efac3be945de9', 'request_id': 'req-30f91053-3168-4ef3-a9d0-d89ae6348f34'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.214797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] The token cache is being invalidate because project 5a03aa5df7e443179b4efac3be945de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:19.215319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.216281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30f91053-3168-4ef3-a9d0-d89ae6348f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.219260 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3323/6674] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:18 2022] DELETE /identity/v3/projects/5a03aa5df7e443179b4efac3be945de9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:19.223982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.224334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.224674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.250456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:19.251867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.367878 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3352/6675] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:19.377169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.377497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.377804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.419030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:19.420457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.443797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb75f2e-798d-4506-bf02-8afe53113e2e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:19.454399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:19.458182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:19.458966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.459350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.459716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] PATH_INFO: `/v3/projects/88c3aadcfdf54815a3590624d4a482d2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.460619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.461476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c3aadcfdf54815a3590624d4a482d2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:19.463497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:19.500812 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3324/6676] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:19.505598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:19.539896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:19.550017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e0f11-05e1-4b0d-a731-80831585be1f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:19.582048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:19.583406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.583691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.583967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.586723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:19.588321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:19.595949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:19.611568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c3aadcfdf54815a3590624d4a482d2', 'request_id': 'req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.624811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c3aadcfdf54815a3590624d4a482d2', 'request_id': 'req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.630782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3325/6677] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:19.633176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:19.661478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c3aadcfdf54815a3590624d4a482d2', 'request_id': 'req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.680137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d72cd-205b-4a56-8d0e-d6fd1977fee7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:19.698262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] The token cache is being invalidate because project 88c3aadcfdf54815a3590624d4a482d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:19.698831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.699726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-49e6fd17-74c0-4962-9a3f-83dc4e4989d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:19.702330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3353/6678] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:19 2022] DELETE /identity/v3/projects/88c3aadcfdf54815a3590624d4a482d2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:19.707290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59e13-31dc-41e1-857b-de4174a59f86 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.707290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59e13-31dc-41e1-857b-de4174a59f86 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.707545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59e13-31dc-41e1-857b-de4174a59f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.789398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-80c59e13-31dc-41e1-857b-de4174a59f86 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:19.791186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80c59e13-31dc-41e1-857b-de4174a59f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.840213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:19.840861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.841167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.841441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:19.842084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:19.848633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:19.915453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:19.943543 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3326/6679] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/projects => generated 361 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:19.944105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:19.953950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:19.969704 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3354/6680] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:19.971402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:19.971813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:19.971961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.033635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:20.035345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:20.086901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea71b-e4e1-4b50-a1cc-7641c1fe1e73 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.104763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.106650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.106650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.119404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.122100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.135450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.249688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3355/6681] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:20.256347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.263204 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3327/6682] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:19 2022] POST /identity/v3/users => generated 281 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:20.275487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.301611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb270-68b7-4441-942d-0fe8ecaac8ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.335218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.335872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911d79f-5226-4327-bf81-06b95c53f830 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.336179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.336611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.337064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.338178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:20.338681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.341612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.367200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.368565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.369084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.369761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.370862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.373759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.398311 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3356/6683] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:20.406551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.425459 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3328/6684] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:20.429293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.456875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf4be2-6cb3-482d-b453-c8e730159da1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.473675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1cc60-be26-4c10-9b0c-0d2edb81d18b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.488693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.491198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.491676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.492134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.493318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.497986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.498973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.499439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.499879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.500923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.504931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.529805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.575865 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3329/6685] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:20.584972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.627163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252da7-25ce-4e2a-9021-a9e9b54caffe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.647519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:20.650889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.651376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.651850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] PATH_INFO: `/v3/projects/be2aaf8387ef4f15a3dc6ed29a869b4e/users/f529043f26444b188739fb9fdb9920a9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.659196 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3357/6686] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:20 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:20.669206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:20.722507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:20.744170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2aaf8387ef4f15a3dc6ed29a869b4e, user_id=f529043f26444b188739fb9fdb9920a9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:20.761036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec801db-0ce9-42f6-9e74-5d9ac72ae1d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:20.804085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3330/6687] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:20 2022] PUT /identity/v3/projects/be2aaf8387ef4f15a3dc6ed29a869b4e/users/f529043f26444b188739fb9fdb9920a9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:20.815419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9f18-f7ca-4025-b4df-6847b1536d90 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:20.815887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9f18-f7ca-4025-b4df-6847b1536d90 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:20.816346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd9f18-f7ca-4025-b4df-6847b1536d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:20.853688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c803-e1ee-460f-b8b0-cc45c20ffc5e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:20.903389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38bd9f18-f7ca-4025-b4df-6847b1536d90 None None] MFA Rules not processed for user `f529043f26444b188739fb9fdb9920a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:20.906444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38bd9f18-f7ca-4025-b4df-6847b1536d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.006512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.007757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.008085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.008376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.009030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.013027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.069776 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3331/6688] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:21.074359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3358/6689] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:20 2022] POST /identity/v3/users => generated 300 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:21.078777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.079049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414d7e-87ba-4d7e-ad40-f8c59dfb7a0c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.079406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414d7e-87ba-4d7e-ad40-f8c59dfb7a0c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.079680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414d7e-87ba-4d7e-ad40-f8c59dfb7a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.103571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e6f19-84d9-4ccb-8e30-b707aadf4193 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.115384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b1414d7e-87ba-4d7e-ad40-f8c59dfb7a0c None None] MFA Rules not processed for user `f529043f26444b188739fb9fdb9920a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:21.116589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b1414d7e-87ba-4d7e-ad40-f8c59dfb7a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.120029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.120985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.121404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.121681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.122506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.126336 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3332/6690] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:21 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:34:21.127177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.133477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.133808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.134021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.150509 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3359/6691] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:21.154692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.174437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] MFA Rules not processed for user `f529043f26444b188739fb9fdb9920a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:21.175586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e479-c8af-4d90-b148-81ab4f338c23 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.175825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.181602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.182627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.184546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.185033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] PATH_INFO: `/v3/projects/6f18500e0100494d8622a24061304f7e/users/d8a4cc665905488a9bed3ea8d2e6c4b8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.185815 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3333/6692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:21 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 16:34:21.186766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.211024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18500e0100494d8622a24061304f7e, user_id=d8a4cc665905488a9bed3ea8d2e6c4b8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.212850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf92b-6552-4788-a5d1-dbaac148c3e4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.214856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.227821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.228636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.229013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.229408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.238903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorizing `identity:check_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.240618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.247874 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3334/6693] 10.222.0.78 () {56 vars in 1264 bytes} [Tue Oct 18 16:34:21 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 18 16:34:21.251856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.253032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3360/6694] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:21 2022] PUT /identity/v3/projects/6f18500e0100494d8622a24061304f7e/users/d8a4cc665905488a9bed3ea8d2e6c4b8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:21.256916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.267645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794791-289a-44e6-a34d-0657b99b24a5 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.274559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:21.372350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.373103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.375186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.375545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.390509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.397525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.424782 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3335/6695] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 18 16:34:21 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 16:34:21.426413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.437890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257082b0-d5f5-4f6f-90af-97544ce5c58a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.450342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.452294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc345e-ec48-4a53-82c9-576c22b6a04d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.456443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.456806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.458195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.458926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.462115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.471620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.474539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.474824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.476858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.492473 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3361/6696] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:21.497356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.498969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.500239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.524099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d175101-b00c-4497-b3ba-39a25b0b8ed8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.538119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.538801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.540277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.540625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] PATH_INFO: `/v3/projects/6f18500e0100494d8622a24061304f7e/users/d8a4cc665905488a9bed3ea8d2e6c4b8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.546695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18500e0100494d8622a24061304f7e, user_id=d8a4cc665905488a9bed3ea8d2e6c4b8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:21.549300 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3336/6697] 10.222.0.78 () {56 vars in 1266 bytes} [Tue Oct 18 16:34:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:21.550713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.559611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82ede-934b-4939-a0e4-7689c8fd217b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:21.567121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c66d71-7d4c-475a-96e9-3775057d9e4d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.572365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3362/6698] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:21 2022] PUT /identity/v3/projects/6f18500e0100494d8622a24061304f7e/users/d8a4cc665905488a9bed3ea8d2e6c4b8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:21.584336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:21.585733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a6f1-6d23-4218-b147-d3b4b5fec397 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.586083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a6f1-6d23-4218-b147-d3b4b5fec397 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.586421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a6f1-6d23-4218-b147-d3b4b5fec397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.634378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c045a6f1-6d23-4218-b147-d3b4b5fec397 None None] MFA Rules not processed for user `d8a4cc665905488a9bed3ea8d2e6c4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:21.637847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c045a6f1-6d23-4218-b147-d3b4b5fec397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.719355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.720162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `HEAD` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.720905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.721412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.724039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 18 16:34:21.745077 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 16:34:21.746365 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:34:21.747672 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:21.754854 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3337/6699] 10.222.0.78 () {56 vars in 1264 bytes} [Tue Oct 18 16:34:21 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 18 16:34:21.756046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.758464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.846622 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3363/6700] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:21.846622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.846622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.846622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.896907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] MFA Rules not processed for user `f529043f26444b188739fb9fdb9920a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:21.898181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:21.909946 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3364/6701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:21 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 16:34:21.910852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:21.929133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f533eae-2c0d-4508-ade0-6210cba0f98e tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:21.949243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:21.949879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:21.950114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:21.950384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:21.955558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:22.018445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:22.101577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4578c85-e53d-4b5e-923a-c2bbfe5f18f2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.119421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.120052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.120325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.120596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.121262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.123221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.147158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.148759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.187527 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3338/6702] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:22.188468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.219984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2125e8-37df-44fe-9173-0d93e1f9f398 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.227709 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3365/6703] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:22.229514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.372921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d49-756d-4991-a65f-2e85b80a8fd2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.380055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.380701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.381062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.381621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.382279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.384710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.399805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:22.404120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.406786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.407175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.407418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.443093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.450287 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3366/6704] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:22 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:22.451492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.455726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.471376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11315788-2e8c-48a9-8b2f-a594e77f6d23 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.485993 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3339/6705] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 18 16:34:22 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 16:34:22.487129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.488905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.489183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.489459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.489726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.490368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.491965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.503772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf61ed-2a27-41f2-a335-8b552f1e059d tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.516667 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3367/6706] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:22.517711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.517844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.518376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.519049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.519049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.533998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.535468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.537992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a2e9-47ce-44d9-9096-7d60c8e6efcc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.560489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.562826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.563860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.564206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.567530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3340/6707] 10.222.0.78 () {56 vars in 1266 bytes} [Tue Oct 18 16:34:22 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:22.567691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.568747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.569805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.587751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec87f-79d7-4dfe-889c-a179e34562b6 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.596227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3368/6708] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:22.598498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.601888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f529043f26444b188739fb9fdb9920a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.603169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.607814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.622474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.628787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540369b7-b36f-4336-b489-4e77b390daaf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.631755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:22.654655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.655667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.656049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.656419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] PATH_INFO: `/v3/projects/898c35a10559403bb455f376bf7f4f9b/users/9dfbb2aab22e42898187bff3ec9421ce/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 18 16:34:22.680185 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 18 16:34:22.681431 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 18 16:34:22.682697 n-d-858383-14 devstack@keystone.service[81775]: ERROR keystone.server.flask.application Oct 18 16:34:22.689742 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3341/6709] 10.222.0.78 () {56 vars in 1263 bytes} [Tue Oct 18 16:34:22 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 16:34:22.692253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:22.706275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898c35a10559403bb455f376bf7f4f9b, user_id=9dfbb2aab22e42898187bff3ec9421ce, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.721958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f67ac-3672-454f-94f3-6358c1b84c51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.735882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc8b8-c6a3-46d8-a32b-075e53962b49 tempest-TokensV3Test-1881009636 tempest-TokensV3Test-1881009636-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:22.757438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:22.760640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.761023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.761497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] PATH_INFO: `/v3/users/f529043f26444b188739fb9fdb9920a9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.763234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f529043f26444b188739fb9fdb9920a9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:22.764631 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3369/6710] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:22 2022] PUT /identity/v3/projects/898c35a10559403bb455f376bf7f4f9b/users/9dfbb2aab22e42898187bff3ec9421ce/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:22.766088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:22.876251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.877157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.877157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:22.890673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f529043f26444b188739fb9fdb9920a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:22.891745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f529043f26444b188739fb9fdb9920a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:22.900460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f529043f26444b188739fb9fdb9920a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:22.901534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f529043f26444b188739fb9fdb9920a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:22.914507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2ac160fa-03ad-49a3-96c1-f807014ee1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f529043f26444b188739fb9fdb9920a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:22.962617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] MFA Rules not processed for user `9dfbb2aab22e42898187bff3ec9421ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:22.963851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:22.984771 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3342/6711] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:22 2022] DELETE /identity/v3/users/f529043f26444b188739fb9fdb9920a9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:22.990032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:22.990283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:22.990506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:23.038133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:23.044330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:23.058153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:23.178300 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3370/6712] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:23.188054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:23.189617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:23.219611 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3343/6713] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:23.307376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e7b04-ffdc-4691-bc47-0918841f74ab None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:23.415264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:23.416065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:23.416524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:23.416898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:23.419091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:23.426209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:23.528335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:23.531295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:23.542680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:23.549699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:23.583463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3371/6714] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:34:23.724911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b98b5-a891-44f9-aa1b-c889edae5192 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:23.739812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:23.740450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:23.740862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:23.741180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:23.769051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:23.770668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:23.792435 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3344/6715] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:25.130580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:25.132980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.175325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d875-3a43-472b-ad4b-f4f78fa14953 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:25.195784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:25.196454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:25.196718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:25.196987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] PATH_INFO: `/v3/users/d8a4cc665905488a9bed3ea8d2e6c4b8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:25.201896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a4cc665905488a9bed3ea8d2e6c4b8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:25.204236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:25.321284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:25.323409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.348279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a4cc665905488a9bed3ea8d2e6c4b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.380471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a4cc665905488a9bed3ea8d2e6c4b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.382521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a4cc665905488a9bed3ea8d2e6c4b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.403148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a4cc665905488a9bed3ea8d2e6c4b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.407931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08ef4ab7-540e-4982-aef0-c11059b90814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a4cc665905488a9bed3ea8d2e6c4b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.411620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c2ae-0bac-46cc-ad29-1ee495494412 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:25.432348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:25.438683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:25.439165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:25.439800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] PATH_INFO: `/v3/projects/be2aaf8387ef4f15a3dc6ed29a869b4e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:25.441433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2aaf8387ef4f15a3dc6ed29a869b4e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:25.455617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:25.480490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3372/6716] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:25 2022] DELETE /identity/v3/users/d8a4cc665905488a9bed3ea8d2e6c4b8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:25.481613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:25.481842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:25.482116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:25.558390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:25.559635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.601696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'request_id': 'req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.622525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'request_id': 'req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.632352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2aaf8387ef4f15a3dc6ed29a869b4e', 'request_id': 'req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.651926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] The token cache is being invalidate because project be2aaf8387ef4f15a3dc6ed29a869b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:25.652479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.653547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a68a087b-88ea-4ee1-84a1-216a5fdde2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:25.659615 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3345/6717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:25 2022] DELETE /identity/v3/projects/be2aaf8387ef4f15a3dc6ed29a869b4e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:25.666385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b316-c52b-4495-a27a-b115dab7657a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:25.666915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b316-c52b-4495-a27a-b115dab7657a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:25.667409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b316-c52b-4495-a27a-b115dab7657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:25.730267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cbb5b316-c52b-4495-a27a-b115dab7657a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:25.731697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbb5b316-c52b-4495-a27a-b115dab7657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.816709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:25.830100 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3373/6718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:25.831127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:25.842173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.890525 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3346/6719] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:25.890983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:25.892121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:25.892542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:25.892697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:25.953451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:25.954795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:25.986390 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3347/6720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:25.987584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.002649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd4152-5b03-4fd9-8436-be6c40b554f7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.018588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.019266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.019555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.019847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.020510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:26.020816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.022905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.023273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6f9d-b42b-4cfb-8dce-5044f96c3d1a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.040075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.041109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.044636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.045201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.052584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3348/6721] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:26.053746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.077174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60e220-4f2f-4730-82fb-83633c2a6a6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.081854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.083874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.086985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.087610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.087890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.088169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.088803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.090771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.111583 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3374/6722] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:26.161262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3349/6723] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:26 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:26.163376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.199201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153e48e-9901-4123-bd81-24f3c0b712ac service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.336693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.337743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.338237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.338736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.341130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.349550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.414359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3375/6724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:26 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:26.414897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.440787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72749625-ac9a-492a-8730-f2ddba2a90bb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.458795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.460326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.460619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.460891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.461980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.463772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.482251 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3350/6725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:26.487428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.504508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ddfcb-ac99-42e9-a095-608aa4d1b6dd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.543113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.544399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.544802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.548086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.549013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.557343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf5c1-c531-4e51-ac62-6ac8a2c57b2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.586381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3376/6726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:26.588297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.606189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e1cdf-63dd-41fe-bc09-25a0537041e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:26.615932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:26.616619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.616901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.617222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] PATH_INFO: `/v3/projects/b2b0fdfe283e42779e06b41e9617b411/users/5894b1913bc94177809ce30744523ffe/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.652767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0fdfe283e42779e06b41e9617b411, user_id=5894b1913bc94177809ce30744523ffe, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:26.655983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:26.690976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3351/6727] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:26 2022] PUT /identity/v3/projects/b2b0fdfe283e42779e06b41e9617b411/users/5894b1913bc94177809ce30744523ffe/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:26.701456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:26.702325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:26.703831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:26.794583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] MFA Rules not processed for user `5894b1913bc94177809ce30744523ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:26.797940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:26.856723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:26.861514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:27.032462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3377/6728] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:27.043299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33d72a-529f-4a3b-a849-3273cf9b3b61 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:27.055745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:27.055745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:27.084653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:27.085658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:27.086040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:27.086817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] PATH_INFO: `/v3/projects/6f18500e0100494d8622a24061304f7e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:27.089882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18500e0100494d8622a24061304f7e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:27.093652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:27.131213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:27.223631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18500e0100494d8622a24061304f7e', 'request_id': 'req-683a1d94-3e82-4cde-9532-21001fcba147'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.228470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659d30a-b33d-4a55-b341-f7b458fa1825 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:27.237816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18500e0100494d8622a24061304f7e', 'request_id': 'req-683a1d94-3e82-4cde-9532-21001fcba147'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.254774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18500e0100494d8622a24061304f7e', 'request_id': 'req-683a1d94-3e82-4cde-9532-21001fcba147'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.257731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:27.297145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] The token cache is being invalidate because project 6f18500e0100494d8622a24061304f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:27.304484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.311792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.314146 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3352/6729] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:26 2022] DELETE /identity/v3/projects/6f18500e0100494d8622a24061304f7e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:27.317830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:27.324640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:27.383884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:27.385071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:27.385071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:27.385488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:27.391780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:27.502662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1d94-3e82-4cde-9532-21001fcba147 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:27.536752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:27.538593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:27.538885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:27.539158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] PATH_INFO: `/v3/users/9dfbb2aab22e42898187bff3ec9421ce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:27.543719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfbb2aab22e42898187bff3ec9421ce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:27.547621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:27.632510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:27.637755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:27.653999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfbb2aab22e42898187bff3ec9421ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.656305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfbb2aab22e42898187bff3ec9421ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.662378 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3378/6730] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:27.685530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfbb2aab22e42898187bff3ec9421ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.686415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfbb2aab22e42898187bff3ec9421ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.704748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b3c4f826-144c-4d66-bb96-4ff9b5384740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfbb2aab22e42898187bff3ec9421ce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:27.743197 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3353/6731] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:27 2022] DELETE /identity/v3/users/9dfbb2aab22e42898187bff3ec9421ce => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:27.840437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:27.843816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:27.872221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d3fbc-b62e-4f31-861b-af6d4930fa69 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:28.008604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:28.009766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:28.010239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:28.010674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] PATH_INFO: `/v3/users/5894b1913bc94177809ce30744523ffe` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:28.012060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5894b1913bc94177809ce30744523ffe)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:28.020289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:28.143799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:28.160684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5894b1913bc94177809ce30744523ffe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:28.171230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5894b1913bc94177809ce30744523ffe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:28.171977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5894b1913bc94177809ce30744523ffe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:28.182992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5894b1913bc94177809ce30744523ffe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:28.184034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5894b1913bc94177809ce30744523ffe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:28.215505 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3379/6732] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:27 2022] DELETE /identity/v3/users/5894b1913bc94177809ce30744523ffe => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:28.219814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:28.220182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:28.220530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:28.263607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:28.265752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:28.433766 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3354/6733] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:28.449629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:28.451288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:28.610756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9fa6b-4e42-4fd8-8a7b-9cd259b85026 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:28.619346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:28.628667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:28.629341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:28.630044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:28.646357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:28.648129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:28.678712 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3380/6734] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:29.063832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:29.065880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:29.091054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856b770-f7f0-4927-8c05-7d6fdd450c6c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:29.157407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:29.161932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:29.162324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:29.162486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] PATH_INFO: `/v3/projects/898c35a10559403bb455f376bf7f4f9b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:29.164358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898c35a10559403bb455f376bf7f4f9b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:29.177668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:29.191646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:29.303942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:29.305608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:29.330220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629252cb-4608-4aa9-9fb9-03be500a3161 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:29.345093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898c35a10559403bb455f376bf7f4f9b', 'request_id': 'req-362ba20b-69ae-4c9b-84f8-7abfbd432003'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:29.369496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898c35a10559403bb455f376bf7f4f9b', 'request_id': 'req-362ba20b-69ae-4c9b-84f8-7abfbd432003'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:29.429092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898c35a10559403bb455f376bf7f4f9b', 'request_id': 'req-362ba20b-69ae-4c9b-84f8-7abfbd432003'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:29.471407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] The token cache is being invalidate because project 898c35a10559403bb455f376bf7f4f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:29.472156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:29.472876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-362ba20b-69ae-4c9b-84f8-7abfbd432003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:29.478098 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3355/6735] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:29 2022] DELETE /identity/v3/projects/898c35a10559403bb455f376bf7f4f9b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:29.487597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4054-8271-4284-b1b5-891beb27974a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:29.487886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4054-8271-4284-b1b5-891beb27974a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:29.488337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a4054-8271-4284-b1b5-891beb27974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:29.538772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:29.539543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:29.539882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:29.543563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:29.545321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-707a4054-8271-4284-b1b5-891beb27974a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:29.546796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-707a4054-8271-4284-b1b5-891beb27974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:29.547377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:29.651496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:29.653521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c737-4f45-4518-bee1-2a21b86278d8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:29.666700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3381/6736] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:29.774597 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3356/6737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:29.783233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:29.783598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:29.783978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:29.814250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:29.830693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:29.832284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:29.855556 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3382/6738] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:29.860591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4054-8271-4284-b1b5-891beb27974a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:29.882175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a4054-8271-4284-b1b5-891beb27974a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:29.918657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:29.919651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:29.924545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:29.925164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:29.926073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:29.926566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:29.930304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:29.989763 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3357/6739] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:29.990938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.009275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1434a6-e71f-4dd5-b1dd-a4545359b74a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.027565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:30.031529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.032002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.033790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.034603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:30.055758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:30.163528 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3383/6740] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:29 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:30.169540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.194592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595488-a3db-4974-8445-901a5f0bee60 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.328802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.330667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:30.434488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:30.437933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.438337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.438702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.439453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:30.445981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:30.486872 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3358/6741] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:30 2022] POST /identity/v3/users => generated 296 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:30.491059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.532134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fca87-d971-4e1f-9340-5f83676ffd34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.545342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:30.547167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.547670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.550017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.551678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:30.553653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:30.562313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:30.576276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3359/6742] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:30.579008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.591551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8e864-7a50-47ad-a541-9ab7d08efef2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.611503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:30.611815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c757d18-2f6a-4e04-a72d-0fba5900a0e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.612622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.613018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.613519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] PATH_INFO: `/v3/projects/b2b0fdfe283e42779e06b41e9617b411` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.614952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b0fdfe283e42779e06b41e9617b411)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:30.624454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:30.632369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:30.633390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.633836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.634272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] PATH_INFO: `/v3/projects/461412979c7f4be0a896043cb73488fc/users/d7c51f6b69644c24b0610b1ab61c1fb6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.675022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461412979c7f4be0a896043cb73488fc, user_id=d7c51f6b69644c24b0610b1ab61c1fb6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:30.681573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:30.712107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3360/6743] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:30 2022] PUT /identity/v3/projects/461412979c7f4be0a896043cb73488fc/users/d7c51f6b69644c24b0610b1ab61c1fb6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:30.716319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:30.777573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b0fdfe283e42779e06b41e9617b411', 'request_id': 'req-ba058776-cfff-44f8-b8d9-d8fe1e174db3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:30.794449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b0fdfe283e42779e06b41e9617b411', 'request_id': 'req-ba058776-cfff-44f8-b8d9-d8fe1e174db3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:30.803831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b0fdfe283e42779e06b41e9617b411', 'request_id': 'req-ba058776-cfff-44f8-b8d9-d8fe1e174db3'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:30.835491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] The token cache is being invalidate because project b2b0fdfe283e42779e06b41e9617b411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:30.835895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:30.845079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ba058776-cfff-44f8-b8d9-d8fe1e174db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:30.846970 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3384/6744] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:30 2022] DELETE /identity/v3/projects/b2b0fdfe283e42779e06b41e9617b411 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:30.851791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65233f-fb3f-43bd-8695-f35a6025e50e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:30.852198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65233f-fb3f-43bd-8695-f35a6025e50e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:30.852591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65233f-fb3f-43bd-8695-f35a6025e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:30.878158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f41bf-6577-49ce-85c4-bb54153d20a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:30.903470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ec65233f-fb3f-43bd-8695-f35a6025e50e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:30.906830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec65233f-fb3f-43bd-8695-f35a6025e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:31.028743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3385/6745] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:31.037944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.039254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.039645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.099700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.099700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.099700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.099700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.100212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.100212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.124924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3361/6746] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:31.129068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.131471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:31.148172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810298b3-6d56-43a8-bd79-96bb6357c78c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.157581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:31.158514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.158829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:31.160607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.161097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.161759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] PATH_INFO: `/v3/projects/461412979c7f4be0a896043cb73488fc/users/d7c51f6b69644c24b0610b1ab61c1fb6/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.164462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461412979c7f4be0a896043cb73488fc, user_id=d7c51f6b69644c24b0610b1ab61c1fb6, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.170941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5b412-b212-42e8-8568-7e642ebc1301 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.200377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3386/6748] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:31.201341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.205591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3362/6748] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:31 2022] PUT /identity/v3/projects/461412979c7f4be0a896043cb73488fc/users/d7c51f6b69644c24b0610b1ab61c1fb6/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:31.207948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:31.212037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.212326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.212608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.226491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d717da5-e0e8-4e2a-bea5-1b4580ff1c86 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.279441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] MFA Rules not processed for user `d7c51f6b69644c24b0610b1ab61c1fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:31.284085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:31.355168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.355710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.355985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.356253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.356933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:31.357231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.365475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.387144 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3387/6749] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:31.388246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.406869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ea06-4a91-43aa-8d91-2e78036480ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.426351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.427546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.428050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.428468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.429494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.431896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.488013 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3388/6750] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:31.490198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.509711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:31.622530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3363/6751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:31.628298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.658029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b51c-6c00-4710-8283-6192816abb40 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.677996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa858e-7b5f-4976-8bfd-69b550cd53d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.683348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.684088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.684471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.685118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.686760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.691636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.708550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:31.708550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:31.721353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:31.721353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:31.721353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:31.721353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:31.792799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3389/6752] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:31.796028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.811897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3364/6753] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:31.813321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:31.832363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90f48-13ca-4f33-ad6a-b1bd129cf56b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:31.996548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bde80e-0a88-4dae-bc1f-4c3008f7f85d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.003260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.005219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.005900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.006179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.006440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.006568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.006732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.007030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.007272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.007669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.009453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.012630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.020947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:32.034665 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3390/6754] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:32.038763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.059269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3365/6755] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:31 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:32.062719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f64d6b-f925-450a-a885-43253eb2a87b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.063806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.078461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.079269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.079546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.079811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.080468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.082289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.096045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e3fc-5f6a-49e9-9dd6-745ea93c3076 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.113980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.114654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.121409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.121736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.123533 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3391/6756] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:32.123716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.124656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.128098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.154414 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3366/6757] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:32.159029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.174262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570cf02-5396-4183-b5f9-8d3e90bdc1e4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.192170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.192854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.193155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.193426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] PATH_INFO: `/v3/projects/6bfc2150a4564dcbb2f425c2740dd5c1/users/02dea4211c1f4da7b5a7eb9b6419c0d9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.199309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3bb06-b439-4849-aefe-497605a27ddc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.221268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfc2150a4564dcbb2f425c2740dd5c1, user_id=02dea4211c1f4da7b5a7eb9b6419c0d9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.224078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7cc1-30a6-436e-817d-5feb3d4998b4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.225869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.249095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.268925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.269297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.270721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.271758 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3392/6758] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:32 2022] PUT /identity/v3/projects/6bfc2150a4564dcbb2f425c2740dd5c1/users/02dea4211c1f4da7b5a7eb9b6419c0d9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:32.282038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.285098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.285589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.286123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.286329 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3367/6759] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:32.290885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.312047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c93ad-bcb0-4303-a65e-cbeb3b75e03f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.328302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] MFA Rules not processed for user `02dea4211c1f4da7b5a7eb9b6419c0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:32.332104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:32.444492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.446164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.451192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.452426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] PATH_INFO: `/v3/projects/0fa05cd124644078a2869f86632e0d8b/users/e868e3bab2cf41bc8886c72ea5b559ef/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.527007 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3393/6760] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:32.532751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.533765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa05cd124644078a2869f86632e0d8b, user_id=e868e3bab2cf41bc8886c72ea5b559ef, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.538246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc881337-ebab-42cc-a5f2-1bea90f25024 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.571412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcc26a-dda0-4692-a2fd-8ca3e7804225 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:32.586591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3368/6761] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:32 2022] PUT /identity/v3/projects/0fa05cd124644078a2869f86632e0d8b/users/e868e3bab2cf41bc8886c72ea5b559ef/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:32.604301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.606507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.607306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.687718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] MFA Rules not processed for user `e868e3bab2cf41bc8886c72ea5b559ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:32.693209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:32.718445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:32.779203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:32.780151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:32.780151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:32.780594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:32.781584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:32.783843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:32.862047 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3394/6762] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:32 2022] POST /identity/v3/projects => generated 377 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:32.868611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.921310 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3369/6763] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:32.949803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:32.953724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:33.001712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:33.036590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f713d6-3aa8-46c7-88f1-a293ccaf5d64 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.104504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb737-fb7f-48c1-9101-5f1401ee6f58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.122676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.124257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.129659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.130966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.131436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.132169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.132374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.132630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.133022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.137129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.207663 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3395/6764] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:32 2022] POST /identity/v3/users => generated 295 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:33.213501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:33.233662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e870b1-12b5-4b5a-9364-8cd5bf81ed2f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.246927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.248051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.249572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.249890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.252824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.255851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.278404 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3396/6765] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:33.282186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:33.312812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbac41-de86-4a11-b6f1-d4bae17a5ca2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.314640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.316216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.323207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.324673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.324673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.324969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] PATH_INFO: `/v3/projects/7f4c4020e3484ea1b816756a75a79d06/users/ec9d13edc0994d118ecbd5602ac98d79/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.338319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3370/6766] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:34:33.370628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4c4020e3484ea1b816756a75a79d06, user_id=ec9d13edc0994d118ecbd5602ac98d79, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.373649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.396172 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3397/6767] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:33 2022] PUT /identity/v3/projects/7f4c4020e3484ea1b816756a75a79d06/users/ec9d13edc0994d118ecbd5602ac98d79/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:33.399908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:33.419411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843bc10-fdfe-4cab-909e-931a4039049d service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.445854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:33.556553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.558898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.559344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.560217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.561324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.563631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed841a86-3a0a-4024-8285-d3af70fabe5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.577736 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3371/6768] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:33.581782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:33.598601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99693960-f0f4-4418-b291-b3fc569cf235 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:33.605655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:33.606750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.607189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.607652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] PATH_INFO: `/v3/projects/7f4c4020e3484ea1b816756a75a79d06/users/ec9d13edc0994d118ecbd5602ac98d79/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.612403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4c4020e3484ea1b816756a75a79d06, user_id=ec9d13edc0994d118ecbd5602ac98d79, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:33.615543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:33.641455 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3398/6769] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:33 2022] PUT /identity/v3/projects/7f4c4020e3484ea1b816756a75a79d06/users/ec9d13edc0994d118ecbd5602ac98d79/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:33.643475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:33.644138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:33.644639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:33.691812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] MFA Rules not processed for user `ec9d13edc0994d118ecbd5602ac98d79`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:33.693699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:33.915240 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3372/6770] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:34.013247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:34.018261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:34.189404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c57922-f31b-4043-b7b0-0876ef88fe2e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:34.203188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:34.204144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:34.204617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:34.216512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:34.254397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:34.256410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c8d03-a425-4d6d-b784-68ef7ceceae6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:34.277774 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3399/6771] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:34.475363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:34.631631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3a299-0f2a-48a3-854a-fa635016f164 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:34.661583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:34.662253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:34.662529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:34.662806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] PATH_INFO: `/v3/users/d7c51f6b69644c24b0610b1ab61c1fb6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:34.664631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c51f6b69644c24b0610b1ab61c1fb6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:34.666654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:34.770552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:34.786966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c51f6b69644c24b0610b1ab61c1fb6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:34.788634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c51f6b69644c24b0610b1ab61c1fb6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:34.813288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c51f6b69644c24b0610b1ab61c1fb6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:34.818911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c51f6b69644c24b0610b1ab61c1fb6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:34.837260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c51f6b69644c24b0610b1ab61c1fb6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:34.877009 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3373/6772] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:34 2022] DELETE /identity/v3/users/d7c51f6b69644c24b0610b1ab61c1fb6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:34.881663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:34.881945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:34.882218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:34.946281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:34.952288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:35.075090 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3400/6773] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:35.168190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:35.169848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:35.325197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4702-eba5-4129-9ec4-1891a34a610c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:35.339668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:35.340312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:35.340589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:35.340893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:35.365294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:35.367571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:35.393878 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3374/6774] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:37.216375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:37.218741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:37.285049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c8cb-0227-4c4a-99a9-d3ab573aa719 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:37.303626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:37.306650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:37.309256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:37.309832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] PATH_INFO: `/v3/projects/461412979c7f4be0a896043cb73488fc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:37.313750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461412979c7f4be0a896043cb73488fc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:37.321381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:37.414680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:37.515966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461412979c7f4be0a896043cb73488fc', 'request_id': 'req-edd22f20-e7db-4341-97e5-4566c762f270'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.542665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461412979c7f4be0a896043cb73488fc', 'request_id': 'req-edd22f20-e7db-4341-97e5-4566c762f270'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.567930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461412979c7f4be0a896043cb73488fc', 'request_id': 'req-edd22f20-e7db-4341-97e5-4566c762f270'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.610904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] The token cache is being invalidate because project 461412979c7f4be0a896043cb73488fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:37.621804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.622970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.626624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3401/6775] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:37 2022] DELETE /identity/v3/projects/461412979c7f4be0a896043cb73488fc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:37.630817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:37.656976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1d07-19b0-41d1-9d41-b6f9a769e636 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:37.819656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:37.820320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:37.820597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:37.820863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] PATH_INFO: `/v3/users/e868e3bab2cf41bc8886c72ea5b559ef` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:37.822301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e868e3bab2cf41bc8886c72ea5b559ef)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:37.824426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:37.954320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e868e3bab2cf41bc8886c72ea5b559ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.955115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e868e3bab2cf41bc8886c72ea5b559ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.970004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e868e3bab2cf41bc8886c72ea5b559ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.970785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e868e3bab2cf41bc8886c72ea5b559ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:37.986182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:37.996507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8aca5ebc-59f6-4eaf-b0af-1d6118ca4bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e868e3bab2cf41bc8886c72ea5b559ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:38.056969 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3375/6776] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:37 2022] DELETE /identity/v3/users/e868e3bab2cf41bc8886c72ea5b559ef => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:39.388275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:39.392387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:39.443851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd22f20-e7db-4341-97e5-4566c762f270 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:39.649836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:39.651589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:39.652157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:39.652673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] PATH_INFO: `/v3/projects/0fa05cd124644078a2869f86632e0d8b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:39.655204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa05cd124644078a2869f86632e0d8b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:39.657689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:39.755480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa05cd124644078a2869f86632e0d8b', 'request_id': 'req-c5462335-186b-468e-af5b-499955abf984'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:39.770261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa05cd124644078a2869f86632e0d8b', 'request_id': 'req-c5462335-186b-468e-af5b-499955abf984'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:39.782678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa05cd124644078a2869f86632e0d8b', 'request_id': 'req-c5462335-186b-468e-af5b-499955abf984'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:39.823753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] The token cache is being invalidate because project 0fa05cd124644078a2869f86632e0d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:39.823753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:39.824579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c5462335-186b-468e-af5b-499955abf984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:39.838033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3402/6777] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:39 2022] DELETE /identity/v3/projects/0fa05cd124644078a2869f86632e0d8b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:39.839160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:39.839686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:39.839686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:39.881653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:39.883195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:40.034675 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3376/6778] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:40.042877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.044363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.044363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.102275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:40.103567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:40.121026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3403/6779] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:40.126467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.145139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb2bda-5e8e-4658-bae8-c068f39d9496 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.158031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.158890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.159914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.159914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.160352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:40.160730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.162703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.186132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3377/6780] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:34:40.190861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.214637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70b32a-a562-45ef-a29f-d512a60499c1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.222984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.223946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.224376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.224700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.225474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.228293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.283595 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3404/6781] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:40 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:40.287347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.307253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd421-5fff-4ad4-a31d-616fd412da49 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.408731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.409550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.409854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.410141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.410994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.412826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.496539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3378/6782] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:40 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:40.501080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.547807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e043c-8e4f-46ff-bbaa-740e8fb78a6d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.559906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.562167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.562514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.562954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.564396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.567666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.582721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:40.606104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3405/6783] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:40.611362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.628967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c6003-d371-4b05-b0b5-df0b359a7507 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.640948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.641633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.641902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.642169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.644926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.646618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.659629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.663382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:40.689801 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3379/6784] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:40.691934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:40.694652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f383e-53b5-4ebe-8dbe-e00eba5a9045 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.713120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ec832-45ae-45ad-9407-9cdb5b7e85ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:40.717913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.718776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.719116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.719459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] PATH_INFO: `/v3/users/02dea4211c1f4da7b5a7eb9b6419c0d9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.723304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02dea4211c1f4da7b5a7eb9b6419c0d9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.729396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.737049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:40.737744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.738020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.738289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] PATH_INFO: `/v3/projects/dacec1cd2016481ea2bbbac834a2b75f/users/592086ce16744a54bc7442625256a860/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.781090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacec1cd2016481ea2bbbac834a2b75f, user_id=592086ce16744a54bc7442625256a860, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:40.784589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8e6f3-51a8-4ce9-bab9-9e94ca9d2f81 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:40.814692 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3380/6785] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:40 2022] PUT /identity/v3/projects/dacec1cd2016481ea2bbbac834a2b75f/users/592086ce16744a54bc7442625256a860/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:40.827348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.827980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.828597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.858525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02dea4211c1f4da7b5a7eb9b6419c0d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:40.871153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02dea4211c1f4da7b5a7eb9b6419c0d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:40.872304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02dea4211c1f4da7b5a7eb9b6419c0d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:40.885980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02dea4211c1f4da7b5a7eb9b6419c0d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:40.887192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c4abb7c4-d981-43f8-90d1-e804eb778202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02dea4211c1f4da7b5a7eb9b6419c0d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:40.900107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] MFA Rules not processed for user `592086ce16744a54bc7442625256a860`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:40.901405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:40.924428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:40.928620 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3406/6786] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:40 2022] DELETE /identity/v3/users/02dea4211c1f4da7b5a7eb9b6419c0d9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:40.933219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:40.933906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:40.934435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:40.986405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:40.988072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:41.042644 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3381/6787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:41.062242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:41.065222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:41.167207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3407/6788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:41.228499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:41.230348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:41.238452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7731e-9459-4001-97b8-cdaccf3b4906 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:41.362325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:41.362950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:41.363223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:41.363491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:41.391959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f6f1-72cf-4c01-b291-466cbb602fbe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:41.396828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:41.398087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:41.398609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:41.399115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:41.427577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:41.430960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115774a2-1c60-4cf4-ad9c-db49ba82a886 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:41.480766 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3408/6789] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:41.507004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:41.508488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:41.521436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3382/6790] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:41.827909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:41.829929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:41.830381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:41.870824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:41.878835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:41.903021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.020145 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3409/6791] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:42.044201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:42.046549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:42.089922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:42.205174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb04c-718a-435e-b977-f995778f544d service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:42.211068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:42.211709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:42.212064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:42.212264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:42.223236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:42.225162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46ed1f-05fd-4b67-a4bd-fb9e6b166ca4 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:42.237287 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3383/6792] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:42.528970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:42.531208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:42.579180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2f5e-d4e7-46f8-b39f-9460e7709990 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:42.592892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:42.594989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:42.601840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:42.602481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] PATH_INFO: `/v3/projects/6bfc2150a4564dcbb2f425c2740dd5c1` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:42.606598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfc2150a4564dcbb2f425c2740dd5c1)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:42.609620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:42.739133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfc2150a4564dcbb2f425c2740dd5c1', 'request_id': 'req-92d7dad4-87ed-41fc-be9f-6da988e75c27'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:42.749811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfc2150a4564dcbb2f425c2740dd5c1', 'request_id': 'req-92d7dad4-87ed-41fc-be9f-6da988e75c27'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:42.762186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfc2150a4564dcbb2f425c2740dd5c1', 'request_id': 'req-92d7dad4-87ed-41fc-be9f-6da988e75c27'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:42.804227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] The token cache is being invalidate because project 6bfc2150a4564dcbb2f425c2740dd5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:42.811760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:42.812178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:42.812556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:42.818176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:42.823653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:42.832682 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3410/6793] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:42 2022] DELETE /identity/v3/projects/6bfc2150a4564dcbb2f425c2740dd5c1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:42.834278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:42.839077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:42.852798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:42.855846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:43.029951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7dad4-87ed-41fc-be9f-6da988e75c27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:43.035164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:43.035976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:43.036360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:43.036744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] PATH_INFO: `/v3/users/ec9d13edc0994d118ecbd5602ac98d79` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:43.037912 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3384/6794] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:43.048051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9d13edc0994d118ecbd5602ac98d79)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:43.048402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:43.050852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:43.051637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:43.181438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:43.189258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9d13edc0994d118ecbd5602ac98d79'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:43.204739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9d13edc0994d118ecbd5602ac98d79'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:43.205806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9d13edc0994d118ecbd5602ac98d79'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:43.230343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9d13edc0994d118ecbd5602ac98d79'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:43.232616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5a43af3a-ad21-4866-b7e5-c445124bad36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9d13edc0994d118ecbd5602ac98d79'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:43.271575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2174-10d4-46b3-aaa1-87f5a6b6f1bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:43.284804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3411/6795] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:42 2022] DELETE /identity/v3/users/ec9d13edc0994d118ecbd5602ac98d79 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:43.287468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:43.288723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:43.289600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:43.290613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:43.293473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:43.306800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:43.309631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:43.328628 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3385/6796] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:44.012076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:44.013240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:44.013755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:44.096130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:44.103046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:44.293229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:44.297746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:44.334909 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3412/6797] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:44.338857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:44.343578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:44.359045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272885e5-17fd-4160-a44d-0e968b7d0343 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:44.450097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:44.479647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:44.482172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:44.483530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:44.485258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] PATH_INFO: `/v3/projects/7f4c4020e3484ea1b816756a75a79d06` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:44.488651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4c4020e3484ea1b816756a75a79d06)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:44.491045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:44.585681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4c4020e3484ea1b816756a75a79d06', 'request_id': 'req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:44.597471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4c4020e3484ea1b816756a75a79d06', 'request_id': 'req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:44.619783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4c4020e3484ea1b816756a75a79d06', 'request_id': 'req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:44.665940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] The token cache is being invalidate because project 7f4c4020e3484ea1b816756a75a79d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:44.666501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:44.671464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b77b45e-5f7d-4b6d-b833-dd8653e4b518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:44.681748 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3386/6798] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:44 2022] DELETE /identity/v3/projects/7f4c4020e3484ea1b816756a75a79d06 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:34:44.685921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf2af-9abe-4a34-b91c-d2f01bca1723 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:44.687423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf2af-9abe-4a34-b91c-d2f01bca1723 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:44.689240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bf2af-9abe-4a34-b91c-d2f01bca1723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:44.710251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c544b7-2719-4df5-ad7a-1588c16398e4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:44.751157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b48bf2af-9abe-4a34-b91c-d2f01bca1723 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:44.753267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b48bf2af-9abe-4a34-b91c-d2f01bca1723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:44.933264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:44.934803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:44.935645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:44.936612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:44.941471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:44.965853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:45.003369 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3387/6799] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:45.010068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.012651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.013751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.095753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:45.103788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:45.115603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.118147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.126548 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3388/6800] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:45.130837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.147574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7e539-e489-492f-9df8-aa1adbd9c24d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.157943 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3413/6801] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:45.160908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.162451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.163192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.163977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.165333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:45.166294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.170234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.215789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3389/6802] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:45.221822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.270209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4135-f229-4f57-b0cc-684d4fe02657 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.292720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.293056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.293333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.295864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.296491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.306308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.413093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3414/6803] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:45 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:45.417897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.446546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251b16-73f5-4f75-b34e-9689695205cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.619362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:45.637877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.639158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.642515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.642834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.643733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.650527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.684013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.690052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:45.750961 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3390/6804] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:45 2022] POST /identity/v3/users => generated 284 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:45.752237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.781799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d61a1-daa7-4f15-a7f1-4de48f4650dc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.790493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.791492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.791912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.793230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.794148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.809915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.829053 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3391/6805] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:45.834569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.850640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe885-d318-415b-9214-d735927a49e0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.859862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.862772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.863207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.863749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.865109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:45.867004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:45.874339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c678-483c-4abe-90f7-78f2c5d251fa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.891936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.892904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.895863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.896617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:45.903208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3392/6806] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:45.905143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:45.907707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:45.947444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d4ad-ce24-473d-992a-f2b4b6a95b3f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:45.966234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:45.968960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:45.969434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:45.977417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] PATH_INFO: `/v3/projects/383100c386334c6d9d48046c98e445c7/users/7326e5e9582b4f049729520f111effce/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.029339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:46.032722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f2396-f48d-406f-8114-ad013c67c0be service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:46.040489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=383100c386334c6d9d48046c98e445c7, user_id=7326e5e9582b4f049729520f111effce, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:46.045516 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3415/6807] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:46.047850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:46.048475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:46.048978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.057957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f856-3009-4bfc-ad73-004b2ec79c7b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:46.094865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:46.097215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:46.107897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3393/6808] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:45 2022] PUT /identity/v3/projects/383100c386334c6d9d48046c98e445c7/users/7326e5e9582b4f049729520f111effce/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:46.112485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:46.112925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:46.113372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.191566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] MFA Rules not processed for user `7326e5e9582b4f049729520f111effce`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:46.194858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:46.196387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:46.235775 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3416/6809] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:46.249615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:46.251303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:46.420256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3394/6810] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:46.426128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:46.427847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53458539-bcd6-4701-943b-b675d2b9afee None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:46.438955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:46.439826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:46.440167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:46.440505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.462506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:46.464642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:46.487816 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3417/6811] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:34:46.680375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3709d-599b-4ac8-bdf4-49a230140152 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:46.694978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:46.695607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:46.695932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:46.696171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.696825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:46.699012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:46.765246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3395/6812] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:46 2022] POST /identity/v3/projects => generated 369 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:34:46.766469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:46.789219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f1e7-aace-4191-84fa-5c72a42d9115 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:46.913669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:46.914283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:46.914563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:46.914831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:46.915587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:46.918356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:46.977074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3418/6813] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:46 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:46.979183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:47.000977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb86f04-cc93-4f62-bfae-8b45d0cc6ea7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:47.026721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:47.027379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.028779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.029704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.034645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:47.036191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e106-ab23-4517-bdf7-411af43de23d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:47.090747 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3396/6814] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:34:47.092510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:47.111242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1df9-c63a-4f95-baac-ff9c72035dda admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:47.122634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:47.123630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.124029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.124308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] PATH_INFO: `/v3/projects/e0de981be73d4c5cb29bf89fc81da21d/users/7f1f780b86d84c6895f7a6f5345ee9d8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.128840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.129443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.131233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.148645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:47.162838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0de981be73d4c5cb29bf89fc81da21d, user_id=7f1f780b86d84c6895f7a6f5345ee9d8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:47.165722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:47.183312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:47.187534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:47.194563 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3419/6815] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:47 2022] PUT /identity/v3/projects/e0de981be73d4c5cb29bf89fc81da21d/users/7f1f780b86d84c6895f7a6f5345ee9d8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:47.195752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:47.297808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:47.387136 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3397/6816] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:47.387537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23d906-2b19-4534-a604-659fb24562bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:47.405500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:47.418620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:47.421313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.421707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.426251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.427234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:47.433167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:47.475125 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3420/6817] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:47.475605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:47.514155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2079-a629-4bb5-a3ed-6734e689a3f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:47.534732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:47.538086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.538652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.538936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] PATH_INFO: `/v3/projects/e0de981be73d4c5cb29bf89fc81da21d/users/7f1f780b86d84c6895f7a6f5345ee9d8/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.543290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0de981be73d4c5cb29bf89fc81da21d, user_id=7f1f780b86d84c6895f7a6f5345ee9d8, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:47.546499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7e7c7-4c16-49b5-8113-a27228796b32 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:47.585923 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3421/6818] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:47 2022] PUT /identity/v3/projects/e0de981be73d4c5cb29bf89fc81da21d/users/7f1f780b86d84c6895f7a6f5345ee9d8/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:47.591098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.591400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.591722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.631893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039d5c8-06c1-4ba6-a4a2-ceb528222e80 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:47.694357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] MFA Rules not processed for user `7f1f780b86d84c6895f7a6f5345ee9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:47.695604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:47.865089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:47.866680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:47.867319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:47.867319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:47.895280 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3422/6819] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:47.979740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:47.997294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:47.999728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1754a-f243-4410-b6b7-4c13922adf71 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:48.011206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3398/6820] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:48.012341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:48.014658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:48.187061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d2d8-c174-4f45-ba31-7d46d5045575 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:48.192469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:48.193127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:48.193388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:48.193706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:48.224822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:48.229659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:48.264431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3423/6821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:48.688840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d1c4-e7eb-4a8a-9277-f3e84b59f7e6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:48.690064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d1c4-e7eb-4a8a-9277-f3e84b59f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:48.691023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d1c4-e7eb-4a8a-9277-f3e84b59f7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:48.740348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c44d1c4-e7eb-4a8a-9277-f3e84b59f7e6 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:48.742433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c44d1c4-e7eb-4a8a-9277-f3e84b59f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:48.760079 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3399/6822] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:48.787799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:48.807662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c552c8-2228-4307-ace2-fe1faf53cbb6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:48.813807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:48.814942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:48.815386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:48.815933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:48.825410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:48.828109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:48.838962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3424/6823] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:50.790112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e6e0-aa68-4ed9-bc88-eb075948bd9d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:50.791261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e6e0-aa68-4ed9-bc88-eb075948bd9d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:50.792406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764e6e0-aa68-4ed9-bc88-eb075948bd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:50.864841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c764e6e0-aa68-4ed9-bc88-eb075948bd9d None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:50.869113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c764e6e0-aa68-4ed9-bc88-eb075948bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:50.894666 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3400/6824] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:50.917689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:50.977547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32353c2c-59f9-4666-94f4-deae7bd828df service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:50.999402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:51.000396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:51.000853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:51.001333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:51.031050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:51.033935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:51.086359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3425/6825] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:51.372575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469d0b-2b1b-4058-8be7-796bf57dd109 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:51.372575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469d0b-2b1b-4058-8be7-796bf57dd109 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:51.372575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469d0b-2b1b-4058-8be7-796bf57dd109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:51.404268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d469d0b-2b1b-4058-8be7-796bf57dd109 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:51.408654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d469d0b-2b1b-4058-8be7-796bf57dd109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:51.428709 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3401/6826] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:51.443778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:51.469370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fea15-dd14-4c0b-817b-de19aa71af51 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:51.490952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:51.491832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:51.492944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:51.493263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:51.517589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:51.523117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:51.550743 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3426/6827] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:52.061201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50be05-8b0b-47c8-85d4-33334e6d0376 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:52.062309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50be05-8b0b-47c8-85d4-33334e6d0376 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:52.062730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50be05-8b0b-47c8-85d4-33334e6d0376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:52.115397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bc50be05-8b0b-47c8-85d4-33334e6d0376 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:52.116736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc50be05-8b0b-47c8-85d4-33334e6d0376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:52.138591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3402/6828] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:52.156801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:52.192182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbe333-e860-4f48-847f-d3f533448029 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:52.210152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:52.211617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:52.212071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:52.214370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:52.256365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:52.261041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:52.269032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:52.276839 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3427/6829] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:52.619192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94acb6-2d4b-43c5-9785-ee6b9fea1b7d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:52.619550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94acb6-2d4b-43c5-9785-ee6b9fea1b7d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:52.619963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94acb6-2d4b-43c5-9785-ee6b9fea1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:52.677411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a94acb6-2d4b-43c5-9785-ee6b9fea1b7d None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:52.679079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a94acb6-2d4b-43c5-9785-ee6b9fea1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:52.697574 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3403/6830] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:52.736500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:52.758938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da505-27e0-4d5c-a4ea-1d348e7df3b4 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:52.780421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:52.781929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:52.782211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:52.782482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:52.805219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:52.806967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:52.842928 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3428/6831] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 16:34:53.120938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba45d3-9685-4e0c-bd14-c4c2cb6ca818 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:53.121978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba45d3-9685-4e0c-bd14-c4c2cb6ca818 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:53.122493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba45d3-9685-4e0c-bd14-c4c2cb6ca818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:53.173152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20ba45d3-9685-4e0c-bd14-c4c2cb6ca818 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:53.175162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20ba45d3-9685-4e0c-bd14-c4c2cb6ca818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:53.197588 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3404/6832] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:53.220869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:53.253238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0dacf-ce02-4e03-b2b0-9270378c4f44 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:53.273205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:53.276122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:53.276629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:53.277082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:53.299755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:53.307705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:53.334099 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3429/6833] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:53.654755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:53.655224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:53.655696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:53.723937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:53.725732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:53.736132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3405/6834] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:53.760802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:53.784304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9b22a-4ad1-4a9b-8791-3f2dc7ca7e75 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:53.834779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:53.836399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:53.836857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:53.842843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:53.869030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:53.870680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:53.895265 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3430/6835] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:34:54.079940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:54.122149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:54.124484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:54.277541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808743-aed0-4e6c-91c5-f1036a4a8842 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:54.283959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf5d8-efc1-4551-926f-caea8b66486b service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:54.288940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:54.290484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.290941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.291382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] PATH_INFO: `/v3/users/7326e5e9582b4f049729520f111effce` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.294056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7326e5e9582b4f049729520f111effce)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:54.296820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:54.307964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:54.308906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.315729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.316210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] PATH_INFO: `/v3/users/592086ce16744a54bc7442625256a860` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.319753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592086ce16744a54bc7442625256a860)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:54.325077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:54.377003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7326e5e9582b4f049729520f111effce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.377738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7326e5e9582b4f049729520f111effce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.389548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7326e5e9582b4f049729520f111effce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.390590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7326e5e9582b4f049729520f111effce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.418604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-297c2414-d4f6-4a20-a88b-405f7f6229e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7326e5e9582b4f049729520f111effce'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.449593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592086ce16744a54bc7442625256a860'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.450904 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3406/6836] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:54 2022] DELETE /identity/v3/users/7326e5e9582b4f049729520f111effce => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:54.452763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.453456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.454011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.463087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592086ce16744a54bc7442625256a860'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.464217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592086ce16744a54bc7442625256a860'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.486014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592086ce16744a54bc7442625256a860'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.487290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e56f2af-8511-4dde-a8f6-b6bc74bbaa25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592086ce16744a54bc7442625256a860'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:54.533298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:54.536869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:54.547135 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3431/6837] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:54 2022] DELETE /identity/v3/users/592086ce16744a54bc7442625256a860 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:54.552920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.553465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.553903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.587498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:54.620731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:54.635704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:54.713262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:54.720621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3407/6838] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:54.760620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:54.762181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:54.771860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3432/6839] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:54.799286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:54.804831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:54.902280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd2ae0-4c83-4b2e-82d4-25fa44a5b380 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:54.908770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc2ad-be4a-4168-aafc-fad3ab8ffe86 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:54.913062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:54.913229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:54.913730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.914055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.914330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.914750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:54.915210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:54.917041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:54.937569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:54.939457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:54.955922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:54.957454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:54.969869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3433/6840] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:34:54.971332 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3408/6841] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:34:56.156234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:56.158635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:56.181218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cb8d2-c598-4ee3-b76c-a7b9bc7ff807 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:56.209245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:56.209245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.209245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.209245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] PATH_INFO: `/v3/projects/dacec1cd2016481ea2bbbac834a2b75f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.211336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacec1cd2016481ea2bbbac834a2b75f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:56.217069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:56.344758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:56.346865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:56.376685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacec1cd2016481ea2bbbac834a2b75f', 'request_id': 'req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.384782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364afe1-162a-4699-8bb7-1784b194300e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:56.390387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacec1cd2016481ea2bbbac834a2b75f', 'request_id': 'req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.402018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacec1cd2016481ea2bbbac834a2b75f', 'request_id': 'req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.449506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] The token cache is being invalidate because project dacec1cd2016481ea2bbbac834a2b75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:56.451848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.457229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed53c5f9-dd9c-4c69-aaa7-18dcbf73fccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.461132 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3434/6842] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:56 2022] DELETE /identity/v3/projects/dacec1cd2016481ea2bbbac834a2b75f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:56.467251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197de0-4a81-4643-bc5c-1ea58679e40c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.467554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197de0-4a81-4643-bc5c-1ea58679e40c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.467807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2197de0-4a81-4643-bc5c-1ea58679e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.518378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a2197de0-4a81-4643-bc5c-1ea58679e40c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:56.521548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2197de0-4a81-4643-bc5c-1ea58679e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:56.536648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:56.537331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.537621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.537879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] PATH_INFO: `/v3/projects/383100c386334c6d9d48046c98e445c7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.539074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383100c386334c6d9d48046c98e445c7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:56.541143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:56.650252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3435/6843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:56.658681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.659076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.659359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.674586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383100c386334c6d9d48046c98e445c7', 'request_id': 'req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.713077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383100c386334c6d9d48046c98e445c7', 'request_id': 'req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.728921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383100c386334c6d9d48046c98e445c7', 'request_id': 'req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.747981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:56.766402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:56.768071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] The token cache is being invalidate because project 383100c386334c6d9d48046c98e445c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:56.773353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.774577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:56.776706 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3409/6844] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:56 2022] DELETE /identity/v3/projects/383100c386334c6d9d48046c98e445c7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:56.782416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:56.783162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:56.784555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:56.789451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:56.874716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3436/6845] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:56.876201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:56.887762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961897-0b90-4401-b0e1-1ac25752d24d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:56.896282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:56.897110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.897628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.897897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.898765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:56.899011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:56.900689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:56.934312 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3437/6846] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:34:56.941658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:56.961279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a184d9-3135-43c5-8313-0a1c3c140b48 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:56.967832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc61a1-2ec2-4079-9a3c-e6ad771e3240 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:56.974629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:56.975490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.975939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.976372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.977287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:56.980653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:56.986226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:56.987120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:56.987562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:56.988022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] PATH_INFO: `/v3/users/7f1f780b86d84c6895f7a6f5345ee9d8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:56.990323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1f780b86d84c6895f7a6f5345ee9d8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:56.994281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:57.065338 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3438/6847] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:56 2022] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:57.069455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:57.116193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1f780b86d84c6895f7a6f5345ee9d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:57.117436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1f780b86d84c6895f7a6f5345ee9d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:57.133515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1f780b86d84c6895f7a6f5345ee9d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:57.136164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1f780b86d84c6895f7a6f5345ee9d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:57.150875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1f780b86d84c6895f7a6f5345ee9d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:57.226036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3410/6848] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:56 2022] DELETE /identity/v3/users/7f1f780b86d84c6895f7a6f5345ee9d8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:57.260347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1af38-2ab4-4fe0-b85b-7b25c113393a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:57.373160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:57.374812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:57.375111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:57.375451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:57.376557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:57.378510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:57.412267 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3439/6849] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:57 2022] POST /identity/v3/users => generated 281 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:57.413651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:57.416536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:57.434772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d3664-f685-4f47-890e-d011566426d6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:57.443192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:57.446252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:57.446707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:57.447140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:57.448465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:57.450653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:57.470841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3411/6850] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:57.474827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:57.488053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613059-37ad-4bdf-96f3-d5d168f2c8bd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:57.494095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:57.494559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:57.494842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:57.495254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:57.496923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:57.498947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b0063-99cb-4b15-a01b-eb6935c49509 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:57.502922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:57.514524 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3440/6851] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:34:57.532583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:57.545045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d96a-bbfa-4c15-8b77-15d2db652184 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:57.560811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:57.561656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:57.562029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:57.562374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] PATH_INFO: `/v3/projects/351c95d99b7d4d7396f57cb26289761e/users/09cecd70199f45ef9424da0dd6b47430/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:57.585435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=351c95d99b7d4d7396f57cb26289761e, user_id=09cecd70199f45ef9424da0dd6b47430, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:57.588848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:57.608501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3412/6852] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:34:57 2022] PUT /identity/v3/projects/351c95d99b7d4d7396f57cb26289761e/users/09cecd70199f45ef9424da0dd6b47430/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:57.619713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae927c-0094-457c-96ea-0f0ae848c2c3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:57.620121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae927c-0094-457c-96ea-0f0ae848c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:57.620344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae927c-0094-457c-96ea-0f0ae848c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:57.671110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-74ae927c-0094-457c-96ea-0f0ae848c2c3 None None] MFA Rules not processed for user `09cecd70199f45ef9424da0dd6b47430`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:57.673067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-74ae927c-0094-457c-96ea-0f0ae848c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:57.860000 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3441/6853] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:57.873322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:57.986952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:58.025064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768b604-c4ad-4d08-ab0d-a6f362b560ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:58.032191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:58.034094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:58.034631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:58.035130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] PATH_INFO: `/v3/users/09cecd70199f45ef9424da0dd6b47430` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:58.043953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cecd70199f45ef9424da0dd6b47430)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:58.048964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:58.141516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cecd70199f45ef9424da0dd6b47430'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:58.143250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cecd70199f45ef9424da0dd6b47430'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:58.159439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cecd70199f45ef9424da0dd6b47430'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:58.160970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cecd70199f45ef9424da0dd6b47430'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:58.176761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cecd70199f45ef9424da0dd6b47430'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:58.211573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3413/6854] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:34:57 2022] DELETE /identity/v3/users/09cecd70199f45ef9424da0dd6b47430 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:58.216145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:58.216916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:58.217346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:58.262293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:58.264136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:58.398167 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3442/6855] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:58.488771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:58.490975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:58.680021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af79294-6da7-4f16-ad27-27f64128da27 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:58.688430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:58.689555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:58.690088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:58.690626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:58.718202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:58.720543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:58.748214 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3414/6856] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:34:59.189564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.190996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.204578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f725-88e2-4436-803a-b3de2aded8fa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.209420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:59.210452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.210452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.210703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] PATH_INFO: `/v3/projects/e0de981be73d4c5cb29bf89fc81da21d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.212110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0de981be73d4c5cb29bf89fc81da21d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:59.213870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:59.340371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0de981be73d4c5cb29bf89fc81da21d', 'request_id': 'req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.354704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.356250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.398424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7476a4-62ab-4620-be56-4e5226784da3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.399711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0de981be73d4c5cb29bf89fc81da21d', 'request_id': 'req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.426030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0de981be73d4c5cb29bf89fc81da21d', 'request_id': 'req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.468420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] The token cache is being invalidate because project e0de981be73d4c5cb29bf89fc81da21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:59.469672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.470567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72ec2166-f1eb-4e41-bdc1-590d0ae1c6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.472724 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3443/6857] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:59 2022] DELETE /identity/v3/projects/e0de981be73d4c5cb29bf89fc81da21d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:59.477125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eaa3f-580c-4f96-9cbb-ce0942d0861a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.477644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eaa3f-580c-4f96-9cbb-ce0942d0861a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.478016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eaa3f-580c-4f96-9cbb-ce0942d0861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.510458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef6eaa3f-580c-4f96-9cbb-ce0942d0861a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:59.511702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef6eaa3f-580c-4f96-9cbb-ce0942d0861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.519813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:59.526580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:59.527351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.527486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.527758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] PATH_INFO: `/v3/projects/351c95d99b7d4d7396f57cb26289761e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.529610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] RBAC: Authorizing `identity:delete_project(project_id=351c95d99b7d4d7396f57cb26289761e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:59.531558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:59.538406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:34:59.599559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351c95d99b7d4d7396f57cb26289761e', 'request_id': 'req-e1ff7ae8-3847-45f3-8503-5aecdebb228d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.600444 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3444/6858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:34:59.608665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351c95d99b7d4d7396f57cb26289761e', 'request_id': 'req-e1ff7ae8-3847-45f3-8503-5aecdebb228d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.608920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.609159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.609836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.621114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351c95d99b7d4d7396f57cb26289761e', 'request_id': 'req-e1ff7ae8-3847-45f3-8503-5aecdebb228d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.633761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:59.635119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.636575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] The token cache is being invalidate because project 351c95d99b7d4d7396f57cb26289761e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:34:59.636870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.641051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e1ff7ae8-3847-45f3-8503-5aecdebb228d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:34:59.649095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3415/6859] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:34:59 2022] DELETE /identity/v3/projects/351c95d99b7d4d7396f57cb26289761e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:34:59.650549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.650822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.651085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.686740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:59.688202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.719877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3445/6860] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:59.724601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.738328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed59f75-60b3-442c-9ba2-b0a4d4cae713 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.754838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:59.757566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.759130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.759567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.761831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:59.762210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:59.767102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edd076-2560-42bb-92e0-4d32f6b406c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:59.796617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3446/6861] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:34:59.797866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3416/6862] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:59.806832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.808918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.809221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.809493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.823689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00899d-013b-4e4f-86c0-48ca0ce55840 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.831003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:59.831790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.832516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.832830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.833565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:59.835940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:59.839263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:34:59.842180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:34:59.856105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3447/6863] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:34:59.860629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.877579 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3417/6864] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:34:59.881099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261cb9-6509-4cc5-bbec-98168e0a813e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.881456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:34:59.987567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:34:59.988278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:34:59.988935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:34:59.989333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:34:59.990212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:34:59.990763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:34:59.991992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768fce-91ee-444e-aebe-541c183e1942 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:34:59.992861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:34:59.999510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.000458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.000729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.001029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.001831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.003940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.017366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3448/6865] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:00.022359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.035678 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3418/6866] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:34:59 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:00.036365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa935ac-7fc0-47b8-8f6c-88c4ac03153a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.039540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.043080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.043707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.043990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.044893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.045630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.047552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.053602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:00.061861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a26e-6d0f-487a-96ca-bfc2cc827af8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.070245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.071357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.072285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.072873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.073967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.077110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.112145 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3449/6867] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:00.116723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.131209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:00.133490 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3419/6868] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:00.138013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.167034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9cea-397d-43e6-8871-9b752b6089b9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.278378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66702a3-e3a8-41a2-9bd1-34cd451cae44 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.297037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.299049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.301196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.301662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.303669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.309208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.348801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.349581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.349867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.350105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.371105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.373918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.392794 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3420/6869] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:00.396861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.409039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3450/6870] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/users => generated 295 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:00.419002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.450707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89a54-21ae-42e6-90fe-ece06ffe6ac7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.457917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.458666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.458947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.459224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] PATH_INFO: `/v3/projects/5f7091e3c3c34ab8995720f1626937ef/users/8e20c1065188433bae1a70ad69ea107a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.464699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabda16b-7912-4d8b-b38c-85ede4858a30 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.479390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7091e3c3c34ab8995720f1626937ef, user_id=8e20c1065188433bae1a70ad69ea107a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.485908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.486918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.487342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.487845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.490939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.491112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce90b9-86ea-486e-be5a-227a980015d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.494554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.523473 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3421/6871] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:00 2022] PUT /identity/v3/projects/5f7091e3c3c34ab8995720f1626937ef/users/8e20c1065188433bae1a70ad69ea107a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:00.526432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.526724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.527304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.534941 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3451/6872] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:00.537272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.561112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5b64-171a-4e57-a9b4-9bb92bad3e74 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.579071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] MFA Rules not processed for user `8e20c1065188433bae1a70ad69ea107a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:00.580951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:00.724466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.726557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.726865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.727146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.727896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.730328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.743789 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3452/6873] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:00.747903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.757161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3422/6874] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:00.759039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.771432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153895a2-ab48-41f4-983b-fca544f48a5f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.783318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.784486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.786975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcee6-e7ef-4f8f-81c5-6902ba167131 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:00.791471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.793082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] PATH_INFO: `/v3/projects/90b900bd60aa4fd0bea23e1109389d32/users/783b81070e354eeda68aeee74e161e35/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.803976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:00.804611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.805483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.805840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.807213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.810809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.827939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b900bd60aa4fd0bea23e1109389d32, user_id=783b81070e354eeda68aeee74e161e35, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:00.835008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34be9a-eb23-43d0-951b-bb4530b05062 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:00.873354 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3453/6875] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:00 2022] PUT /identity/v3/projects/90b900bd60aa4fd0bea23e1109389d32/users/783b81070e354eeda68aeee74e161e35/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:00.883245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:00.884069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:00.885007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:00.929026 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3423/6876] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/projects => generated 397 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:00.945309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:00.970018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] MFA Rules not processed for user `783b81070e354eeda68aeee74e161e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:00.971414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:00.997466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:01.077642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aaa0-2d3a-46b3-816c-99caf5d08997 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.090566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.091828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.092102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.092374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.093032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.098364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.104200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:01.165586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3424/6877] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/users => generated 305 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:01.170897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.177209 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3454/6878] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:35:01.191282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.191432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089aa7b-484c-401e-92f7-8784196f7e16 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.193201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:01.206583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.224268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.224667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.224809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.228114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.229816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.279596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3425/6879] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:01.280628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.306797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8cac0-568f-4013-97f9-2106b5d167d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.332925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.336236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.339434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.339732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] PATH_INFO: `/v3/projects/5a0d74904dde477cb5661b5f312ef977/users/584541425e614d0fbc593b9987582836/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.350559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8eb34-3e53-4396-be59-26118d6bdd76 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.363469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.364211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.364678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.365091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.386926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d74904dde477cb5661b5f312ef977, user_id=584541425e614d0fbc593b9987582836, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.387407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.390135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.391135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.431650 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3426/6880] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:01 2022] PUT /identity/v3/projects/5a0d74904dde477cb5661b5f312ef977/users/584541425e614d0fbc593b9987582836/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:01.434035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.457691 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3455/6881] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:01.584594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69ee6-64aa-490f-8d8f-17e5c5e13f39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.592659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.593728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.594261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.594682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.595980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.600115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.615992 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3427/6882] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:01.621434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.636646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:01.673095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e91c17-e9c8-41a3-ae4c-b7f848514a5b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.691515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.692166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.693568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.693776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] PATH_INFO: `/v3/projects/5a0d74904dde477cb5661b5f312ef977/users/584541425e614d0fbc593b9987582836/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.695309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1067f8-8ad1-415a-83c5-b06fe6f1b61a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:01.699242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0d74904dde477cb5661b5f312ef977, user_id=584541425e614d0fbc593b9987582836, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.705705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38feb0-98e9-4a88-a1b6-1b5f71af7d1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.710263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:01.710956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.711234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.711502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] PATH_INFO: `/v3/users/783b81070e354eeda68aeee74e161e35` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.715577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783b81070e354eeda68aeee74e161e35)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:01.718492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:01.746528 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3456/6883] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:01 2022] PUT /identity/v3/projects/5a0d74904dde477cb5661b5f312ef977/users/584541425e614d0fbc593b9987582836/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:01.750752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.750987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.751284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:01.844350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783b81070e354eeda68aeee74e161e35'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:01.845428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783b81070e354eeda68aeee74e161e35'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:01.850504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] MFA Rules not processed for user `584541425e614d0fbc593b9987582836`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:01.852077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:01.854118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783b81070e354eeda68aeee74e161e35'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:01.855450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783b81070e354eeda68aeee74e161e35'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:01.878554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3c64aff2-485c-4088-92c1-5ae573adc141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783b81070e354eeda68aeee74e161e35'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:01.906315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:01.942898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3428/6884] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:01 2022] DELETE /identity/v3/users/783b81070e354eeda68aeee74e161e35 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:01.952025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371d3d-da16-466f-b857-5a24579d356a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:01.952324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371d3d-da16-466f-b857-5a24579d356a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:01.952598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371d3d-da16-466f-b857-5a24579d356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:02.011987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-db371d3d-da16-466f-b857-5a24579d356a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:02.014178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db371d3d-da16-466f-b857-5a24579d356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:02.023240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3457/6885] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:02.042400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:02.045205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:02.132834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3429/6886] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:02.134340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371d3d-da16-466f-b857-5a24579d356a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:02.135767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db371d3d-da16-466f-b857-5a24579d356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:02.166273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb965a-1044-4d1a-9866-0b29642de291 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:02.190916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:02.241133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371d3d-da16-466f-b857-5a24579d356a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:02.251814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:02.252510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:02.253085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:02.253228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:02.279200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:02.280971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:02.281225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:02.293763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:02.295279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:02.295575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:02.298125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:02.332929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3430/6887] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:02.425477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:02.427166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:02.439010 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3458/6888] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:35:02.873661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:02.875502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:02.913519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76ebd8-c1b5-429e-9d16-3e028e63cb81 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:02.931975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:02.931975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:02.932306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:02.932306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] PATH_INFO: `/v3/projects/90b900bd60aa4fd0bea23e1109389d32` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:02.933532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b900bd60aa4fd0bea23e1109389d32)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:02.937349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:03.094993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b900bd60aa4fd0bea23e1109389d32', 'request_id': 'req-accf42e0-c989-4f22-841d-b78a11ff6786'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:03.116677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b900bd60aa4fd0bea23e1109389d32', 'request_id': 'req-accf42e0-c989-4f22-841d-b78a11ff6786'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:03.137356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b900bd60aa4fd0bea23e1109389d32', 'request_id': 'req-accf42e0-c989-4f22-841d-b78a11ff6786'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:03.167998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:03.170518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:03.193503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] The token cache is being invalidate because project 90b900bd60aa4fd0bea23e1109389d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:03.193929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:03.194668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-accf42e0-c989-4f22-841d-b78a11ff6786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:03.201050 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3431/6889] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:02 2022] DELETE /identity/v3/projects/90b900bd60aa4fd0bea23e1109389d32 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:03.207674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9445-422c-4b3f-801e-d91e88de63a2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:03.208700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9445-422c-4b3f-801e-d91e88de63a2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:03.211153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad9445-422c-4b3f-801e-d91e88de63a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:03.278792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5aad9445-422c-4b3f-801e-d91e88de63a2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:03.283542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5aad9445-422c-4b3f-801e-d91e88de63a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:03.329503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:03.412310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2105e5-223b-417c-b497-439379a44a98 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:03.490019 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3432/6890] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:03.492355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:03.492534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:03.493096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:03.547907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:03.549899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:03.598748 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3433/6891] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:03.601357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:03.626936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:03.627877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:03.628329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:03.628922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:03.631436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:03.640423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:03.652276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eebef-9ecb-4eec-b687-86523100edfa None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:03.674756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:03.674756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:03.674756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:03.674756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:03.675270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:03.675270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:03.690962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:03.741062 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3434/6892] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:03.746480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:03.764008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422a34-f509-4d36-be29-81cd17b8f5a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:03.774772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:03.775745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:03.776194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:03.777054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:03.777859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:03.783331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:03.800751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:03.802531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:03.827591 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3459/6893] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:03.846085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3435/6894] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:03 2022] POST /identity/v3/projects => generated 395 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:03.847864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:03.874215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97262338-2fca-40e3-8c06-1dfc78bfd8b5 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:04.026883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:04.027530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.027811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.028083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.029190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:04.032010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:04.094811 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3460/6895] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:03 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:04.099785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:04.127367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5485f8c-3763-4101-b2d0-a1e65da16744 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:04.133891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:04.134994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.135511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.135998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.136929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:04.139250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:04.156737 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3436/6896] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:04.157716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:04.172037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950c023-79ad-47f6-9076-e0e830e37e34 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:04.179579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:04.180882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.181455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.181959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.182879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:04.185389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6758edb-a3f1-4a55-aadc-cb7f6112e9a3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:04.251604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:04.264359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3461/6897] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:04.268836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2950e7-69bc-41b9-943b-32936096b900 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:04.291506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:04.292477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.292838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.293155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] PATH_INFO: `/v3/projects/9f92f2890cb44ab69f2837fef430c074/users/baa0e3844d3c4eb1a16fd8c83876e95f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.315073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f92f2890cb44ab69f2837fef430c074, user_id=baa0e3844d3c4eb1a16fd8c83876e95f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:04.318261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:04.352169 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3437/6898] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:04 2022] PUT /identity/v3/projects/9f92f2890cb44ab69f2837fef430c074/users/baa0e3844d3c4eb1a16fd8c83876e95f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:04.356246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.357217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.357613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.459232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] MFA Rules not processed for user `baa0e3844d3c4eb1a16fd8c83876e95f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:04.460592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:04.571073 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3462/6899] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:04.623809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:04.643399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:04.803153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ed87-1f72-47ac-8666-5558ac62db87 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:04.816975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:04.818528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:04.818848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:04.819435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:04.845446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:04.848208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fbfb7-9d63-4c64-9827-514fe3abf7b3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:04.867734 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3438/6900] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:04 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:06.639977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:06.641750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:06.658350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:06.753910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3879a4-f239-4feb-8afc-ed007f632210 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:06.769847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:06.771260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:06.773301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:06.774096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] PATH_INFO: `/v3/users/0bd4e1ec258d40b4831ab4fa90e01889` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:06.777750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd4e1ec258d40b4831ab4fa90e01889)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:06.782581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:06.884220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd4e1ec258d40b4831ab4fa90e01889'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:06.900744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd4e1ec258d40b4831ab4fa90e01889'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:06.902544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd4e1ec258d40b4831ab4fa90e01889'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:06.916313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd4e1ec258d40b4831ab4fa90e01889'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:06.917544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd4e1ec258d40b4831ab4fa90e01889'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:06.970920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3463/6901] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:06 2022] DELETE /identity/v3/users/0bd4e1ec258d40b4831ab4fa90e01889 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:06.971995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:06.972458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:06.972558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:06.998980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:07.000715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:07.080284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:07.128751 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3439/6902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:07.162269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:07.167239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:07.285080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90393d-9aa1-44fd-a51d-f4ff7fa567e0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:07.289456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:07.290205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:07.290589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:07.290964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:07.303939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:07.306579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:07.321750 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3464/6903] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:08.249924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:08.250389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:08.265610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4f3b-6028-4fb7-a9dd-24f50e0d827c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:08.276648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:08.277816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:08.279235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:08.280042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] PATH_INFO: `/v3/projects/40c7b1a1fe8e40d690c27ccc87185d53` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:08.282097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c7b1a1fe8e40d690c27ccc87185d53)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:08.286590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:08.418439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c7b1a1fe8e40d690c27ccc87185d53', 'request_id': 'req-b7975d45-d63b-4710-97c1-21bfe37ab09b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.431543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c7b1a1fe8e40d690c27ccc87185d53', 'request_id': 'req-b7975d45-d63b-4710-97c1-21bfe37ab09b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.445345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c7b1a1fe8e40d690c27ccc87185d53', 'request_id': 'req-b7975d45-d63b-4710-97c1-21bfe37ab09b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.467376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] The token cache is being invalidate because project 40c7b1a1fe8e40d690c27ccc87185d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:08.467743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.468590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.474062 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3440/6904] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:08 2022] DELETE /identity/v3/projects/40c7b1a1fe8e40d690c27ccc87185d53 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:08.479813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:08.509969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d081cb-3ecd-4dc1-8211-dd3db8fdda48 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:08.579323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:08.708069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:08.709469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:08.709943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:08.710403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] PATH_INFO: `/v3/users/3140e35b5144465688f36362e8827699` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:08.712320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3140e35b5144465688f36362e8827699)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:08.716205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:08.878206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3140e35b5144465688f36362e8827699'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.894969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3140e35b5144465688f36362e8827699'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.895904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3140e35b5144465688f36362e8827699'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.924016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3140e35b5144465688f36362e8827699'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.924484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3140e35b5144465688f36362e8827699'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:08.990847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3465/6905] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:08 2022] DELETE /identity/v3/users/3140e35b5144465688f36362e8827699 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:09.858704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:09.861391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:09.891850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7975d45-d63b-4710-97c1-21bfe37ab09b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:10.080726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:10.081932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:10.085449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:10.085916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] PATH_INFO: `/v3/projects/3cc0a846647b4624bfece2bde38207c7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:10.088051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc0a846647b4624bfece2bde38207c7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:10.093512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:10.222686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc0a846647b4624bfece2bde38207c7', 'request_id': 'req-c229f85d-bfa0-422a-a3d6-a62631ebbc27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.242500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc0a846647b4624bfece2bde38207c7', 'request_id': 'req-c229f85d-bfa0-422a-a3d6-a62631ebbc27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.255458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc0a846647b4624bfece2bde38207c7', 'request_id': 'req-c229f85d-bfa0-422a-a3d6-a62631ebbc27'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.273721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:10.283258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] The token cache is being invalidate because project 3cc0a846647b4624bfece2bde38207c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:10.286835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.286835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.290196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3441/6906] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:09 2022] DELETE /identity/v3/projects/3cc0a846647b4624bfece2bde38207c7 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:10.295884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:10.297921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:10.331191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3670-6159-48b8-974d-84d3ce974e9f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:10.540983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:10.541931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:10.542264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:10.542502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] PATH_INFO: `/v3/users/27fb6aa9cdc74ddc824bec8c042b4783` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:10.546834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fb6aa9cdc74ddc824bec8c042b4783)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:10.548681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:10.648200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fb6aa9cdc74ddc824bec8c042b4783'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.656961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:10.662760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fb6aa9cdc74ddc824bec8c042b4783'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.663372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fb6aa9cdc74ddc824bec8c042b4783'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.678467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fb6aa9cdc74ddc824bec8c042b4783'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.680686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad1462ff-5611-4fae-a5b3-cbbec883d0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fb6aa9cdc74ddc824bec8c042b4783'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:10.726816 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3466/6907] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:10 2022] DELETE /identity/v3/users/27fb6aa9cdc74ddc824bec8c042b4783 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:12.692002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:12.693699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:12.720144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f85d-bfa0-422a-a3d6-a62631ebbc27 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:12.869982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:12.871580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:12.874267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:12.876068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] PATH_INFO: `/v3/projects/00937672214b4f65a6ee46361a8cfae8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:12.877774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=00937672214b4f65a6ee46361a8cfae8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:12.880440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.029604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00937672214b4f65a6ee46361a8cfae8', 'request_id': 'req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:13.043673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00937672214b4f65a6ee46361a8cfae8', 'request_id': 'req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:13.055859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00937672214b4f65a6ee46361a8cfae8', 'request_id': 'req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:13.073146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] The token cache is being invalidate because project 00937672214b4f65a6ee46361a8cfae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:13.074401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:13.077089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f8d4cdc4-019d-46a3-9b3a-12c4767f3bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:13.080402 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3442/6908] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:12 2022] DELETE /identity/v3/projects/00937672214b4f65a6ee46361a8cfae8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:13.085294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.086198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.086665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.139923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:13.141230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:13.255411 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3467/6909] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:13.257215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.257560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.257887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.354640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:13.357015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:13.374501 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3443/6910] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:13.375825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.389427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2fdb8-d11e-412d-9fef-838f127847a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.409404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.410049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.410710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.410710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.411250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:13.411553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:13.413200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.442545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.445847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3468/6911] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:13.454675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08998d5-707c-428f-a39d-4b99b64df6dd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.473632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.474372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.474606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.474815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.475438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:13.485114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.578143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.586300 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3444/6912] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:13 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:13.589897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910cc6-2cc5-47c7-961f-20eb7bda23c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.727678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.728319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.728603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.728878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.729567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:13.732121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.760806 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3469/6913] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:13 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:13.766249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.784145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b236ae3-d99f-4748-a140-39e51e7fb138 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.793285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.794749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.795053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.795365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.796156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:13.797846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.845397 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3445/6914] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:13.846063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.869832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ae458-6bea-4bb3-87bb-2e6373791e9b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.888242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.889605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.891283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.892342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:13.898379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:13.908239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123515-48bd-4b08-8b26-073a47f106d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:13.947015 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3470/6915] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:13.948143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:13.964186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8885d-b007-4839-852b-e40bdbb5ef0f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:13.978553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:13.979233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:13.979521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:13.979815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] PATH_INFO: `/v3/projects/67e578075eb943579e63c0557efcceec/users/085ac962f4784a3a9544c13a5cc8c631/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.023495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e578075eb943579e63c0557efcceec, user_id=085ac962f4784a3a9544c13a5cc8c631, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:14.026417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:14.068460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:14.068585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:14.068828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.071739 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3446/6916] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:13 2022] PUT /identity/v3/projects/67e578075eb943579e63c0557efcceec/users/085ac962f4784a3a9544c13a5cc8c631/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:14.134260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] MFA Rules not processed for user `085ac962f4784a3a9544c13a5cc8c631`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:14.135722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:14.206200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:14.293199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3471/6917] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:14.294433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:14.372894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:14.457487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec1441-ad22-4d79-944e-f017fe0ceb37 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:14.473105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:14.474768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:14.475054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:14.475320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.479124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:14.483985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:14.577881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:14.578168 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3447/6918] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:14 2022] POST /identity/v3/projects => generated 391 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:14.592602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b137e4-e8c8-4d3b-9a3f-4ab76a9ee6bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:14.766155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:14.769145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:14.769974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:14.771236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.772754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:14.778507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:14.851124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3472/6919] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:14 2022] POST /identity/v3/users => generated 302 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:14.854460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:14.866565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522425f5-17a0-4ad2-ba7a-6eec9f17820e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:14.873417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:14.874571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:14.875191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:14.875716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.876678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:14.879158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:14.902374 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3448/6920] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:14.904519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:14.921925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56748-2503-418a-9644-742fc4877763 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:14.933363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:14.934099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:14.934378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:14.935273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] PATH_INFO: `/v3/projects/52ffcd38411b40daa855a50d6ac726f9/users/1e20bd5f3f1f4e5bad21c261d0c4fa91/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:14.963965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ffcd38411b40daa855a50d6ac726f9, user_id=1e20bd5f3f1f4e5bad21c261d0c4fa91, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:14.969259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:14.994857 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3473/6921] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:14 2022] PUT /identity/v3/projects/52ffcd38411b40daa855a50d6ac726f9/users/1e20bd5f3f1f4e5bad21c261d0c4fa91/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:14.998677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:15.010609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7665f3-e97a-4e26-9f29-bee70dd0003c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:15.189951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:15.190607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:15.190884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:15.191151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:15.191817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:15.194234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b36a4b-3da2-44c3-a5e1-5fee13cecf00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:15.220420 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3449/6922] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:15.220609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:15.241379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd907c-4c79-490d-aa77-63ea77404e51 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:15.251990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:15.252752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:15.253092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:15.253372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] PATH_INFO: `/v3/projects/52ffcd38411b40daa855a50d6ac726f9/users/1e20bd5f3f1f4e5bad21c261d0c4fa91/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:15.257200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ffcd38411b40daa855a50d6ac726f9, user_id=1e20bd5f3f1f4e5bad21c261d0c4fa91, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:15.263130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:15.286391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3474/6923] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:15 2022] PUT /identity/v3/projects/52ffcd38411b40daa855a50d6ac726f9/users/1e20bd5f3f1f4e5bad21c261d0c4fa91/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:15.297938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:15.298191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:15.298393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:15.362167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] MFA Rules not processed for user `1e20bd5f3f1f4e5bad21c261d0c4fa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:15.363454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:15.534847 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3450/6924] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:15.560539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:15.563656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:15.670964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77b4b-4608-4306-b03e-1549605bc557 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:15.686663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:15.687735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:15.688065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:15.689302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:15.726534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:15.733233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:15.760985 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3475/6925] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:21.064701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:21.066208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:21.098467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:21.159015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbccf8-a86b-47bc-ae45-4ae356c71d2e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:21.164083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:21.165483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:21.167379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:21.167983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:21.172401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:21.269878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:21.271510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692fc7b-be01-4ce8-991e-eae5cfd45860 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:21.286878 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3451/6926] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:21.880818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:21.951609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:22.087217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96db9e-e907-46ec-b9e4-75640fe1c09e service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:22.098674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:22.100180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:22.100640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:22.101073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] PATH_INFO: `/v3/users/085ac962f4784a3a9544c13a5cc8c631` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:22.103554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] RBAC: Authorizing `identity:delete_user(user_id=085ac962f4784a3a9544c13a5cc8c631)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:22.106645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:22.194497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085ac962f4784a3a9544c13a5cc8c631'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.220351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085ac962f4784a3a9544c13a5cc8c631'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.221140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085ac962f4784a3a9544c13a5cc8c631'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.235171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085ac962f4784a3a9544c13a5cc8c631'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.238763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085ac962f4784a3a9544c13a5cc8c631'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.276875 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3476/6927] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:21 2022] DELETE /identity/v3/users/085ac962f4784a3a9544c13a5cc8c631 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:22.281196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:22.281788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:22.281906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:22.310663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:22.312487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:22.425830 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3452/6928] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:22.444358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:22.447690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:22.543144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e207b-c91c-4d57-b384-123932ad854b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:22.548697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:22.549580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:22.549865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:22.550270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:22.561338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:22.573924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:22.574159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780ddf-e803-4e93-80ed-2428048d779c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:22.576162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:22.605116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3477/6929] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:22.609458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a0eaa-5166-44be-8b96-b8431a7c299a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:22.667895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:22.669166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:22.672421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:22.672707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] PATH_INFO: `/v3/users/8e20c1065188433bae1a70ad69ea107a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:22.682614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e20c1065188433bae1a70ad69ea107a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:22.684792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:22.814166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e20c1065188433bae1a70ad69ea107a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.815121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e20c1065188433bae1a70ad69ea107a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.827689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e20c1065188433bae1a70ad69ea107a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.829252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e20c1065188433bae1a70ad69ea107a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.863542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e20c1065188433bae1a70ad69ea107a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:22.871002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:22.912739 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3453/6930] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:22 2022] DELETE /identity/v3/users/8e20c1065188433bae1a70ad69ea107a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:22.914190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:22.914664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:22.914776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:22.952567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:22.955078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:23.024147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:23.063634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3478/6931] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:35:23.089627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:23.092816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:23.149156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:23.150920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:23.183681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69384f-7888-4276-bdf4-8a20207358d1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:23.201311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:23.201984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:23.202270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:23.202545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] PATH_INFO: `/v3/projects/67e578075eb943579e63c0557efcceec` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:23.203754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e578075eb943579e63c0557efcceec)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:23.205699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:23.248700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa225fb-e949-4cd6-9b67-e1ffa21a8dcf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:23.263391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:23.264040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:23.264330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:23.264610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:23.288812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:23.290948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:23.319769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3454/6932] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:23.384867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e578075eb943579e63c0557efcceec', 'request_id': 'req-1df3c433-33b7-4d6c-a09e-499c269fc926'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.393103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e578075eb943579e63c0557efcceec', 'request_id': 'req-1df3c433-33b7-4d6c-a09e-499c269fc926'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.401688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e578075eb943579e63c0557efcceec', 'request_id': 'req-1df3c433-33b7-4d6c-a09e-499c269fc926'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.423432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] The token cache is being invalidate because project 67e578075eb943579e63c0557efcceec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:23.423648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.424716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.432769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:23.433769 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3479/6933] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:23 2022] DELETE /identity/v3/projects/67e578075eb943579e63c0557efcceec => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:23.446289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad1a7-9e26-4999-9461-bd30fa76f036 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:23.524621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:23.526021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:23.526021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:23.526021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] PATH_INFO: `/v3/users/1e20bd5f3f1f4e5bad21c261d0c4fa91` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:23.529331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e20bd5f3f1f4e5bad21c261d0c4fa91)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:23.531873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:23.654631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e20bd5f3f1f4e5bad21c261d0c4fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.655589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e20bd5f3f1f4e5bad21c261d0c4fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.664923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e20bd5f3f1f4e5bad21c261d0c4fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.665943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e20bd5f3f1f4e5bad21c261d0c4fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.678103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e20bd5f3f1f4e5bad21c261d0c4fa91'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:23.719639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3455/6934] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:23 2022] DELETE /identity/v3/users/1e20bd5f3f1f4e5bad21c261d0c4fa91 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:23.943006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:23.949055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:23.975651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3c433-33b7-4d6c-a09e-499c269fc926 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:24.075762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:24.077355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:24.099324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:24.119398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:24.120139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:24.120485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:24.120945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] PATH_INFO: `/v3/projects/5f7091e3c3c34ab8995720f1626937ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:24.122721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7091e3c3c34ab8995720f1626937ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:24.125054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:24.238010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6480-3d81-46e1-9d5e-0f193a7c44b4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:24.243187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7091e3c3c34ab8995720f1626937ef', 'request_id': 'req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.254264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7091e3c3c34ab8995720f1626937ef', 'request_id': 'req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.270911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7091e3c3c34ab8995720f1626937ef', 'request_id': 'req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.283227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:24.308300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] The token cache is being invalidate because project 5f7091e3c3c34ab8995720f1626937ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:24.308657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.312168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.319448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3480/6935] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:23 2022] DELETE /identity/v3/projects/5f7091e3c3c34ab8995720f1626937ef => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:24.321447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:24.324588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:24.389643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:24.391123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:24.391886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:24.392461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] PATH_INFO: `/v3/projects/52ffcd38411b40daa855a50d6ac726f9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:24.394353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ffcd38411b40daa855a50d6ac726f9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:24.397230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:24.426504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d997f-0495-4f8a-a0f9-bbd4f66c80a7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:24.436791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47663796-a219-4133-a9de-328772094c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:24.437510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663796-a219-4133-a9de-328772094c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:24.437794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663796-a219-4133-a9de-328772094c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:24.438067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663796-a219-4133-a9de-328772094c7c admin admin] PATH_INFO: `/v3/users/584541425e614d0fbc593b9987582836` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:24.439267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47663796-a219-4133-a9de-328772094c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=584541425e614d0fbc593b9987582836)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:24.443751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47663796-a219-4133-a9de-328772094c7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:24.487626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ffcd38411b40daa855a50d6ac726f9', 'request_id': 'req-125845c9-4db4-497a-8904-c5977d310d8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.502506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ffcd38411b40daa855a50d6ac726f9', 'request_id': 'req-125845c9-4db4-497a-8904-c5977d310d8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.536522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ffcd38411b40daa855a50d6ac726f9', 'request_id': 'req-125845c9-4db4-497a-8904-c5977d310d8b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.566465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] The token cache is being invalidate because project 52ffcd38411b40daa855a50d6ac726f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:24.566760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.567457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-125845c9-4db4-497a-8904-c5977d310d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.572255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47663796-a219-4133-a9de-328772094c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584541425e614d0fbc593b9987582836'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.575083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3456/6936] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:24 2022] DELETE /identity/v3/projects/52ffcd38411b40daa855a50d6ac726f9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:24.576611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:24.576847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:24.582895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:24.623643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47663796-a219-4133-a9de-328772094c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584541425e614d0fbc593b9987582836'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.625118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47663796-a219-4133-a9de-328772094c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584541425e614d0fbc593b9987582836'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.628761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:24.630328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:24.652345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47663796-a219-4133-a9de-328772094c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584541425e614d0fbc593b9987582836'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.653955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47663796-a219-4133-a9de-328772094c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584541425e614d0fbc593b9987582836'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:24.711648 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3481/6937] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:24 2022] DELETE /identity/v3/users/584541425e614d0fbc593b9987582836 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:24.774961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:24.834475 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3457/6938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:24.843418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:24.844039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:24.844546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:24.898158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:24.901958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.027346 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3482/6939] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:25.031694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.047264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5400e-0005-4b18-b6c4-8ec26adcc156 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.056106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.056685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.056972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.057697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.057938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:25.058244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.061260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.082818 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3458/6940] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:35:25.083254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.094607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104c2d7-7cae-4221-8f04-347261849b71 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.100733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.101429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.101836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.102122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.104762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.107939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.119965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.123774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.142134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:25.148154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6122f-ecb5-4c71-8d1a-b180d560ba67 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.157405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.158191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.158565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.159351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] PATH_INFO: `/v3/projects/5a0d74904dde477cb5661b5f312ef977` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.160132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0d74904dde477cb5661b5f312ef977)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.162180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.166863 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3483/6941] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:25.171575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.224737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0d74904dde477cb5661b5f312ef977', 'request_id': 'req-cc9fbf87-06f0-48d6-9964-e68b93e17794'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:25.236417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0d74904dde477cb5661b5f312ef977', 'request_id': 'req-cc9fbf87-06f0-48d6-9964-e68b93e17794'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:25.261651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec9b12-f3d0-46de-9b87-a057dbad43d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.263059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0d74904dde477cb5661b5f312ef977', 'request_id': 'req-cc9fbf87-06f0-48d6-9964-e68b93e17794'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:25.294341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] The token cache is being invalidate because project 5a0d74904dde477cb5661b5f312ef977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:25.297859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:25.299933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc9fbf87-06f0-48d6-9964-e68b93e17794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:25.308009 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3459/6942] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:25 2022] DELETE /identity/v3/projects/5a0d74904dde477cb5661b5f312ef977 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:35:25.310728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09b5c-af1a-4b80-b108-e0ec3c20d71a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.311421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09b5c-af1a-4b80-b108-e0ec3c20d71a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.313403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09b5c-af1a-4b80-b108-e0ec3c20d71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.369035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-36c09b5c-af1a-4b80-b108-e0ec3c20d71a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:25.381482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-36c09b5c-af1a-4b80-b108-e0ec3c20d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.394686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.395865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.397582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.398276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.399203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.404704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.439523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3484/6943] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:25.441068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.445917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.473558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fae441-13a4-4661-b474-91a4289326f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.478753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.479431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.479711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.479987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.480771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.482562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.494249 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3485/6944] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:25.498867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.509431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91d86c-b99b-4373-ace7-17079c11caa4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.516431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.517360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.517953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.518460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.519429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.521196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.535656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3460/6945] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:25.546472 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3486/6946] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:25.554895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.555037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.555347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.555709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.578708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3d933-e716-4b06-8f73-232bfb1d01f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.584977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.585696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.586398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.586398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] PATH_INFO: `/v3/projects/3998d884d18f49c8a7642aaa4bc5271b/users/6d550917a6e74aa088a72f987d912993/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.595298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:25.597485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.627791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3998d884d18f49c8a7642aaa4bc5271b, user_id=6d550917a6e74aa088a72f987d912993, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.630109 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3461/6947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:25.634397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.636609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82a2c0-2649-4522-b17d-71f35ba015de admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.648977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbbdb0-1100-49fd-998b-70502f83e3a3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.657871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.659040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.659347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.659906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.660704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:25.662366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.666090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.692409 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3462/6948] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:25.692867 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3487/6949] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:25 2022] PUT /identity/v3/projects/3998d884d18f49c8a7642aaa4bc5271b/users/6d550917a6e74aa088a72f987d912993/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:25.709825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.710881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.710881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.711167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.724196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5e0f0-c603-4ae5-a1bf-ceebfede7b1d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:25.767281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] MFA Rules not processed for user `6d550917a6e74aa088a72f987d912993`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:25.767942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:25.785717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:25.824251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:25.825563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:25.826073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:25.826617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:25.827668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:25.828584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:25.830848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:25.880148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3463/6950] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:25.881919 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3488/6951] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:25.883748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.897711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:25.899128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:26.076646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0481da-bc31-4d04-904f-fe560c826175 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.080707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725b831-9a42-4537-9370-7bada03325aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.087132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.087946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.088232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.088500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.089300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.092382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.130212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3464/6952] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:25 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:26.135076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:26.151534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356870b-40ef-461c-888b-5c45741de3c1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.172245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.173758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.180602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.181539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.182402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.186311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.238843 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3465/6953] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:26.240638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:26.254693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.255414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.255789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.256409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.274657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2345d2f-53db-4a3a-bf96-3061dbe9a52b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.287721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.288638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.289108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.289555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.290388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.292327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.317228 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3466/6954] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:26.322907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:26.346991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01840e-749f-4a35-b3be-21834900f3f7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.371955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.372756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.373061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.373340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] PATH_INFO: `/v3/projects/d84f4784a1004cf8bceb807a8930639a/users/c7eb110d969442aeba0a7f87b09163a8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.407815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84f4784a1004cf8bceb807a8930639a, user_id=c7eb110d969442aeba0a7f87b09163a8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.409670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de167c-6fd5-4a3c-b7ef-0a2ad3a7087b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.442258 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3467/6955] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:26 2022] PUT /identity/v3/projects/d84f4784a1004cf8bceb807a8930639a/users/c7eb110d969442aeba0a7f87b09163a8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:26.451453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.452829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.453157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.453434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.456906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.491178 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3489/6956] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:26.512862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] MFA Rules not processed for user `c7eb110d969442aeba0a7f87b09163a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:26.514147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:26.680695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:26.726060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:26.734095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3468/6957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:26.743561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d2de-36d5-4c0a-9489-975c5224fdee service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:26.853192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:26.875971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:26.877989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:26.878809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:26.879361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:26.881251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:26.885410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:26.931417 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3490/6958] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:26 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:26.933135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:26.950870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69313e-91e5-49c5-9a98-4b6122712768 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:27.047682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:27.048600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.049012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.049402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.050108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:27.052239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:27.085702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3469/6959] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:26 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:27.089344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:27.110962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64032-76de-425e-bd03-c319f4084284 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:27.128423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:27.129396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.129694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.130869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.131733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:27.133573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:27.163350 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3491/6960] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:27.166011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:27.190244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166dcc5-bc0e-4fa2-8587-f91f618ee623 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:27.201145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:27.202034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.202481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.202765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] PATH_INFO: `/v3/projects/0e66599522134917ac7c9ecbaaa5b94c/users/69f982389002461cae170a2bdbdf2def/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.224154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e66599522134917ac7c9ecbaaa5b94c, user_id=69f982389002461cae170a2bdbdf2def, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:27.228619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:27.259288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3470/6961] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:27 2022] PUT /identity/v3/projects/0e66599522134917ac7c9ecbaaa5b94c/users/69f982389002461cae170a2bdbdf2def/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:27.264017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:27.301585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23580-2440-47ed-83bc-fef9f991866d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:27.468948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:27.469672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.471236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.471540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.472654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:27.474426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5aaaa-b6a5-4eb4-8fef-75b1d83a5b67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:27.512761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3492/6962] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:27.516738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:27.545887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba9473-8fc3-455b-aa12-719130e2a994 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:27.563491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:27.566592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.566592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.566592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] PATH_INFO: `/v3/projects/0e66599522134917ac7c9ecbaaa5b94c/users/69f982389002461cae170a2bdbdf2def/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.579550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e66599522134917ac7c9ecbaaa5b94c, user_id=69f982389002461cae170a2bdbdf2def, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:27.585253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:27.627252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:27.628085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:27.629255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:27.632883 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3471/6963] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:27 2022] PUT /identity/v3/projects/0e66599522134917ac7c9ecbaaa5b94c/users/69f982389002461cae170a2bdbdf2def/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:27.707778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] MFA Rules not processed for user `69f982389002461cae170a2bdbdf2def`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:27.708583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:27.892026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3493/6964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:27.956099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:27.959590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:28.124555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9816a6-bf8a-4bc7-b484-efab612f2b04 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:28.134896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:28.135028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:28.135416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:28.135784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:28.153751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:28.155508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:28.176066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3472/6965] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:33.720259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:33.739974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918148-22a2-4c4a-a534-6475024a3736 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:33.750282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:33.750923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:33.751204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:33.751480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:33.861268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:33.912837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:33.914639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddd7a1-db08-47b0-9aa5-6b78d7c663fc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:33.939066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3494/6966] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:36.264153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:36.384613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:36.426151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd5fb-2a3c-4b84-8d52-93bb1f631207 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:36.441145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:36.442403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:36.443127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:36.443475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] PATH_INFO: `/v3/users/c7eb110d969442aeba0a7f87b09163a8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:36.444961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eb110d969442aeba0a7f87b09163a8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:36.450392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:36.545692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eb110d969442aeba0a7f87b09163a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:36.546531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eb110d969442aeba0a7f87b09163a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:36.561010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eb110d969442aeba0a7f87b09163a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:36.561917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eb110d969442aeba0a7f87b09163a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:36.574727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eb110d969442aeba0a7f87b09163a8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:36.602852 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3473/6967] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:36 2022] DELETE /identity/v3/users/c7eb110d969442aeba0a7f87b09163a8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:36.604562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:36.605078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:36.605209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:36.647694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:36.648941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:36.744091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:36.745533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:36.785021 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3495/6968] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:36.828824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:36.830265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:36.929780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3577fb4-cc9a-4dd2-931f-bc7ba671db2b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:36.942026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:36.943459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:36.943744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:36.944024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:36.960073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:36.988145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1730a0-d590-4b91-80d9-3b39264bdfbc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:37.000637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:37.003340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:37.003979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:37.004257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:37.004527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:37.005490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:37.043489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:37.047907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15b716-2ad3-4921-aff4-17a752f5c453 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:37.055067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3474/6969] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:37.055970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:37.060578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:37.083674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3496/6970] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:35:37.094835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129255e-c6bb-4b35-b582-7d87e7861eb1 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:37.100545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:37.101847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:37.102249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:37.102585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] PATH_INFO: `/v3/users/baa0e3844d3c4eb1a16fd8c83876e95f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:37.103919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa0e3844d3c4eb1a16fd8c83876e95f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:37.106953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:37.337764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa0e3844d3c4eb1a16fd8c83876e95f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:37.337764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa0e3844d3c4eb1a16fd8c83876e95f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:37.337764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:37.337764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa0e3844d3c4eb1a16fd8c83876e95f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:37.337764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa0e3844d3c4eb1a16fd8c83876e95f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:37.341803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa0e3844d3c4eb1a16fd8c83876e95f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:37.382954 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3475/6971] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:37 2022] DELETE /identity/v3/users/baa0e3844d3c4eb1a16fd8c83876e95f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:37.383242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:37.383242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:37.383242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:37.427663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:37.428909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:37.513687 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3497/6972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:37.552178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:37.553674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:37.712166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163bb7-80f4-4a24-9ced-9c6d38633a18 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:37.720023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:37.721432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:37.721906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:37.722365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:37.737821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:37.739719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:37.757358 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3476/6973] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:37.983982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:37.988848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:38.026700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1f189-bd1e-4197-a390-daa8939266d6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:38.048531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:38.066291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:38.066291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:38.066291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] PATH_INFO: `/v3/projects/d84f4784a1004cf8bceb807a8930639a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:38.066291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84f4784a1004cf8bceb807a8930639a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:38.074404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:38.138119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:38.204727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84f4784a1004cf8bceb807a8930639a', 'request_id': 'req-1d198173-1596-4f95-9fbe-e2766de2f0c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.224551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84f4784a1004cf8bceb807a8930639a', 'request_id': 'req-1d198173-1596-4f95-9fbe-e2766de2f0c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.241284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84f4784a1004cf8bceb807a8930639a', 'request_id': 'req-1d198173-1596-4f95-9fbe-e2766de2f0c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.263498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] The token cache is being invalidate because project d84f4784a1004cf8bceb807a8930639a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:38.264000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.264790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.266602 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3498/6974] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:37 2022] DELETE /identity/v3/projects/d84f4784a1004cf8bceb807a8930639a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:38.273613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:38.303023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:38.304685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:38.336952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9230-b96d-44df-ac18-07aa27584faf service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:38.438752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d198173-1596-4f95-9fbe-e2766de2f0c2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:38.445460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:38.446113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:38.446388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:38.446653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] PATH_INFO: `/v3/projects/9f92f2890cb44ab69f2837fef430c074` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:38.447907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f92f2890cb44ab69f2837fef430c074)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:38.452267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:38.527619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:38.528306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:38.529085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:38.529784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] PATH_INFO: `/v3/users/69f982389002461cae170a2bdbdf2def` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:38.532233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f982389002461cae170a2bdbdf2def)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:38.534463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:38.552225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f92f2890cb44ab69f2837fef430c074', 'request_id': 'req-d734b4f0-1d10-4f16-8a91-24cd73480e4a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.567660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f92f2890cb44ab69f2837fef430c074', 'request_id': 'req-d734b4f0-1d10-4f16-8a91-24cd73480e4a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.577657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f92f2890cb44ab69f2837fef430c074', 'request_id': 'req-d734b4f0-1d10-4f16-8a91-24cd73480e4a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.617260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] The token cache is being invalidate because project 9f92f2890cb44ab69f2837fef430c074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:38.617260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.620189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d734b4f0-1d10-4f16-8a91-24cd73480e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.630506 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3499/6975] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:38 2022] DELETE /identity/v3/projects/9f92f2890cb44ab69f2837fef430c074 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:38.635798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:38.636081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:38.637260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:38.660533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f982389002461cae170a2bdbdf2def'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.661295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f982389002461cae170a2bdbdf2def'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.678220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:38.679648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:38.687026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f982389002461cae170a2bdbdf2def'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.688379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f982389002461cae170a2bdbdf2def'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.702392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88744b08-872c-43bc-a92b-c5a3633df989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f982389002461cae170a2bdbdf2def'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:38.720656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:38.739704 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3477/6976] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:38 2022] DELETE /identity/v3/users/69f982389002461cae170a2bdbdf2def => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:38.768547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:38.837225 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3500/6977] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:38.841845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:38.842439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:38.842965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:38.879788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:38.882239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:39.015019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.015815 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3478/6978] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:39.031033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35204ae6-8d26-4fd8-9f54-256d2d3df761 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.038013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.040129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.040551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.040900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.041780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:39.043396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.046635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.068084 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3501/6979] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:39.072556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.114213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adcff-8a71-4bd2-b738-feaff38e7dcb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.119415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.120057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.120315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.120582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.121971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.124585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.178430 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3479/6980] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:39.179409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.192273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef692cd9-7894-4752-b615-fe34a4204330 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.292019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.293054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.293498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.294111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.295177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.297769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.344145 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3502/6981] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:39 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:39.349413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.365858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5001e9-617a-4a0b-88aa-d29e0468680b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.378211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.378211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.378211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.378605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.379014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.380987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.416267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3480/6982] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:39.417337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.436836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff84a-116b-48fa-89bb-b046330e92b0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.443012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.444066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.444516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.444970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.445961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.448482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eda4f3-703f-4eba-9adf-589cc2e9fced admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.466745 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3503/6983] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:39.470924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.503314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d62dc-cc83-484b-9d19-23db113d921b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:39.522765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:39.525169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.525535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.525877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] PATH_INFO: `/v3/projects/3cdd4289d5ba4c86a79a0da7f14749b3/users/07ec8991f6c24c69abcb907504eafb1e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.559108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdd4289d5ba4c86a79a0da7f14749b3, user_id=07ec8991f6c24c69abcb907504eafb1e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:39.566545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:39.611823 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3481/6984] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:39 2022] PUT /identity/v3/projects/3cdd4289d5ba4c86a79a0da7f14749b3/users/07ec8991f6c24c69abcb907504eafb1e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:39.614645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:39.614933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:39.615262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:39.687687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] MFA Rules not processed for user `07ec8991f6c24c69abcb907504eafb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:39.689689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:39.801710 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3504/6985] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:39.824477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:39.827164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:40.066722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2843b-7795-4e12-be59-cdf654249603 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:40.072394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:40.073521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:40.074556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:40.075122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:40.088322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:40.094222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce222dde-4fcb-4623-9941-5911ba4dd630 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:40.160653 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3482/6986] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:40.633754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:40.639404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:40.766722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:40.889687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c9447-fef0-4882-a9fa-b83318235077 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:40.925910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:40.927352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:40.928004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:40.928492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] PATH_INFO: `/v3/projects/0e66599522134917ac7c9ecbaaa5b94c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:40.930113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e66599522134917ac7c9ecbaaa5b94c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:40.932250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:41.027212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e66599522134917ac7c9ecbaaa5b94c', 'request_id': 'req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:41.056979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e66599522134917ac7c9ecbaaa5b94c', 'request_id': 'req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:41.084977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e66599522134917ac7c9ecbaaa5b94c', 'request_id': 'req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:41.115946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] The token cache is being invalidate because project 0e66599522134917ac7c9ecbaaa5b94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:41.118594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:41.121646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:41.125544 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3505/6987] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:40 2022] DELETE /identity/v3/projects/0e66599522134917ac7c9ecbaaa5b94c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:41.132492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c4b-ddbe-46cd-a013-3ae470fa3b55 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:41.133064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c4b-ddbe-46cd-a013-3ae470fa3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:41.133162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606c4b-ddbe-46cd-a013-3ae470fa3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:41.193960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:41.195650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:41.216938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d0606c4b-ddbe-46cd-a013-3ae470fa3b55 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:41.231419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d0606c4b-ddbe-46cd-a013-3ae470fa3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:41.330405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:41.446606 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3483/6988] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:41.467924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:41.468824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:41.469663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:41.517108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:41.519358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:41.555065 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3484/6989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:35:41.563527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e2136-8e00-4d85-86e0-6d2a264c6a7c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:41.565665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:41.579413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2ae7-0ef0-4806-b199-26847c007efb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:41.590924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:41.592014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:41.592718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:41.593173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:41.593418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:41.593872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:41.594124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:41.594631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:41.597743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:41.598349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:41.608579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:41.627930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:41.656946 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3485/6990] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:35:41.659292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:41.687822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78d04-4ed6-49dc-8a24-6c9450d49461 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:41.712436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:41.714099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:41.718024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:41.718690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:41.720723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:41.727556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:41.738693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:41.743732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:41.808984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3506/6991] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:35:41.828601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3486/6992] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:41 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:41.830540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:41.854700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f6cbe-a5de-44a9-ab9e-b3909a597c40 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:42.037612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:42.082405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:42.082405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:42.082620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:42.082752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:42.083373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:42.097504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:42.159295 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3507/6993] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:41 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:42.160585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:42.190754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc6e52-88b5-4cb5-930f-098493475815 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:42.199816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:42.200910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:42.201471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:42.202674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:42.203627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:42.210606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:42.231836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3487/6994] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:42.236708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:42.255777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5ef9d-ab92-4d0f-9c3a-a0bc59d83844 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:42.304333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:42.307569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:42.307855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:42.310138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:42.311022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:42.312657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ec19c-b444-47d2-ac06-628c36b05b7c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:42.367744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3508/6995] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:42.369355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:42.404022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6ac3-1a53-4f32-9f4d-71bde19f0a29 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:42.412167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:42.413361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:42.415282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:42.416151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] PATH_INFO: `/v3/projects/1081316325c64a399087dd06845abb9f/users/4089a117cf4a45f4a6f005df6d1b0593/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:42.492562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1081316325c64a399087dd06845abb9f, user_id=4089a117cf4a45f4a6f005df6d1b0593, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:42.504206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:42.543319 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3488/6996] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:42 2022] PUT /identity/v3/projects/1081316325c64a399087dd06845abb9f/users/4089a117cf4a45f4a6f005df6d1b0593/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:42.567304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:42.567673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:42.570122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:42.643939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] MFA Rules not processed for user `4089a117cf4a45f4a6f005df6d1b0593`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:42.649029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:42.908895 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3509/6997] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:42.947973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:42.950716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:43.164390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e77252-4804-4de2-bb8c-d3c3dc41e9f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:43.183609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:43.190013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:43.190356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:43.190586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:43.221430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:43.223535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:43.270802 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3489/6998] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:47.141916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:47.168119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1f5c7-7203-4ce6-96b6-9220d9d3972d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:47.181042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:47.181674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:47.182128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:47.182595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:47.185545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:47.373811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:47.375265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:47.407490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3510/6999] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:49.061622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:49.066366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:49.111597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066b0e-5105-4162-b6ec-309a9202564f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:49.117452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:49.119095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:49.119596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:49.120181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:49.123596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:49.179541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:49.182119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc0fb7-00f0-400e-9306-badd82ace974 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:49.202325 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3490/7000] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:53.538977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:53.541958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:53.663519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:53.776864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d893-1f8c-4910-9e2c-df5d227330d1 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:53.784552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:53.784552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:53.784552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:53.784552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] PATH_INFO: `/v3/users/6d550917a6e74aa088a72f987d912993` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:53.788351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d550917a6e74aa088a72f987d912993)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:53.793677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:53.908681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d550917a6e74aa088a72f987d912993'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:53.956542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d550917a6e74aa088a72f987d912993'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:53.959842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d550917a6e74aa088a72f987d912993'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:53.982512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d550917a6e74aa088a72f987d912993'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:53.988446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d550917a6e74aa088a72f987d912993'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:54.029944 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3511/7001] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:53 2022] DELETE /identity/v3/users/6d550917a6e74aa088a72f987d912993 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:54.034298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:54.034886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:54.034886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:54.074581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:54.075842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:54.208567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:54.246552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3491/7002] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:54.286587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:54.288098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:54.470421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff3467-912a-4ca6-bdd4-ef0f7cae90d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:54.477346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:54.477999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:54.478276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:54.478546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:54.490097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:54.491776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69b052-fe8a-4166-a3f7-dd2811fa5fbd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:54.504934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3512/7003] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:55.233293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:55.236679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:55.257482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b582ef0-5474-455d-a1ec-4a7ccf4b6e68 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:55.275165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:55.276159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:55.276925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:55.277439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] PATH_INFO: `/v3/projects/3998d884d18f49c8a7642aaa4bc5271b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:55.278823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3998d884d18f49c8a7642aaa4bc5271b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:55.281305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:55.364006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3998d884d18f49c8a7642aaa4bc5271b', 'request_id': 'req-2d588582-dbcf-4034-a28c-880911fa6297'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:55.375708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3998d884d18f49c8a7642aaa4bc5271b', 'request_id': 'req-2d588582-dbcf-4034-a28c-880911fa6297'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:55.386256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3998d884d18f49c8a7642aaa4bc5271b', 'request_id': 'req-2d588582-dbcf-4034-a28c-880911fa6297'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:55.399710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] The token cache is being invalidate because project 3998d884d18f49c8a7642aaa4bc5271b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:35:55.400420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:55.401419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2d588582-dbcf-4034-a28c-880911fa6297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:55.406553 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3492/7004] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:35:55 2022] DELETE /identity/v3/projects/3998d884d18f49c8a7642aaa4bc5271b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:55.408919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:55.410066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:55.410729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:55.436170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:55.438006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:55.561675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3513/7005] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:55.562501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:55.563045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:55.566596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:55.619885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:55.621515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:55.643277 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3493/7006] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:55.648433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:55.658529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:55.669463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa914-3001-495f-960c-92434ec2c4c6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:55.688731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:55.689865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:55.690376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:55.690904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:55.691815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:35:55.692348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:55.694728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:55.731713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:55.732118 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3514/7007] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:35:55.746765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c574b57-cf1b-428a-a81a-784951f8c01e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:55.752596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:55.753273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:55.753553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:55.754333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:55.754993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:55.758782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:55.832333 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3494/7008] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:35:55 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:35:55.835032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:55.851192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac9d30-ba38-4f4e-8d2e-77daf8b2536e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:56.008566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:56.011638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.011944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.012365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.013085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:56.015033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:56.098775 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3515/7009] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:35:55 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:35:56.101849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:56.127074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f22f0-b154-43e3-b33e-30384917c89d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:56.143398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:56.144624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.144978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.145223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.149101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:56.156962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:56.194180 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3495/7010] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:35:56.197862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:56.216248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a28e3b-e33b-4a0c-a7ab-56346827e3f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:56.223736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:56.226087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.227249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.227549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.229365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:56.235291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da956de5-5869-48c9-8a01-32fcffc5e98d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:56.261498 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3516/7011] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:35:56.267232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:56.286810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b7d6e-2d53-487e-a5a3-e704b67217a5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:56.295943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:56.296696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.297105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.297396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] PATH_INFO: `/v3/projects/71e114ef186c4c558dc9f82ed15e9f77/users/333438a9ef3c4630b0ffb4bbacba1d49/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.338149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e114ef186c4c558dc9f82ed15e9f77, user_id=333438a9ef3c4630b0ffb4bbacba1d49, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:56.343205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:56.374644 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3496/7012] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:35:56 2022] PUT /identity/v3/projects/71e114ef186c4c558dc9f82ed15e9f77/users/333438a9ef3c4630b0ffb4bbacba1d49/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:56.389480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.389772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.390053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.446958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] MFA Rules not processed for user `333438a9ef3c4630b0ffb4bbacba1d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:56.450073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:56.580062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3517/7013] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:56.678806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:56.680573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:56.917528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428ce91-41d3-44bb-8aeb-e7a8310c4fa3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:56.927370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:56.940055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:56.957649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:56.957981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:56.974866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:56.976900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1f4b8-d4a7-4a3d-a6ac-756ed95074d2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:56.998344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3497/7014] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:35:59.271282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:59.273087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:59.435920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:59.457633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592e17-8643-4e5b-a153-26a5c53452e8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:35:59.463532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:35:59.464430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:59.464776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:59.465087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] PATH_INFO: `/v3/users/4089a117cf4a45f4a6f005df6d1b0593` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:59.474017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4089a117cf4a45f4a6f005df6d1b0593)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:35:59.476071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:35:59.576771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4089a117cf4a45f4a6f005df6d1b0593'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:59.586585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4089a117cf4a45f4a6f005df6d1b0593'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:59.587508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4089a117cf4a45f4a6f005df6d1b0593'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:59.600547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4089a117cf4a45f4a6f005df6d1b0593'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:59.601674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4089a117cf4a45f4a6f005df6d1b0593'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:35:59.629567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3518/7015] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:35:59 2022] DELETE /identity/v3/users/4089a117cf4a45f4a6f005df6d1b0593 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:35:59.632328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:35:59.632878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:35:59.632971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:35:59.662999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:35:59.664652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:35:59.687034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:35:59.810509 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3498/7016] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:35:59.857677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:35:59.859928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:00.054925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d4a5-b15c-4983-97a7-8281d4db012d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:00.060518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:00.062183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:00.062740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:00.063261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:00.078689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:00.079744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7032457-b33a-4bbe-999d-3ade20a7f07d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:00.095471 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3519/7017] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:00.525915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:00.530250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:00.585224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864c64-dd01-4e8e-98a6-494812696d09 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:00.595396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:00.596102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:00.596405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:00.596674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] PATH_INFO: `/v3/projects/1081316325c64a399087dd06845abb9f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:00.597909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1081316325c64a399087dd06845abb9f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:00.599857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:00.766624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1081316325c64a399087dd06845abb9f', 'request_id': 'req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:00.775892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1081316325c64a399087dd06845abb9f', 'request_id': 'req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:00.790799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1081316325c64a399087dd06845abb9f', 'request_id': 'req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:00.846579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] The token cache is being invalidate because project 1081316325c64a399087dd06845abb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:36:00.851882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:00.857231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9f5704c3-0cb6-481a-b45e-80d47aa68c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:00.860416 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3499/7018] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:36:00 2022] DELETE /identity/v3/projects/1081316325c64a399087dd06845abb9f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:00.867117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:00.868534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:00.869305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:00.918852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:00.957889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:01.048280 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3520/7019] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:01.055888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.056164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.056425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.080525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:01.081824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:01.097705 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3500/7020] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:01.099247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.113064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b33c34-ec23-4a6f-8fb4-9b76910e81ad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.119389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.120543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.121077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.121307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.123354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:36:01.123354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.124692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.144855 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3521/7021] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:36:01.147255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.163737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5ef5a-c04c-484d-b5f5-dc0a7c545913 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.174600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.176172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.177267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.177891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.180152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.183472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.251485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3501/7022] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:36:01 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:01.253116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.268975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6c6a1-6c5b-477b-bdb1-d94fc5f02c91 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.300480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:01.454877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.455530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.455871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.456076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.456732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.464706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.529746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.531195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3522/7023] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:36:01 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:01.544177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713e256-e34b-4475-99df-58c9ff1d3e34 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.561039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.562103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.562619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.563125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.564027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.565988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.590506 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3502/7024] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:36:01.595633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.612978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b2066-9b98-4726-8284-8db1785fd3d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.620186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.621233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.621993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.622432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.623533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.627710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05871f-c617-4cea-b954-7cfacb46595d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.678154 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3523/7025] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:36:01.678978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:01.701760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cb9f-49d3-40e1-8da0-880fd7fc943c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:01.715426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:01.716273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.717240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.717636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] PATH_INFO: `/v3/projects/cd1c9bd926244361951ae98aebfd9c90/users/909dcdca71fd4ae59680e37ae8a0cae4/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.758942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1c9bd926244361951ae98aebfd9c90, user_id=909dcdca71fd4ae59680e37ae8a0cae4, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:01.762521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:01.793743 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3503/7026] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:36:01 2022] PUT /identity/v3/projects/cd1c9bd926244361951ae98aebfd9c90/users/909dcdca71fd4ae59680e37ae8a0cae4/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:36:01.809310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:01.809647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:01.810029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:01.890117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] MFA Rules not processed for user `909dcdca71fd4ae59680e37ae8a0cae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:01.891361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:02.143346 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3524/7027] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:36:02.253810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:02.255664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:02.441233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:02.533275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b328db-aab2-4f0b-8384-3d431d2e64c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:02.541160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:02.541991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:02.543585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:02.543585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:02.591285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:02.602654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:02.645604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3504/7028] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:07.278971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:07.281622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:07.396609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b42da2-0687-4508-b46e-d73443adeeff None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:07.403756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:07.404657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:07.405167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:07.405603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:07.407890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:07.429580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:07.551936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:07.554130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:07.580583 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3525/7029] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:36:12.627007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:17.571434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=22 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:18.178143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:18.182990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:18.226677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062a169-8794-4ff7-84f5-bf093cc05b10 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:18.242213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:18.244896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:18.245077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:18.245344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:18.249466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:18.291973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:18.295235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6263bb-8479-4056-b927-b2ae36f9abb5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:18.322113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3505/7030] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:23.902498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:23.905697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:24.076897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cfbc5-db24-4cf7-bdc1-c8b6e464a4cb service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:24.099074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:24.101404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:24.104970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:24.106279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] PATH_INFO: `/v3/users/333438a9ef3c4630b0ffb4bbacba1d49` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:24.108549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=333438a9ef3c4630b0ffb4bbacba1d49)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:24.112493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:24.234964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333438a9ef3c4630b0ffb4bbacba1d49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:24.251491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333438a9ef3c4630b0ffb4bbacba1d49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:24.252493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333438a9ef3c4630b0ffb4bbacba1d49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:24.268389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333438a9ef3c4630b0ffb4bbacba1d49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:24.269447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333438a9ef3c4630b0ffb4bbacba1d49'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:24.311640 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3526/7031] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:36:23 2022] DELETE /identity/v3/users/333438a9ef3c4630b0ffb4bbacba1d49 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:24.315982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:24.316528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:24.316879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:24.366305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:24.370665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:24.563207 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3506/7032] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:24.615872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:24.618213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:24.849569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24614-6476-4d73-8f26-5495aa52f07b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:24.861123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:24.862308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:24.863320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:24.864367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:24.909366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:24.912068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca297e-a1c7-4cb4-8bc1-f82dc55b2a20 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:24.937434 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3527/7033] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:25.663262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:25.664723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:25.750810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c216a-4f4b-48f1-9e1e-3cc714c0bf2b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:25.760349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:25.761495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:25.762496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:25.762976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] PATH_INFO: `/v3/users/07ec8991f6c24c69abcb907504eafb1e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:25.765063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ec8991f6c24c69abcb907504eafb1e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:25.772327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:25.901212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ec8991f6c24c69abcb907504eafb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:25.902162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ec8991f6c24c69abcb907504eafb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:25.927539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ec8991f6c24c69abcb907504eafb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:25.928933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ec8991f6c24c69abcb907504eafb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:25.949916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ec8991f6c24c69abcb907504eafb1e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.017787 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3507/7034] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:36:25 2022] DELETE /identity/v3/users/07ec8991f6c24c69abcb907504eafb1e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:26.023712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.025248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.025976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.122189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:26.127072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:26.170996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:26.189142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:26.192019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:26.344696 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3528/7035] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:26.377774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:26.379313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:26.395958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d7bb8-c982-4724-b3f7-ca0ff8d909c9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:26.409634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:26.410612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.410947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.411376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] PATH_INFO: `/v3/projects/71e114ef186c4c558dc9f82ed15e9f77` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.420293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e114ef186c4c558dc9f82ed15e9f77)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:26.423783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:26.432323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:26.533988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54be54a-1da4-4f38-bf0d-0c17e936ff88 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:26.549253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:26.552205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.553284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.553761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.581680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e114ef186c4c558dc9f82ed15e9f77', 'request_id': 'req-7accbc57-cb9a-4798-bf71-c3278db02f06'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.582677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:26.585505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d6c0-de44-4a7d-9de9-44306728aebd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:26.597201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e114ef186c4c558dc9f82ed15e9f77', 'request_id': 'req-7accbc57-cb9a-4798-bf71-c3278db02f06'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.609767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e114ef186c4c558dc9f82ed15e9f77', 'request_id': 'req-7accbc57-cb9a-4798-bf71-c3278db02f06'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.612624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3529/7036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:36:26.631564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] The token cache is being invalidate because project 71e114ef186c4c558dc9f82ed15e9f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:36:26.631851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.633081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7accbc57-cb9a-4798-bf71-c3278db02f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:26.636267 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3508/7037] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:36:26 2022] DELETE /identity/v3/projects/71e114ef186c4c558dc9f82ed15e9f77 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:26.643283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.643791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.644166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.698981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:26.706767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:26.860981 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3530/7038] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:26.862239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.862839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.862839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.908200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:26.911112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:26.933468 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3509/7039] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:26.937946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:26.953035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d1162-fe3e-4760-8a8a-27e923f177dc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:26.968835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:26.970573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:26.970900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:26.971196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:26.974699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:36:26.975072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:26.981147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.010203 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3531/7040] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:36:27.015289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.031017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7a96c-abdb-4294-a13c-02a88138e891 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.046885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.047516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.047787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.048403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.049092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.051012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.149479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.161535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3510/7041] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:36:27 2022] POST /identity/v3/projects => generated 359 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:27.183874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cdc63-73a8-4401-ae5e-d3a2cf1d8c25 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.308899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:27.338709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.339562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.339842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.340986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.340986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.343501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.385748 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3532/7042] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:36:27 2022] POST /identity/v3/users => generated 280 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:27.390394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.411854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a79e0-66a7-4daf-80b5-7eb16c8ffc79 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.420630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.426306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:27.441290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.442603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.443573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.443923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.445851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.449832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.453623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66c65-16e6-447d-b05e-ee3cea08ff5c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.470653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.472096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.472390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.473589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] PATH_INFO: `/v3/projects/3cdd4289d5ba4c86a79a0da7f14749b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.476875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdd4289d5ba4c86a79a0da7f14749b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.487284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3511/7043] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:36:27.488435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.490196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.525900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b0f9-065c-436c-869b-5336360d0a05 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.534287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.535308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.535761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.536126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.537022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.539150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.561481 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3512/7044] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:36:27.562878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.579107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f9b2-7fdc-40d1-addb-8acf9364c831 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:27.586999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:27.589312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.590041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.590684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] PATH_INFO: `/v3/projects/bf31f179890e416abf1ffc0336844a43/users/bc1f3d7dd96243f098ab58f5b758d986/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.624605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf31f179890e416abf1ffc0336844a43, user_id=bc1f3d7dd96243f098ab58f5b758d986, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:27.630901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faae1c-2c72-4bc7-861f-2e17a30da2cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:27.645989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdd4289d5ba4c86a79a0da7f14749b3', 'request_id': 'req-60d8ef4f-e6ad-477b-8855-05bf07d90450'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:27.682206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3513/7045] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:36:27 2022] PUT /identity/v3/projects/bf31f179890e416abf1ffc0336844a43/users/bc1f3d7dd96243f098ab58f5b758d986/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:36:27.687032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdd4289d5ba4c86a79a0da7f14749b3', 'request_id': 'req-60d8ef4f-e6ad-477b-8855-05bf07d90450'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:27.702482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.703114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.704841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.705773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdd4289d5ba4c86a79a0da7f14749b3', 'request_id': 'req-60d8ef4f-e6ad-477b-8855-05bf07d90450'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:27.754592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] The token cache is being invalidate because project 3cdd4289d5ba4c86a79a0da7f14749b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:36:27.755225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:27.756696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60d8ef4f-e6ad-477b-8855-05bf07d90450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:27.767906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] MFA Rules not processed for user `bc1f3d7dd96243f098ab58f5b758d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:27.769888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:27.776555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3533/7046] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:36:27 2022] DELETE /identity/v3/projects/3cdd4289d5ba4c86a79a0da7f14749b3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:27.778396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6d46-f977-404a-88c4-c85916203efd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:27.782595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6d46-f977-404a-88c4-c85916203efd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:27.783140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6d46-f977-404a-88c4-c85916203efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:27.841395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2cef6d46-f977-404a-88c4-c85916203efd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:27.848376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2cef6d46-f977-404a-88c4-c85916203efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:27.949051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3514/7047] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:36:27.972099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:27.974050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:27.982781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:28.003470 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3534/7048] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:28.005216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.005331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.005581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.056486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:28.058890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:28.088578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3535/7049] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:28.094787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.114470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35cf12-ae3b-4381-826a-7d4e7202faaf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.126286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9cf5-e882-4d70-a9e8-0d83f3cab394 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.128455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.129126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.129460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.131503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.133236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:36:28.133492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.133897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.135463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.135924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.136354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.136624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.158302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.162107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.187121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3536/7050] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:36:28.189976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3515/7051] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:36:28.195640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.220789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe54ae-d875-4e27-89c6-799bb5902058 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.238901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.239893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.240517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.241012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.242251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.246414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.334935 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3537/7052] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:36:28 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:28.338415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.361404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ce596-feba-42ea-9f35-285a70086f05 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.487592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.489028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.489028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.489028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.490805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.495633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.534811 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3516/7053] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:36:28 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:28.538832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.551065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484534c-2850-46d9-bd05-ced8c6e67562 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.560324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.561159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.561562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.561907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.562772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.565176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.584654 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3538/7054] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:36:28.585527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.601984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e2f73-878e-40c7-aa9b-70aa7da0c0c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.634032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.634032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.634920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.635648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.636454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.638291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c189-d454-4d39-a133-0e7f79c81fa0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.666281 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3517/7055] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:36:28.672556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:28.688822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd97d6a-363d-4dc9-a747-3213beecf437 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:28.696177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:28.697780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.698406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.698927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] PATH_INFO: `/v3/projects/e3e143f63ae340dab1f1ba739592666a/users/ee957c509b914e3483fd7f7872057652/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.729765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:28.743671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e143f63ae340dab1f1ba739592666a, user_id=ee957c509b914e3483fd7f7872057652, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:28.755451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:28.791456 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3539/7056] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:36:28 2022] PUT /identity/v3/projects/e3e143f63ae340dab1f1ba739592666a/users/ee957c509b914e3483fd7f7872057652/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:28.793990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:28.794281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:28.794557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:28.845172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] MFA Rules not processed for user `ee957c509b914e3483fd7f7872057652`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:28.846386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:28.974320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3518/7057] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:29.021499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:29.169504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a05b05-0991-416d-98b5-a4d7765c4f49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:29.186297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:29.187139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:29.187419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:29.188112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:29.201223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:29.202890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc7195-2fc5-45ec-820b-4f1bc9e2fa07 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:29.216859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3540/7058] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:38.963777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:39.210249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:41.386234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:41.387882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:41.552283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38770927-55ab-4dbd-8c69-0f5743397c21 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:41.566704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:41.567827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:41.568301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:41.568763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] PATH_INFO: `/v3/users/e12e63c76594460a9d2995005508993d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:41.574627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12e63c76594460a9d2995005508993d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:41.577078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:41.737957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12e63c76594460a9d2995005508993d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:41.739044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12e63c76594460a9d2995005508993d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:41.760455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12e63c76594460a9d2995005508993d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:41.763387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12e63c76594460a9d2995005508993d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:41.785010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12e63c76594460a9d2995005508993d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:41.826424 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3519/7059] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:36:41 2022] DELETE /identity/v3/users/e12e63c76594460a9d2995005508993d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:41.830834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:41.831728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:41.832664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:41.862218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:41.863799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:41.970072 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3541/7060] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:36:41.997024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:41.998489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:42.128516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599495bd-ca65-4d62-ad28-c36f07815ed4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:42.138029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:42.138929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:42.139332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:42.139800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:42.175645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:42.182549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694654d-599e-4947-80f6-ee4d49e118ea service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:42.194508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3520/7061] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:43.536323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:43.537820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:43.563619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cc83c-949b-4df6-a0dd-f5085256de0e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:43.575966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:43.578554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:43.579063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:43.579716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] PATH_INFO: `/v3/projects/9e485dacc4cb4debaa307360f5262c0a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:43.581399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e485dacc4cb4debaa307360f5262c0a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:43.584707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:43.720106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e485dacc4cb4debaa307360f5262c0a', 'request_id': 'req-5bc70b03-891e-4f05-9995-20e0b2af579f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:43.734687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e485dacc4cb4debaa307360f5262c0a', 'request_id': 'req-5bc70b03-891e-4f05-9995-20e0b2af579f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:43.750146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e485dacc4cb4debaa307360f5262c0a', 'request_id': 'req-5bc70b03-891e-4f05-9995-20e0b2af579f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:43.783031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] The token cache is being invalidate because project 9e485dacc4cb4debaa307360f5262c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:36:43.783394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:43.784543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5bc70b03-891e-4f05-9995-20e0b2af579f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:36:43.791658 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3542/7062] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:36:43 2022] DELETE /identity/v3/projects/9e485dacc4cb4debaa307360f5262c0a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:43.792822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:43.793530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:43.793815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:43.833478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:43.835230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:43.886991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:43.983638 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3521/7063] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:43.992631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:43.994214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:43.994610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.059323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:44.066192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:44.094150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3543/7064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:44.098986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.138901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2764-bcde-4119-9369-05d048f72bb4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.147258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.148093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.148382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.148717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.150068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:36:44.150605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.155244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.175135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3522/7065] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:36:44.181400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.197636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b93d5-6dbb-43ca-8ef8-1087ba3e01ea None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.207465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.208367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.210897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.211388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.212888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.215443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.265141 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3544/7066] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:36:44 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:36:44.268882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.286663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc9b00-cf03-4add-9b63-66b41e95a2f5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.410220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.411568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.412093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.412529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.413385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.416901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.464551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3523/7067] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:36:44 2022] POST /identity/v3/users => generated 281 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:36:44.466794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.479938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14173c3f-a3d4-4b79-b4d5-3780a2e313f6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.485506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.486141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.487612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.487612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.487867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.496152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.535384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3545/7068] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:36:44.538385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.556811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445d3d5-d1b4-4f67-9ee9-aa2f2a784f88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.572509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.578985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.579351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.580377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.581090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.583139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e8b43-2953-4e7f-9e15-e520e60730da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.621591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3524/7069] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:36:44.626475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.639790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688685a-eb8d-457d-ba7c-5596568feb87 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:44.645821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:44.646593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.646968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.647441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] PATH_INFO: `/v3/projects/f34fd34ac60744ee9775911907d432c0/users/74c90c833e4a478fb759871ef3eb6737/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.666339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34fd34ac60744ee9775911907d432c0, user_id=74c90c833e4a478fb759871ef3eb6737, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:44.672254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:44.702044 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3546/7070] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:36:44 2022] PUT /identity/v3/projects/f34fd34ac60744ee9775911907d432c0/users/74c90c833e4a478fb759871ef3eb6737/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:36:44.703004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:44.703356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:44.703722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:44.768352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] MFA Rules not processed for user `74c90c833e4a478fb759871ef3eb6737`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:36:44.769584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:44.925307 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3525/7071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:36:44.951039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:44.952669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:45.043541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:45.137792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05b594-85a0-4647-90a5-e761dd3e4ab5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:45.143566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:45.144660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:45.145159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:45.145729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:45.170648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:45.172115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:45.201309 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3547/7072] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:49.723343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:49.725720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:49.779353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:36:49.918697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f4825-d73a-42ca-a735-15053ee41e56 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:49.928709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:49.929866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:49.931113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:49.931721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:49.936798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:50.043778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:50.046507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:50.080363 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3526/7073] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:52.870942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:52.873552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:53.097458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc58ca-5bc8-4a54-9990-39eb5a8e5241 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:53.107772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:53.108807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:53.109707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:53.110159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:53.112550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:53.132348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:53.135104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:53.151857 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3548/7074] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:36:54.876072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:36:54.878823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:54.931787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f349e-ce53-4e7f-a576-ae65510ae8d5 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:36:54.955682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:36:54.964462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:36:54.964911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:36:54.965382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:36:54.979179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:36:55.062348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:36:55.064784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:36:55.098358 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3527/7075] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:00.826176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:00.841870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024992-eeb7-4b41-9536-2bdb296bd592 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:00.847615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:00.849749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:00.850571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:00.851199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:00.855923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:00.986247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:00.988249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f9c9-37d1-452d-a8a9-c5a76efb298e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:01.020342 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3549/7076] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:05.080949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=58 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:07.567477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:07.569983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:07.627870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711d46-f3d9-4b3e-8e60-f592da2266bc service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:07.642729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:07.644034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:07.644427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:07.646031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] PATH_INFO: `/v3/users/909dcdca71fd4ae59680e37ae8a0cae4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:07.647444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=909dcdca71fd4ae59680e37ae8a0cae4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:07.650829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:07.798942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909dcdca71fd4ae59680e37ae8a0cae4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:07.799917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909dcdca71fd4ae59680e37ae8a0cae4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:07.823775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909dcdca71fd4ae59680e37ae8a0cae4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:07.824754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909dcdca71fd4ae59680e37ae8a0cae4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:07.838890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909dcdca71fd4ae59680e37ae8a0cae4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:07.868520 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3528/7077] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:07 2022] DELETE /identity/v3/users/909dcdca71fd4ae59680e37ae8a0cae4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:07.870281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:07.870801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:07.870932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:07.910872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:07.912184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:07.985733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:08.029635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3550/7078] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:08.043303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:08.046153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:08.145935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66a929-2c18-4b5c-be6c-fe725a19f95f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:08.150604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:08.151343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:08.151618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:08.151884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:08.166355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:08.168197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78379c04-f027-4787-9631-b22c28603a61 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:08.233331 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3529/7079] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:09.071200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.073165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:09.092115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5a36-2bd3-4762-a936-39893bdbe41d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.097965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.099256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.099746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.100246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] PATH_INFO: `/v3/projects/cd1c9bd926244361951ae98aebfd9c90` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.102422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1c9bd926244361951ae98aebfd9c90)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.105738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.188282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1c9bd926244361951ae98aebfd9c90', 'request_id': 'req-a28d4e8e-78ea-4c10-af42-c957e8b34212'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:09.195946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1c9bd926244361951ae98aebfd9c90', 'request_id': 'req-a28d4e8e-78ea-4c10-af42-c957e8b34212'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:09.203164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1c9bd926244361951ae98aebfd9c90', 'request_id': 'req-a28d4e8e-78ea-4c10-af42-c957e8b34212'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:09.223552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] The token cache is being invalidate because project cd1c9bd926244361951ae98aebfd9c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:09.225320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:09.229579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a28d4e8e-78ea-4c10-af42-c957e8b34212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:09.231448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3551/7080] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:09 2022] DELETE /identity/v3/projects/cd1c9bd926244361951ae98aebfd9c90 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:09.239698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.240185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.240639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.287859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:09.292406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:09.421363 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3530/7081] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:09.432203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.434619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.435128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.461908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:09.464006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:09.479991 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3552/7082] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:09.484755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.496236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148434b2-f1ca-4c9a-8f4c-431fe6599afc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.502266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.502975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.503431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.503698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.504684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:09.505184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.506961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.521414 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3531/7083] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:09.526406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.542692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cc1f-0c1a-4156-866e-7b1f96712777 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.548355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.550671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.551150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.551719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.552520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.554797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.605167 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3553/7084] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:09 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:09.608705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.614532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:09.624133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e653b3-6182-4913-b312-e6122612544e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.754774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.766941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.768205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.768771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.769758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.790973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.835500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3532/7085] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:09 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:09.839949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.851855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f08b-2946-498e-99ee-f3638a87fadc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.859640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.865925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.866518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.867492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.868595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.871528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.888057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3554/7086] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:09.892045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.905874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4164-0d93-401c-9f5c-75a3ed7abaa7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.912207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.915559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.915864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.916108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:09.916772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:09.918417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6cd89-1d8f-4a10-b83e-62a9d94d60f7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:09.956585 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3533/7087] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:37:09.961921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:09.972547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1b8c-b6eb-40ce-b7ba-8dae7e84efd2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:09.990560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:09.991358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:09.991530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:09.991826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] PATH_INFO: `/v3/projects/1f6dc6db02004cb18b14207bd9fe03f0/users/06fc0c9be5cd461ca0986cdbf2861394/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.026733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6dc6db02004cb18b14207bd9fe03f0, user_id=06fc0c9be5cd461ca0986cdbf2861394, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:10.028462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:10.060727 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3555/7088] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:09 2022] PUT /identity/v3/projects/1f6dc6db02004cb18b14207bd9fe03f0/users/06fc0c9be5cd461ca0986cdbf2861394/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:10.072848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:10.073460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:10.074025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.152904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] MFA Rules not processed for user `06fc0c9be5cd461ca0986cdbf2861394`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:10.154261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:10.353067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3534/7089] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:10.354387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:10.441220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aae67c-2252-44bf-a78c-2c3f4e72b5ae admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:10.448322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:10.449342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:10.449883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:10.451502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.452429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:10.456240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:10.471334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:10.510869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3556/7090] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:10 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:37:10.514739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:10.533669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20373f04-6356-4672-8a64-0d1fae237b19 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:10.704262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:10.706027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:10.706562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:10.716331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.733151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:10.742413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:10.775067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:10.788210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:10.795120 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3535/7091] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:10 2022] POST /identity/v3/users => generated 308 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:10.800848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634fd7e-04b3-4665-9b53-5fce07e0ae35 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:10.811368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:10.812636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:10.813168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:10.813711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.814793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:10.818082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:10.833155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3557/7092] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:37:10.838507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:10.852593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fb661-8acb-4eb4-8144-9c4f39f545bf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:10.860683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:10.861740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:10.862402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:10.862900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] PATH_INFO: `/v3/projects/8186ffd2f49f4e82871c0608a5e8443b/users/ad56cb78d1e94eb2944fe78018afa417/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:10.888138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8186ffd2f49f4e82871c0608a5e8443b, user_id=ad56cb78d1e94eb2944fe78018afa417, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:10.892426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:10.931591 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3536/7093] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:10 2022] PUT /identity/v3/projects/8186ffd2f49f4e82871c0608a5e8443b/users/ad56cb78d1e94eb2944fe78018afa417/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:10.942250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:10.967144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9028c-e1b5-47b4-81b3-dc50e25bdc59 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:11.116673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:11.117402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:11.117773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:11.117943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:11.118607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:11.120925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37dfe-bb32-459d-8e4c-e0f43578a325 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:11.152182 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3558/7094] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:11.155283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:11.181297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3e762-2ebd-44f6-a155-0038c419484c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:11.198951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:11.199969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:11.201872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:11.202672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] PATH_INFO: `/v3/projects/8186ffd2f49f4e82871c0608a5e8443b/users/ad56cb78d1e94eb2944fe78018afa417/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:11.208461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8186ffd2f49f4e82871c0608a5e8443b, user_id=ad56cb78d1e94eb2944fe78018afa417, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:11.218223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:11.247815 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3537/7095] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:11 2022] PUT /identity/v3/projects/8186ffd2f49f4e82871c0608a5e8443b/users/ad56cb78d1e94eb2944fe78018afa417/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:11.367406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:11.368560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:11.369388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:11.409379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] MFA Rules not processed for user `ad56cb78d1e94eb2944fe78018afa417`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:11.411793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:11.629585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:11.631594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:11.635621 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3559/7096] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:11.788374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de9ae2-df3a-444b-81dd-ef4f099b88cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:11.809346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:11.810476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:11.810983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:11.812588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:11.839569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:11.842107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18299f68-3287-4f51-9d59-209fbb9b43b7 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:11.890640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3538/7097] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:37:12.127964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:12.379978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23666071-ce90-40c5-ae27-2e50e7d25e21 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:12.389445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:12.390115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:12.394432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:12.394432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] PATH_INFO: `/v3/users/06fc0c9be5cd461ca0986cdbf2861394` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:12.397812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fc0c9be5cd461ca0986cdbf2861394)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:12.410952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:12.416124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:12.517687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fc0c9be5cd461ca0986cdbf2861394'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:12.528678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fc0c9be5cd461ca0986cdbf2861394'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:12.530157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fc0c9be5cd461ca0986cdbf2861394'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:12.542464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fc0c9be5cd461ca0986cdbf2861394'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:12.543395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fc0c9be5cd461ca0986cdbf2861394'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:12.678058 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3560/7098] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:12 2022] DELETE /identity/v3/users/06fc0c9be5cd461ca0986cdbf2861394 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:12.680238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:12.681145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:12.681145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:12.730665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:12.731916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:12.883399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3539/7099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:12.895421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:12.896888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:13.051742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f81b8-63c8-4175-8b41-31623e5eca01 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:13.063657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:13.064308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:13.064589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:13.064868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:13.084095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:13.085654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:13.111665 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3561/7100] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:13.770504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:13.771686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:13.787247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c163-a07c-49e2-9dda-12e93ab88725 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:13.795037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:13.796212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:13.796695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:13.797189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] PATH_INFO: `/v3/projects/1f6dc6db02004cb18b14207bd9fe03f0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:13.798542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6dc6db02004cb18b14207bd9fe03f0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:13.801677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:13.874281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6dc6db02004cb18b14207bd9fe03f0', 'request_id': 'req-6e901231-7995-4e9d-8d28-4d820f2e7ce5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:13.882196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6dc6db02004cb18b14207bd9fe03f0', 'request_id': 'req-6e901231-7995-4e9d-8d28-4d820f2e7ce5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:13.890599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6dc6db02004cb18b14207bd9fe03f0', 'request_id': 'req-6e901231-7995-4e9d-8d28-4d820f2e7ce5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:13.897149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:13.913896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] The token cache is being invalidate because project 1f6dc6db02004cb18b14207bd9fe03f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:13.914746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:13.915813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:13.917453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3540/7101] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:13 2022] DELETE /identity/v3/projects/1f6dc6db02004cb18b14207bd9fe03f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:13.921557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:13.936081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff26eda-be23-4453-a9c3-c1286f000ce9 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:14.019326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:14.020022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:14.020263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:14.021428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] PATH_INFO: `/v3/users/ad56cb78d1e94eb2944fe78018afa417` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:14.022742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad56cb78d1e94eb2944fe78018afa417)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:14.029967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:14.092349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:14.126191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad56cb78d1e94eb2944fe78018afa417'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:14.138892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad56cb78d1e94eb2944fe78018afa417'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:14.140124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad56cb78d1e94eb2944fe78018afa417'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:14.158340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad56cb78d1e94eb2944fe78018afa417'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:14.159901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0d8e88af-5754-42f5-917a-668c675a4d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad56cb78d1e94eb2944fe78018afa417'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:14.203407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3562/7102] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:13 2022] DELETE /identity/v3/users/ad56cb78d1e94eb2944fe78018afa417 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:14.888078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:14.889686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:14.915780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e901231-7995-4e9d-8d28-4d820f2e7ce5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:15.050997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:15.051944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.052435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.052879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] PATH_INFO: `/v3/projects/8186ffd2f49f4e82871c0608a5e8443b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.054579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8186ffd2f49f4e82871c0608a5e8443b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:15.056724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:15.152653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8186ffd2f49f4e82871c0608a5e8443b', 'request_id': 'req-ff6e1742-b359-42c7-a370-976df4630bea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:15.166581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8186ffd2f49f4e82871c0608a5e8443b', 'request_id': 'req-ff6e1742-b359-42c7-a370-976df4630bea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:15.187880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8186ffd2f49f4e82871c0608a5e8443b', 'request_id': 'req-ff6e1742-b359-42c7-a370-976df4630bea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:15.219295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] The token cache is being invalidate because project 8186ffd2f49f4e82871c0608a5e8443b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:15.219788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:15.225833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ff6e1742-b359-42c7-a370-976df4630bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:15.228828 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3541/7103] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:14 2022] DELETE /identity/v3/projects/8186ffd2f49f4e82871c0608a5e8443b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:15.235005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.235563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.235984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.305163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:15.308679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:15.471725 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3563/7104] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:15.479725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.480013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.480281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.536714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:15.537961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:15.566252 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3542/7105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:15.571620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:15.591401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d3bc9-7f19-49ba-a835-f123502adf3f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:15.599771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:15.600403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.600883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.601373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.602371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:15.602886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:15.604714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:15.643043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3564/7106] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:15.645703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:15.660987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e66f9-6d58-4a95-b915-a19ae8a3b838 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:15.673892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:15.674537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.674817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.675089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.675746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:15.677696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:15.733623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3543/7107] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:15 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:37:15.735826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:15.748125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672054bd-aa72-4ee6-ad82-a9dbf79cd852 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:15.872704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:15.873727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.874040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.874638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.882035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:15.896603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:15.928040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3565/7108] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:15 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:15.932974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:15.954968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4045f-2696-47b8-a9e7-390d3ce5e642 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:15.964981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:15.965646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:15.966408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:15.966699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:15.967407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:15.972632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:15.997422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3544/7109] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:16.000953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.016303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa90273-e5e5-4e1e-b6e0-944f31c01b27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.025228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.025872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.026153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.026497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.027196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.033136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f3edc-dd56-4403-be36-9033ecf23973 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.050218 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3566/7110] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:16.051303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.063233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8646f2-f6db-4029-9d5a-a3cda7446d96 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.069635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.070841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.071313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.071792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] PATH_INFO: `/v3/projects/a4f00fa4b38043dbb62ee05b1ec5ddfc/users/857714653d004a24ae84928860491536/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.096631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f00fa4b38043dbb62ee05b1ec5ddfc, user_id=857714653d004a24ae84928860491536, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.103707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.128507 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3545/7111] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:16 2022] PUT /identity/v3/projects/a4f00fa4b38043dbb62ee05b1ec5ddfc/users/857714653d004a24ae84928860491536/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:16.139525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.140167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.140681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.190766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:16.211883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] MFA Rules not processed for user `857714653d004a24ae84928860491536`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:16.214732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:16.351861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3567/7112] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:16.354414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.402186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:16.479266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36bdd4-f0c0-4bfc-9daf-e8b7dc71dd65 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.485361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.486012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.486386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.486826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.487514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.490960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.541509 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3546/7113] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:16 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:37:16.547138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.564323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0923df-6961-44a6-b368-917fae6d3f9f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.674525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.675686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.676060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.676624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.680090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.684649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.730699 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3568/7114] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:16 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:16.735192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.752849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2a64-c815-4d25-9626-ab4f788c8633 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.761307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.762208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.762625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.763089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.764575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.766769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.783436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3547/7115] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:16.787541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.816459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80435-9f0d-4dd0-8150-21892e801537 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:16.831339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:16.834093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:16.834534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:16.835081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] PATH_INFO: `/v3/projects/d6a47179833445399c1cacdc906fe76f/users/807cad240a934e4f8b062320a34c1bc7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:16.889102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a47179833445399c1cacdc906fe76f, user_id=807cad240a934e4f8b062320a34c1bc7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:16.892079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:16.922206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3569/7116] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:16 2022] PUT /identity/v3/projects/d6a47179833445399c1cacdc906fe76f/users/807cad240a934e4f8b062320a34c1bc7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:16.926389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:16.942606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87994581-d211-47b4-82fa-bcf6bc2ff8a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:17.084498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:17.086638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:17.086991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:17.087881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:17.089555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:17.092513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805494a9-7534-481c-ac5f-e37826a45594 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:17.131693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3548/7117] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:17.135951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:17.156638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719897-dcdf-46fd-9ebb-4c58d76ee3d8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:17.178394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:17.178771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:17.179031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:17.179852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] PATH_INFO: `/v3/projects/d6a47179833445399c1cacdc906fe76f/users/807cad240a934e4f8b062320a34c1bc7/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:17.197606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a47179833445399c1cacdc906fe76f, user_id=807cad240a934e4f8b062320a34c1bc7, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:17.217019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:17.256694 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3570/7118] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:17 2022] PUT /identity/v3/projects/d6a47179833445399c1cacdc906fe76f/users/807cad240a934e4f8b062320a34c1bc7/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:17.269572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:17.270111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:17.270832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:17.370723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] MFA Rules not processed for user `807cad240a934e4f8b062320a34c1bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:17.374879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:17.587277 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3549/7119] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:17.599286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:17.602696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:17.733063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868e6a0-c2c1-45b1-92bc-748a1db41862 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:17.743694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:17.747090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:17.749006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:17.749391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:17.761637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:17.926322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:17.927778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:17.957526 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3571/7120] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:21.976589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:21.978481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:22.013374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:22.137358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39b06-feae-4eb9-b5ac-5bd3997617f0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:22.147497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:22.148202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:22.148475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:22.148836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:22.157241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:22.189702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:22.191234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:22.219213 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3550/7121] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:24.297868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:24.298608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:24.321485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb57e8-7e5e-4e2b-9f79-1bcbc2743061 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:24.328796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:24.329474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:24.329750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:24.330022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:24.356497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:24.363077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:24.383033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3572/7122] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:28.359680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:28.362677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:28.617263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041473a-f627-4501-82cd-1981f91ccde6 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:28.638441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:28.639109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:28.639385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:28.639656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] PATH_INFO: `/v3/users/85ef590207844cc5b5ecb86cc00fc862` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:28.642236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ef590207844cc5b5ecb86cc00fc862)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:28.655845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:28.810569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ef590207844cc5b5ecb86cc00fc862'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:28.813930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ef590207844cc5b5ecb86cc00fc862'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:28.842050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ef590207844cc5b5ecb86cc00fc862'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:28.843357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ef590207844cc5b5ecb86cc00fc862'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:28.854614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ef590207844cc5b5ecb86cc00fc862'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:28.900685 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3551/7123] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:28 2022] DELETE /identity/v3/users/85ef590207844cc5b5ecb86cc00fc862 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:30.222901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:30.247246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1907db-3ab6-491d-99df-0fa958708808 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:30.371930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:30.374114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:30.376571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:30.377031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] PATH_INFO: `/v3/projects/9d36e2aefcbe4a37a390a41917a828d4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:30.379806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d36e2aefcbe4a37a390a41917a828d4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:30.382740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:30.485403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d36e2aefcbe4a37a390a41917a828d4', 'request_id': 'req-39b7b8fb-65fe-4794-8ec2-03690a625fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:30.505967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d36e2aefcbe4a37a390a41917a828d4', 'request_id': 'req-39b7b8fb-65fe-4794-8ec2-03690a625fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:30.528709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d36e2aefcbe4a37a390a41917a828d4', 'request_id': 'req-39b7b8fb-65fe-4794-8ec2-03690a625fd6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:30.572590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] The token cache is being invalidate because project 9d36e2aefcbe4a37a390a41917a828d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:30.573206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:30.575246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:30.580722 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3573/7124] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:30 2022] DELETE /identity/v3/projects/9d36e2aefcbe4a37a390a41917a828d4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:30.586921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:30.589209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:30.624835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125be1b-fade-463e-a8c2-6b5b03d60bc2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:30.681216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:30.807295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:30.808600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:30.809192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:30.809744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] PATH_INFO: `/v3/users/8e68b5170a7f4b83b4b295cedb610206` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:30.811295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e68b5170a7f4b83b4b295cedb610206)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:30.813634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:31.008194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e68b5170a7f4b83b4b295cedb610206'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:31.011275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e68b5170a7f4b83b4b295cedb610206'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:31.035386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e68b5170a7f4b83b4b295cedb610206'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:31.036440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e68b5170a7f4b83b4b295cedb610206'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:31.058473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b8ae32ad-30b4-4ff9-b0f7-67b2f80f5464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e68b5170a7f4b83b4b295cedb610206'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:31.102058 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3552/7125] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:30 2022] DELETE /identity/v3/users/8e68b5170a7f4b83b4b295cedb610206 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:32.497126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:32.498902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:32.519378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b8fb-65fe-4794-8ec2-03690a625fd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:32.544830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:32.643710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:32.644522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:32.645114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:32.647342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] PATH_INFO: `/v3/projects/50a8cd3fa01f4e76bad896691591ae5b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:32.647342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a8cd3fa01f4e76bad896691591ae5b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:32.650186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:32.781781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a8cd3fa01f4e76bad896691591ae5b', 'request_id': 'req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:32.824627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a8cd3fa01f4e76bad896691591ae5b', 'request_id': 'req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:32.841624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a8cd3fa01f4e76bad896691591ae5b', 'request_id': 'req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:32.886772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] The token cache is being invalidate because project 50a8cd3fa01f4e76bad896691591ae5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:32.888372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:32.889309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b4db38ea-5cfc-466d-bc1f-7dfe486f28d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:32.891780 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3574/7126] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:32 2022] DELETE /identity/v3/projects/50a8cd3fa01f4e76bad896691591ae5b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:32.898030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:32.900148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:32.900658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:32.964814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:32.966133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:33.142004 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3553/7127] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:33.152580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.153239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.154438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.227950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:33.235526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:33.271406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3575/7128] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:33.273890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.299119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c81ce-f1fa-4548-9f48-8fa1e73edb8b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.310157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.311094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.311748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.312322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.313348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:33.314651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.317874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:33.335280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3554/7129] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:37:33.339859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.357677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9eb2a-9744-4611-b3f2-ffcbcca0796a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.365813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.368448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.368954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.369857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.370760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.374109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:33.443005 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3576/7130] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:33 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:33.446615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.460707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f6aea-a1e7-40de-90e5-4e958265ed23 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.531884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:33.573054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.574073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.575040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.575593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.576480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.579154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:33.623765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3555/7131] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:33 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:33.625866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.647177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509bc3c-b5e3-4206-a6c7-824a4e4847a5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.659048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.661872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.663364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.664061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.668617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.674452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:33.757852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.758406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3577/7132] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:33.777883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b5e89-1a8c-4bf8-862e-72a7fedc348a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.788760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.789494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.789724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.790294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.792424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.799955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac37d-1188-4814-ab03-ae8e1fc88abb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:33.825941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3556/7133] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:33.830338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:33.851185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f1e9-163d-4687-9043-f4a1faf513cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:33.868865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:33.875163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:33.875931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:33.876958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] PATH_INFO: `/v3/projects/6f48249ad675426b831ae7c3cc2a6a02/users/b2c9634f6bb948c7ac325cfedc006292/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:33.929478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f48249ad675426b831ae7c3cc2a6a02, user_id=b2c9634f6bb948c7ac325cfedc006292, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:33.936660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:34.002180 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3578/7134] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:33 2022] PUT /identity/v3/projects/6f48249ad675426b831ae7c3cc2a6a02/users/b2c9634f6bb948c7ac325cfedc006292/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:34.003296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:34.003801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:34.003916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:34.064163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:34.068171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:34.282087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3557/7135] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:34.313757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:34.316588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:34.447979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:34.462015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804e2c-857e-45dc-b07c-f48bc152e675 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:34.468821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:34.469694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:34.470639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:34.470914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:34.492939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:34.494519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c94df0-9205-4031-b295-e3b5ab942b15 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:34.531406 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3579/7136] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:38.404543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:38.406546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:38.439849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7038c-398d-4571-8fab-db5ea7f8851c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:38.454002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:38.505136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:38.505136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:38.505136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] PATH_INFO: `/v3/users/857714653d004a24ae84928860491536` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:38.505136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] RBAC: Authorizing `identity:delete_user(user_id=857714653d004a24ae84928860491536)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:38.505136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:38.627922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857714653d004a24ae84928860491536'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:38.629564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857714653d004a24ae84928860491536'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:38.661812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857714653d004a24ae84928860491536'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:38.664652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857714653d004a24ae84928860491536'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:38.680192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857714653d004a24ae84928860491536'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:38.731493 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3558/7137] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:38 2022] DELETE /identity/v3/users/857714653d004a24ae84928860491536 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:38.738120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:38.739676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:38.740681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:38.852648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:38.858308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:39.131185 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3580/7138] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:39.152327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:39.153861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:39.230851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:39.289796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730ec04-9a70-4b2d-8acf-0409b079c03a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:39.293784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:39.294940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:39.295416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:39.295887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:39.309752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:39.311246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1742-896a-4ef4-87ed-fac5a4263594 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:39.333935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3559/7139] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:41.283859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:41.285581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:41.307275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e786f-8edf-46cb-86ec-409ac714f835 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:41.329065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:41.329745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:41.330030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:41.330307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] PATH_INFO: `/v3/users/2b093292edb647b8866ab44d70fdf1b6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:41.332243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b093292edb647b8866ab44d70fdf1b6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:41.334288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:41.451210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b093292edb647b8866ab44d70fdf1b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:41.468559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b093292edb647b8866ab44d70fdf1b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:41.471319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b093292edb647b8866ab44d70fdf1b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:41.490293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b093292edb647b8866ab44d70fdf1b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:41.491526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b093292edb647b8866ab44d70fdf1b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:41.556496 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3581/7140] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:41 2022] DELETE /identity/v3/users/2b093292edb647b8866ab44d70fdf1b6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:41.563994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:41.564511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:41.564511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:41.606475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:41.607791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:41.729725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3560/7141] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:41.759782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:41.761704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:41.882714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db675-a289-4ddf-ab3d-f6304368150f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:41.906399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:41.907398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:41.907943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:41.908377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:41.924306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:41.926305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:41.947770 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3582/7142] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:42.034796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:42.050788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:42.111560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac11eb5-30e6-437b-a18d-af1c597bf550 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:42.119355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:42.120208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:42.120680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:42.121295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] PATH_INFO: `/v3/projects/a4f00fa4b38043dbb62ee05b1ec5ddfc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:42.124784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f00fa4b38043dbb62ee05b1ec5ddfc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:42.126782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:42.203130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f00fa4b38043dbb62ee05b1ec5ddfc', 'request_id': 'req-90f17725-131f-42c0-8c1b-56f4b4454d80'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.213720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f00fa4b38043dbb62ee05b1ec5ddfc', 'request_id': 'req-90f17725-131f-42c0-8c1b-56f4b4454d80'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.222614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f00fa4b38043dbb62ee05b1ec5ddfc', 'request_id': 'req-90f17725-131f-42c0-8c1b-56f4b4454d80'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.239275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] The token cache is being invalidate because project a4f00fa4b38043dbb62ee05b1ec5ddfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:42.239913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.241318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.247867 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3561/7143] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:42 2022] DELETE /identity/v3/projects/a4f00fa4b38043dbb62ee05b1ec5ddfc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:42.248450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:42.262357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d9f22-7903-439c-a114-b7fd8b2eeed8 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:42.267869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:42.370524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:42.371276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:42.371577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:42.372095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] PATH_INFO: `/v3/users/807cad240a934e4f8b062320a34c1bc7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:42.373877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=807cad240a934e4f8b062320a34c1bc7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:42.376585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:42.481357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807cad240a934e4f8b062320a34c1bc7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.491869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807cad240a934e4f8b062320a34c1bc7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.493436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807cad240a934e4f8b062320a34c1bc7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.504309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807cad240a934e4f8b062320a34c1bc7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.505762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807cad240a934e4f8b062320a34c1bc7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:42.531588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3583/7144] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:42 2022] DELETE /identity/v3/users/807cad240a934e4f8b062320a34c1bc7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:43.515131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:43.520167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:43.546078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17725-131f-42c0-8c1b-56f4b4454d80 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:43.657568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:43.670205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:43.676764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:43.677363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:43.677734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] PATH_INFO: `/v3/projects/d6a47179833445399c1cacdc906fe76f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:43.680953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a47179833445399c1cacdc906fe76f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:43.697082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:43.815211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a47179833445399c1cacdc906fe76f', 'request_id': 'req-3f004e7a-a504-45ba-9e76-daa950e64c75'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:43.830396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:43.833696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:43.835778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a47179833445399c1cacdc906fe76f', 'request_id': 'req-3f004e7a-a504-45ba-9e76-daa950e64c75'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:43.860806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b1532-68b5-4b3a-8595-e2e7cd252b3c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:43.865561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a47179833445399c1cacdc906fe76f', 'request_id': 'req-3f004e7a-a504-45ba-9e76-daa950e64c75'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:43.895344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] The token cache is being invalidate because project d6a47179833445399c1cacdc906fe76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:43.898222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:43.902387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3f004e7a-a504-45ba-9e76-daa950e64c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:43.905598 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3562/7145] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:43 2022] DELETE /identity/v3/projects/d6a47179833445399c1cacdc906fe76f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:43.917278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4979e2-1e8b-4a03-84e7-37f2aebf05ee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:43.918562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4979e2-1e8b-4a03-84e7-37f2aebf05ee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:43.918946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4979e2-1e8b-4a03-84e7-37f2aebf05ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:43.976276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2f4979e2-1e8b-4a03-84e7-37f2aebf05ee None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:43.983014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2f4979e2-1e8b-4a03-84e7-37f2aebf05ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:43.995103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:43.997019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:43.999505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.000021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] PATH_INFO: `/v3/projects/57219e9b82c443f3a13a0f6ca49f4994` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.002619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57219e9b82c443f3a13a0f6ca49f4994)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.005558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.007688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3563/7146] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:44.015417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.016271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.016271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.058682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:44.060290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:44.072370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3564/7147] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:44.074262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:44.076800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.101888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57219e9b82c443f3a13a0f6ca49f4994', 'request_id': 'req-3868586d-8fa7-4b2c-ae07-ac5a42321012'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.104127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bcbe9-ec18-405e-8184-c22a8437cf5c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.117070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57219e9b82c443f3a13a0f6ca49f4994', 'request_id': 'req-3868586d-8fa7-4b2c-ae07-ac5a42321012'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.144742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57219e9b82c443f3a13a0f6ca49f4994', 'request_id': 'req-3868586d-8fa7-4b2c-ae07-ac5a42321012'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.165947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] The token cache is being invalidate because project 57219e9b82c443f3a13a0f6ca49f4994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:44.166635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.169083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.172899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3584/7148] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:43 2022] DELETE /identity/v3/projects/57219e9b82c443f3a13a0f6ca49f4994 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:44.179122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.182433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:44.232355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.233286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.233707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.234334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.236142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:44.236579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.239141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.258871 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3565/7149] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:44.264474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.267916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:44.296298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cceed-f9fd-4493-8373-9465fc4afeab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.305819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.307923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.308279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.308862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.309708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.311967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.318391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868586d-8fa7-4b2c-ae07-ac5a42321012 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.324426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.325461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.325954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.327103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] PATH_INFO: `/v3/users/e52e5b62b6ae46be875afc38b9bafc1f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.328640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52e5b62b6ae46be875afc38b9bafc1f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.331881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.354200 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3566/7150] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:44 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:44.358553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.446228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52e5b62b6ae46be875afc38b9bafc1f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.463983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52e5b62b6ae46be875afc38b9bafc1f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.465398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52e5b62b6ae46be875afc38b9bafc1f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.489268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52e5b62b6ae46be875afc38b9bafc1f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.493742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52e5b62b6ae46be875afc38b9bafc1f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:44.521362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:44.568448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3585/7151] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:44 2022] DELETE /identity/v3/users/e52e5b62b6ae46be875afc38b9bafc1f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:44.574978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1545b-c906-475f-9d47-f7238221a8fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.665759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.667759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.668227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.675311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.676406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.679961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.786438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.787291 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3567/7152] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:44 2022] POST /identity/v3/users => generated 293 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:44.789730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:44.810368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2a08-a305-4639-80be-5ed4855bd815 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.815564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.816326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.816706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.817388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.818025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.820240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.839250 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3586/7153] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:37:44.843703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.857799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387dafc-e08b-4ce3-b6a2-635bcb3c18de admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.864570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.865971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.866946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.867425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.868828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.871664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6b43-65ec-4086-90b4-328af1d01b37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.898725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3568/7154] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:44.899720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:44.923819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2461f-256f-48c0-aba9-02f0c1172137 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:44.935296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:44.936103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:44.936391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:44.936694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] PATH_INFO: `/v3/projects/68895008913d4da0b2225141d91c96be/users/7fab54379b9e4cee8ea40a8cec727238/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:44.972480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] RBAC: Authorizing `identity:create_grant(project_id=68895008913d4da0b2225141d91c96be, user_id=7fab54379b9e4cee8ea40a8cec727238, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:44.976082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:44.989639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:45.001586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3587/7155] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:44 2022] PUT /identity/v3/projects/68895008913d4da0b2225141d91c96be/users/7fab54379b9e4cee8ea40a8cec727238/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:45.015917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.018864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.018864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.056011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] MFA Rules not processed for user `7fab54379b9e4cee8ea40a8cec727238`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:45.058319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:45.165246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:45.171441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3569/7156] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:45.260627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26cec7-983d-40fe-a491-1e339a4faced admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:45.266793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:45.267425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.267791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.267990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.268623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:45.271534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:45.317054 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3588/7157] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:45 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:37:45.324053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:45.361830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbb552-74c9-4be5-9b8a-bc5dd6b36f4a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:45.514066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:45.515340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.516407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.517145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.518906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:45.527113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:45.555043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:45.575786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:45.578680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:45.589335 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3570/7158] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:45 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:45.591383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:45.608257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9af1-ae96-46bb-9c25-11a650bce74f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:45.636898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4052aa-dc04-4b2a-97ae-a6ae570c418d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:45.638244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:45.639362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.639867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.640370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] PATH_INFO: `/v3/projects/87f420f3a99f4b24bcb0a450632973f7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.642462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f420f3a99f4b24bcb0a450632973f7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:45.646063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:45.654637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:45.655278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.655545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.655818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.656481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:45.658126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:45.696922 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3571/7159] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:45.699064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:45.727960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59a87a-29cf-4d7a-bc90-4dbc2b7adef9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:45.748413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f420f3a99f4b24bcb0a450632973f7', 'request_id': 'req-6ae31f0f-8abf-4df2-8980-3a153cf6df51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:45.763914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f420f3a99f4b24bcb0a450632973f7', 'request_id': 'req-6ae31f0f-8abf-4df2-8980-3a153cf6df51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:45.790019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f420f3a99f4b24bcb0a450632973f7', 'request_id': 'req-6ae31f0f-8abf-4df2-8980-3a153cf6df51'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:45.810265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] The token cache is being invalidate because project 87f420f3a99f4b24bcb0a450632973f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:45.810632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:45.817784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ae31f0f-8abf-4df2-8980-3a153cf6df51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:45.822873 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3589/7160] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:45 2022] DELETE /identity/v3/projects/87f420f3a99f4b24bcb0a450632973f7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:45.827180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf2fd-77b8-4e9b-84a0-a733bbcd2656 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.827825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf2fd-77b8-4e9b-84a0-a733bbcd2656 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.829354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cf2fd-77b8-4e9b-84a0-a733bbcd2656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.877288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-271cf2fd-77b8-4e9b-84a0-a733bbcd2656 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:45.878837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-271cf2fd-77b8-4e9b-84a0-a733bbcd2656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:45.939792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:45.940503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:45.940784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:45.941084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] PATH_INFO: `/v3/projects/6993951dd238410e97ac9ad1914cba52/users/9de8b5f24bdc4b1ea371478a61edd247/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:45.978002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6993951dd238410e97ac9ad1914cba52, user_id=9de8b5f24bdc4b1ea371478a61edd247, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:45.981314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.002137 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3572/7161] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:45 2022] PUT /identity/v3/projects/6993951dd238410e97ac9ad1914cba52/users/9de8b5f24bdc4b1ea371478a61edd247/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:46.003339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.005208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:46.041740 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3590/7162] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:46.049677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.050348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.050909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.100002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:46.102232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:46.119387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:46.167608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c51d9-2275-403f-92ae-caac09c42554 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.174618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.175970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.176596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.177426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.179173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.181240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.199113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3573/7163] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:37:46.203516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.225674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7442d54-2f69-445c-9e75-fc5b985dd660 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.232348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.233385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.233673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.235010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] PATH_INFO: `/v3/projects/6993951dd238410e97ac9ad1914cba52/users/9de8b5f24bdc4b1ea371478a61edd247/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.237638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6993951dd238410e97ac9ad1914cba52, user_id=9de8b5f24bdc4b1ea371478a61edd247, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.240593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28389f6-106e-4eca-a23d-56fbc9fd5743 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.256353 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3574/7164] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:46 2022] PUT /identity/v3/projects/6993951dd238410e97ac9ad1914cba52/users/9de8b5f24bdc4b1ea371478a61edd247/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:46.275327 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3591/7165] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:46.275583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.275583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.275583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.277580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.297704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8834b5-ea63-4e2f-972a-6680a2858af1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.319941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] MFA Rules not processed for user `9de8b5f24bdc4b1ea371478a61edd247`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:46.322102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:46.388314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:46.454985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.455471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.455749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.456031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.456841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:46.457072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.458831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.469891 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3575/7166] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:46.485846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.488876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:46.493061 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3592/7167] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:46.498522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.513264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492765e7-4826-4d87-a665-24e68fdaecb6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.520879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.523175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.523881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.524513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.525964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.531079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.602545 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3593/7168] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:46 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:46.606984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.664063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcad1f-5ae4-4363-88ee-27467e8c01b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.752181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda6b36-4230-4a37-9b2b-54e155f2836a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.769112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.769385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.769981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.769981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.770666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.776594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.798011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.799054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.799666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.799975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.807288 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3594/7169] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:46 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:46.808764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.823316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c15f9-e756-4c0a-8751-29019daf70f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.830183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.831422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.831891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.832420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.833905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.837099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.845144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:46.855672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3595/7170] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:46.861411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.873188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3288cc4-348c-48e0-810d-4bf55f0bc866 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.880051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.881678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.882372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.882805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.883471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.886519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:46.906575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3596/7171] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:46.911391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:46.926182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286e26d-9825-4947-937d-07486bac2c2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:46.932908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:46.933663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:46.935964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:46.935964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] PATH_INFO: `/v3/projects/4c5928393e6b474e9d40c3e4f86995b3/users/e1f7bf58c5d644dca8847f2df70049dc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:46.971733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5928393e6b474e9d40c3e4f86995b3, user_id=e1f7bf58c5d644dca8847f2df70049dc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:46.974457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa0309-b4c0-4a6f-bded-507cba9a7264 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.016555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:47.019632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.040804 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3597/7172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:46 2022] PUT /identity/v3/projects/4c5928393e6b474e9d40c3e4f86995b3/users/e1f7bf58c5d644dca8847f2df70049dc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:47.052218 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3576/7173] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:37:47.054183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.054680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.055142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.102296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] MFA Rules not processed for user `e1f7bf58c5d644dca8847f2df70049dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:47.104592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:47.231040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3598/7174] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:37:47.238724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.255424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071e26-8a77-4ecc-847a-c1cc2973b10e service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:47.277895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.354985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:47.390967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:47.391796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.392168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.392535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.393491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:47.395628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.402758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936db5e-da42-4dfc-9a00-2ca36c4e61ad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:47.416188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:47.417293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.417978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.418569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] PATH_INFO: `/v3/users/7fab54379b9e4cee8ea40a8cec727238` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.420313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fab54379b9e4cee8ea40a8cec727238)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:47.422882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.454932 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3577/7175] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:47 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:47.459022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.547030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fab54379b9e4cee8ea40a8cec727238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:47.570951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fab54379b9e4cee8ea40a8cec727238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:47.577653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fab54379b9e4cee8ea40a8cec727238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:47.582447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:47.609570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fab54379b9e4cee8ea40a8cec727238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:47.613643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c9ad31b2-664c-44cc-9a4c-f9ec95e08d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fab54379b9e4cee8ea40a8cec727238'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:47.670460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0ba6a-89eb-4b40-a2fe-f0cc9df61f1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:47.671027 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3599/7176] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:47 2022] DELETE /identity/v3/users/7fab54379b9e4cee8ea40a8cec727238 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:47.675217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.675496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.675763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.754265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:47.755815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:47.809430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:47.812498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.812914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.813618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.814992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:47.818988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.848469 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3600/7177] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:47.860733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.864900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:47.870268 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3578/7178] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:47 2022] POST /identity/v3/users => generated 299 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:47.876551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.887482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:47.905583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbed129-b2ad-469a-bc77-6827ec263437 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:47.914366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:47.915348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:47.915348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:47.915348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:47.916105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:47.918327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:47.977054 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3579/7179] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:47.978713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:47.999715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e515b1-dfc1-46df-a52a-116807f8cb4b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:48.005483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff830a-c6b5-4a90-b001-232fdcac151e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:48.020488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:48.022848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:48.023285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:48.023637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] PATH_INFO: `/v3/projects/500a5538cc5748058cca8aa9cbf5c20e/users/006d4cdbb7bb4fd0986832949b9f5a6d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:48.045789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:48.047766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:48.048251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:48.048732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:48.073268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500a5538cc5748058cca8aa9cbf5c20e, user_id=006d4cdbb7bb4fd0986832949b9f5a6d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:48.076728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:48.101600 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3580/7180] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:47 2022] PUT /identity/v3/projects/500a5538cc5748058cca8aa9cbf5c20e/users/006d4cdbb7bb4fd0986832949b9f5a6d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:48.108627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:48.109177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:48.111906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:48.160284 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3601/7181] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:37:48.164077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:48.387811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90aebb-ea97-4fce-8eba-6f05f59ae0e5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:48.400638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:48.402042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:48.402526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:48.403006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:48.411982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:48.426071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a1acb-769e-437e-b388-390fba4d0af7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:48.482984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:48.492395 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3581/7182] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:48.513613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418e2ef-2780-47ef-b427-3925a35be696 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:48.535132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:48.536866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:48.538964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:48.539794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] PATH_INFO: `/v3/projects/500a5538cc5748058cca8aa9cbf5c20e/users/006d4cdbb7bb4fd0986832949b9f5a6d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:48.546557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=500a5538cc5748058cca8aa9cbf5c20e, user_id=006d4cdbb7bb4fd0986832949b9f5a6d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:48.555882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:48.601489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3602/7183] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:48 2022] PUT /identity/v3/projects/500a5538cc5748058cca8aa9cbf5c20e/users/006d4cdbb7bb4fd0986832949b9f5a6d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:48.618008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:48.618426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:48.618603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:48.697278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] MFA Rules not processed for user `006d4cdbb7bb4fd0986832949b9f5a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:48.699573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:48.889120 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3582/7184] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:48.921133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:48.925234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:49.081432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f05912-e419-4b6c-a581-baefafa12e5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:49.089077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:49.090126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:49.090641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:49.091222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:49.096127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:49.156347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:49.282602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:49.284498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:49.304252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:49.306767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:49.329588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3603/7185] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:37:49.444668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52711b5b-ffc6-4532-9e55-df02162ef9f1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:49.456148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:49.456858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:49.457185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:49.457609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] PATH_INFO: `/v3/projects/68895008913d4da0b2225141d91c96be` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:49.460551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68895008913d4da0b2225141d91c96be)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:49.462692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:49.595493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:49.599016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68895008913d4da0b2225141d91c96be', 'request_id': 'req-25805922-9a57-48d5-9186-a417660f8c4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:49.616950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68895008913d4da0b2225141d91c96be', 'request_id': 'req-25805922-9a57-48d5-9186-a417660f8c4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:49.634791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68895008913d4da0b2225141d91c96be', 'request_id': 'req-25805922-9a57-48d5-9186-a417660f8c4b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:49.675923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] The token cache is being invalidate because project 68895008913d4da0b2225141d91c96be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:49.676211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:49.681477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:49.685596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3583/7186] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:49 2022] DELETE /identity/v3/projects/68895008913d4da0b2225141d91c96be => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:49.690188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:49.710516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd562-e8dc-4844-be98-e5806bc6d778 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:49.885093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:49.887458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:49.890702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:49.891243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] PATH_INFO: `/v3/users/9de8b5f24bdc4b1ea371478a61edd247` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:49.895245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de8b5f24bdc4b1ea371478a61edd247)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:49.905540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:50.089802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de8b5f24bdc4b1ea371478a61edd247'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:50.108195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de8b5f24bdc4b1ea371478a61edd247'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:50.108195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de8b5f24bdc4b1ea371478a61edd247'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:50.118040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de8b5f24bdc4b1ea371478a61edd247'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:50.119119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a99e06de-46b4-4583-98de-e16e38ede90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de8b5f24bdc4b1ea371478a61edd247'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:50.163360 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3604/7187] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:49 2022] DELETE /identity/v3/users/9de8b5f24bdc4b1ea371478a61edd247 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:50.937533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:50.939067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:50.966099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25805922-9a57-48d5-9186-a417660f8c4b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:51.110603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:51.112086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.114778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.116333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] PATH_INFO: `/v3/projects/6993951dd238410e97ac9ad1914cba52` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.121009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6993951dd238410e97ac9ad1914cba52)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:51.125814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:51.242763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6993951dd238410e97ac9ad1914cba52', 'request_id': 'req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:51.255032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6993951dd238410e97ac9ad1914cba52', 'request_id': 'req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:51.267150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6993951dd238410e97ac9ad1914cba52', 'request_id': 'req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:51.300331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] The token cache is being invalidate because project 6993951dd238410e97ac9ad1914cba52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:51.300729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:51.301530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d2b2f452-ef54-42f6-9fb7-091f2ad900e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:51.303917 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3584/7188] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:50 2022] DELETE /identity/v3/projects/6993951dd238410e97ac9ad1914cba52 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:51.309022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.309884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.310341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.349214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:51.349764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:51.436920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:51.507145 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3605/7189] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:51.518329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.519983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.520435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.571826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:51.573446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:51.583099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3585/7190] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:51.587855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:51.604592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634dddd-af6a-4baf-b88e-bcd50eb8628d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:51.612766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:51.613340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.613621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.613895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.614760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:51.615896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:51.618462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:51.637065 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3606/7191] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:51.642818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:51.658227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee110a-74bb-4b21-b9fe-e447653ef5db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:51.669761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:51.670604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.671015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.671420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.672239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:51.674833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:51.739497 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3586/7192] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:51 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:51.740890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:51.775934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdc336-e2f7-4db3-8804-81a8c11898f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:51.953759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:51.954601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:51.955077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:51.959336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:51.962512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:51.964933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:52.008938 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3607/7193] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:51 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:52.014040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:52.029589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b910a32-4218-4e56-9f47-297f2005bc6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:52.040489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:52.041368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:52.041779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:52.042166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:52.042973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:52.045429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:52.070378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:52.081442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3587/7194] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:52.083568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fb599-c00b-4482-8a95-34f3b4512811 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:52.090466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:52.091673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:52.092306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:52.092863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:52.093813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:52.096030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280a4f-346e-4e23-8c32-3495bc827f7f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:52.117127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3608/7195] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:52.118459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:52.129299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36166956-8b2e-4aff-aa24-a336192d7d0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:52.135629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:52.136567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:52.137308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:52.137783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] PATH_INFO: `/v3/projects/640b928e52af4aad92ec7c348be06683/users/85757a0ee13048f8bed808f4084ea53e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:52.166694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640b928e52af4aad92ec7c348be06683, user_id=85757a0ee13048f8bed808f4084ea53e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:52.170371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:52.192702 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3588/7196] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:52 2022] PUT /identity/v3/projects/640b928e52af4aad92ec7c348be06683/users/85757a0ee13048f8bed808f4084ea53e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:52.204632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:52.205300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:52.205671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:52.248899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] MFA Rules not processed for user `85757a0ee13048f8bed808f4084ea53e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:52.250684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:52.503574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3609/7197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:52.507444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:52.516896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:52.783565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2303f27-a511-4f3a-a125-950c861b6387 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:52.802512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:52.805215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:52.807840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:52.808401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:52.810353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:52.816537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549b4d-4699-409b-b310-59a8b38c636c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:52.892658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:52.893132 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3589/7198] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:52 2022] POST /identity/v3/projects => generated 387 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:52.917506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baec474-5b0c-49b3-9db7-a2665929a91e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.044842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:53.221935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.224351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.227077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.227580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.231881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.239747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.241200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.241909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.255171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.342974 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3610/7199] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:52 2022] POST /identity/v3/users => generated 300 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:37:53.349246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.359202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] MFA Rules not processed for user `b2c9634f6bb948c7ac325cfedc006292`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:53.362956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:53.404334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f80b-8603-4ba0-93e2-c6f0c81d5412 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.438682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.442235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.442539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.442825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.445916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.451581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.487205 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3611/7200] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:53.492516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.518752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1860fad-6374-4c79-b698-e54c480e5f34 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.533824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.534657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.535175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.536769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] PATH_INFO: `/v3/projects/ad2321cf77884fa6b20f87ad77403804/users/80c4ab5dc1384cce99607d1004fe4016/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.591782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2321cf77884fa6b20f87ad77403804, user_id=80c4ab5dc1384cce99607d1004fe4016, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.594719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.637223 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3590/7201] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:53.638693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.640744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:53.645559 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3612/7202] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:53 2022] PUT /identity/v3/projects/ad2321cf77884fa6b20f87ad77403804/users/80c4ab5dc1384cce99607d1004fe4016/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:37:53.655689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.680793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aee3e-c406-4531-9b4b-f2f28830642f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.832322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647780c-a8b8-4b77-b544-8905565b8253 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.836900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.838196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.839246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.839699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.841436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.844176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.844898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.845431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.845868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.847022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.851253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.853595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.877121 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3613/7203] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:53.884925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.927304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c491a-6358-49b2-8c1d-e732d05c8f9d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:53.932033 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3591/7204] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:53 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:53.937041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:53.938078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.938429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.938659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] PATH_INFO: `/v3/projects/ad2321cf77884fa6b20f87ad77403804/users/80c4ab5dc1384cce99607d1004fe4016/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:53.941361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2321cf77884fa6b20f87ad77403804, user_id=80c4ab5dc1384cce99607d1004fe4016, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:53.944815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a947639-2070-46b5-bb84-2bb0818e3e4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:53.945023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:53.963196 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3614/7205] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:37:53 2022] PUT /identity/v3/projects/ad2321cf77884fa6b20f87ad77403804/users/80c4ab5dc1384cce99607d1004fe4016/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:53.974262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:53.975291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:53.975776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.001190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872d47b-dc70-4d54-84b9-e916a9d910cf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:54.018171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:54.055606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] MFA Rules not processed for user `80c4ab5dc1384cce99607d1004fe4016`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:54.056873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:54.152828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:54.153690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:54.153966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:54.154236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.156217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:54.172813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:54.198847 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3592/7206] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:54.204958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:54.224790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:54.231802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4a19-c776-4501-9672-e4eb7076af8f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:54.249427 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3615/7207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:54.261580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:54.262575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:54.264163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:54.264270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:54.264367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:54.264628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] PATH_INFO: `/v3/system/users/4be8c34c44a6445f803891e465d9845e/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.315396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4be8c34c44a6445f803891e465d9845e, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:54.316845 n-d-858383-14 devstack@keystone.service[81775]: WARNING py.warnings [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 16:37:54.316845 n-d-858383-14 devstack@keystone.service[81775]: warnings.warn(msg) Oct 18 16:37:54.316845 n-d-858383-14 devstack@keystone.service[81775]: Oct 18 16:37:54.319155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de8520-2d95-4616-a037-ec8b3ee8ec35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:54.333387 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3593/7208] 10.222.0.78 () {60 vars in 1378 bytes} [Tue Oct 18 16:37:54 2022] PUT /identity/v3/system/users/4be8c34c44a6445f803891e465d9845e/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:54.344751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:54.345210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:54.345374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.409478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] MFA Rules not processed for user `4be8c34c44a6445f803891e465d9845e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:54.410721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:54.501839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e865b-57de-41a7-8444-fd1d77c1fd2c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:54.514652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:54.515208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:54.515494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:54.515768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.553956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:54.556816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:54.603304 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3616/7209] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:37:54.650300 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3594/7210] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:54 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 16:37:54.654601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:54.906710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:54.923634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b493b-633a-4d5b-8e4f-431ccfa839a8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:54.935644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:54.936845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:54.936845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:54.936845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] PATH_INFO: `/v3/users/85757a0ee13048f8bed808f4084ea53e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:54.938225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85757a0ee13048f8bed808f4084ea53e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:54.940156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:54.969720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d712ba-44b1-406a-99c3-6d1d15f0d8b0 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:55.046413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be8c34c44a6445f803891e465d9845e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:55.047046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:55.047319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:55.047590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] PATH_INFO: `/v3/services` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:55.048205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:55.049620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:55.050411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85757a0ee13048f8bed808f4084ea53e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:55.051122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85757a0ee13048f8bed808f4084ea53e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:55.058686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:55.066057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3617/7211] 10.222.0.78 () {58 vars in 1110 bytes} [Tue Oct 18 16:37:54 2022] GET /identity/v3/services => generated 2191 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:37:55.070925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:55.071656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85757a0ee13048f8bed808f4084ea53e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:55.072584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85757a0ee13048f8bed808f4084ea53e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:55.098360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:55.100017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-945d5d3c-4fc4-4286-bef4-72e832aa9141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85757a0ee13048f8bed808f4084ea53e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:55.145043 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3595/7212] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:54 2022] DELETE /identity/v3/users/85757a0ee13048f8bed808f4084ea53e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:55.151154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:55.151491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:55.152290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:55.195281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:55.196499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:55.435569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c5fdd-a04b-4245-8963-530f64bc4692 None tempest-ImageQuotaTest-2023610539-system-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:55.444941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3596/7213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:37:55.528131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:55.529827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:55.569495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be8c34c44a6445f803891e465d9845e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:55.570199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:55.570409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:55.570669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] PATH_INFO: `/v3/limits` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:55.581703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:55.587352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 18 16:37:55.706579 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: ERROR keystone.server.flask.application Oct 18 16:37:55.708719 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3618/7214] 10.222.0.78 () {60 vars in 1126 bytes} [Tue Oct 18 16:37:55 2022] POST /identity/v3/limits => generated 124 bytes in 639 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 18 16:37:55.717879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:55.719034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a1bb-26fd-4901-aa5d-9100c3325818 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:55.720583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:55.724010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:55.725423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:55.725767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:55.726068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:55.741717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:55.743889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:55.765184 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3597/7215] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:37:55.859345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:55.969580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1d9d9-c517-407b-ba7c-8a8d2242f296 None tempest-ImageQuotaTest-2023610539-system-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:56.070899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be8c34c44a6445f803891e465d9845e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:56.072167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:56.072638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:56.073278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:56.074430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:56.076279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:56.094123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:56.095038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3619/7216] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:37:55 2022] GET /identity/v3/registered_limits => generated 129 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:56.182583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:56.240766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfaf04-eee6-436f-bf59-f14e9fdeb070 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:56.290428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be8c34c44a6445f803891e465d9845e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:56.291942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:56.292439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:56.292936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:56.294103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:56.295520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:56.305465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3598/7217] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Oct 18 16:37:56 2022] GET /identity/v3/registered_limits => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:57.247992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:57.250603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:57.273078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f65353-5ffb-4a22-9c83-26a0a354127e None tempest-ImageQuotaTest-2023610539-system-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:57.278807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:57.281411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:57.281980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:57.282575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] PATH_INFO: `/v3/projects/640b928e52af4aad92ec7c348be06683` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:57.285102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640b928e52af4aad92ec7c348be06683)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:57.305859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:57.440864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640b928e52af4aad92ec7c348be06683', 'request_id': 'req-4b56391d-8d60-43f4-8b43-6d81df4780f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.449048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640b928e52af4aad92ec7c348be06683', 'request_id': 'req-4b56391d-8d60-43f4-8b43-6d81df4780f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.464312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640b928e52af4aad92ec7c348be06683', 'request_id': 'req-4b56391d-8d60-43f4-8b43-6d81df4780f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.482197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] The token cache is being invalidate because project 640b928e52af4aad92ec7c348be06683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:57.485429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.491399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.493216 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3620/7218] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:57 2022] DELETE /identity/v3/projects/640b928e52af4aad92ec7c348be06683 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:57.497807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:57.499706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:57.621262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854a12c-978f-4122-bd6f-be089a0b58e9 None tempest-ImageQuotaTest-2023610539-system-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:57.631253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:57.632770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:57.635055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:57.636740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] PATH_INFO: `/v3/users/80c4ab5dc1384cce99607d1004fe4016` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:57.650351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c4ab5dc1384cce99607d1004fe4016)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:57.654183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:57.750251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c4ab5dc1384cce99607d1004fe4016'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.750952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c4ab5dc1384cce99607d1004fe4016'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.764420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c4ab5dc1384cce99607d1004fe4016'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.765745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c4ab5dc1384cce99607d1004fe4016'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.791961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4a920f0b-626a-4604-934f-e7307202bc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c4ab5dc1384cce99607d1004fe4016'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:57.816855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:57.834894 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3599/7219] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:37:57 2022] DELETE /identity/v3/users/80c4ab5dc1384cce99607d1004fe4016 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:59.168348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:59.198010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56391d-8d60-43f4-8b43-6d81df4780f0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:59.269053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:37:59.370889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:59.371869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:59.372186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:59.372455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] PATH_INFO: `/v3/projects/ad2321cf77884fa6b20f87ad77403804` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:59.374449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2321cf77884fa6b20f87ad77403804)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:59.376452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:59.454635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2321cf77884fa6b20f87ad77403804', 'request_id': 'req-a815829d-253a-4582-869a-0e5889e5f4bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:59.469439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2321cf77884fa6b20f87ad77403804', 'request_id': 'req-a815829d-253a-4582-869a-0e5889e5f4bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:59.477865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2321cf77884fa6b20f87ad77403804', 'request_id': 'req-a815829d-253a-4582-869a-0e5889e5f4bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:59.495743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] The token cache is being invalidate because project ad2321cf77884fa6b20f87ad77403804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:37:59.496321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:59.497620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a815829d-253a-4582-869a-0e5889e5f4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:37:59.503169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3621/7220] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:37:59 2022] DELETE /identity/v3/projects/ad2321cf77884fa6b20f87ad77403804 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:37:59.504595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:59.505122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:59.505377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:59.534087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:59.535653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:59.700254 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3600/7221] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:59.715730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:59.718994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:59.719346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:59.755182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:37:59.756781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:59.786569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:59.788807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:37:59.792883 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3622/7222] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:37:59.794556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:59.806362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04044c6-75e5-454a-98f2-8de2e44bc510 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:59.819118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:59.819929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:59.820276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:59.820612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:59.821457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:37:59.821822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:59.823918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:59.869982 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3623/7223] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:37:59.871062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:59.886400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19028f6d-075f-4c99-8239-511717958552 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:37:59.892148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:37:59.893384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:37:59.893384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:37:59.893821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:37:59.894534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:37:59.897725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:37:59.953161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3624/7224] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:37:59 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:37:59.957763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:37:59.999628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78864af-5807-48f6-964b-126b2e6f28d7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.139162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca618-eca3-4f31-b3a9-25deb711a633 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.155796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.157097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.157097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.157097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.157766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.159704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:00.192352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.197819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.198256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.198678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.204921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:00.213080 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3625/7225] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:37:59 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:00.216142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:00.244635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e1c72-fd02-4589-a1c9-c3e79eec325e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.257886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.258983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.260315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.260859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.262240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.267313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:00.270986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:00.298098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3626/7226] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:00.301015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:00.332868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4965e8-8ce0-4e08-ae91-246fa5e8d4ff admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.354408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.355599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.356887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.357320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.360740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.365129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:00.393969 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3627/7227] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:00.398865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:00.418866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.421557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629e702-7724-4ca6-afa6-d0ed48b25180 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:00.429356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c758f42-0370-4b8c-97a2-34a29e2cd34c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.436174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3601/7228] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:00.442843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.443983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.444507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.444895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] PATH_INFO: `/v3/projects/e383ade59038492584c05cf8d5581bf4/users/814ca67530eb469badb807f34442cb31/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.482134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e383ade59038492584c05cf8d5581bf4, user_id=814ca67530eb469badb807f34442cb31, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.487351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:00.524194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3628/7229] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:00 2022] PUT /identity/v3/projects/e383ade59038492584c05cf8d5581bf4/users/814ca67530eb469badb807f34442cb31/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:00.538886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.538886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.539824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.558299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:00.627234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] MFA Rules not processed for user `814ca67530eb469badb807f34442cb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:00.628590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:00.813504 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3602/7230] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:00.822836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:00.975586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f28d-2882-4995-9fb8-1fb419086f7d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:00.992129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:00.992391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:00.992679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:00.992950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:00.993669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:00.995951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:01.099050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3629/7231] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:00 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:01.104538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:01.129418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b8c8-5f3b-4dff-8821-536dac8990d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:01.288607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:01.290322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:01.292331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:01.292833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:01.293706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:01.298182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:01.354790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:01.355448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3603/7232] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:01 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:01.370335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee432-b973-4c4b-9d4a-66248832a561 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:01.399964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:01.401054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:01.401570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:01.402194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:01.403038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:01.405195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:01.422352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3630/7233] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:01.428475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:01.442384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b936e-f25a-402b-b40a-f5a5e8e88269 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:01.465293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:01.465972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:01.466254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:01.467156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:01.468053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:01.472568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca0411-51dc-4736-abb1-05d93fdbad7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:01.490780 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3604/7234] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:01.491313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:01.503818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c1ecd-bfe0-4fdd-ad67-b164c9539676 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:01.515487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:01.517039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:01.517511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:01.517964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] PATH_INFO: `/v3/projects/7dd6d03256894f67a217f9f68b84d328/users/c8e43f300ee14a43a2018511577dea39/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:01.563903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd6d03256894f67a217f9f68b84d328, user_id=c8e43f300ee14a43a2018511577dea39, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:01.569214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:01.602463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3631/7235] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:01 2022] PUT /identity/v3/projects/7dd6d03256894f67a217f9f68b84d328/users/c8e43f300ee14a43a2018511577dea39/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:01.616558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:01.617161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:01.617358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:01.708257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] MFA Rules not processed for user `c8e43f300ee14a43a2018511577dea39`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:01.710547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:01.878882 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3605/7236] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:01.885455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.051423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27521112-2fec-4516-bf75-d4b10fc5cf0a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.063870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.067265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.067552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.067829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.074057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.079056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.123764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:02.154169 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3632/7237] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:02.156150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.172600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:02.196156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba3ff6-2e95-4471-817b-e0604b10da1f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.348984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.350059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.350629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.351734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.353452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.364607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.446217 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3606/7238] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:02 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:02.453600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.468605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0994883-062a-4bf4-b5b1-57bfdb0cb9c0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.476430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.477539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.478190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.478637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.479544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.481728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.498068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3633/7239] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:02.502044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.515497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f380-4eda-4992-838c-9d11fa32b8f8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.523640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.524347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.524609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.524881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] PATH_INFO: `/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8/users/04a1868f92a84348bfcd30e19e28ce33/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.548012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5baf609d9644f24ad7dd92f0ab969d8, user_id=04a1868f92a84348bfcd30e19e28ce33, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.550807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.573631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3607/7240] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:02 2022] PUT /identity/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8/users/04a1868f92a84348bfcd30e19e28ce33/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:02.574310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.591258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aab6fc-1650-4d03-a004-6899ea21a52e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.758144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.759831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.760629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.763652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.765521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.773799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32fe03-581e-41d3-8ae0-a7e8f67acf4b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.826510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:02.828690 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3634/7241] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:38:02.844191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e272c56-ccac-4b2f-8c20-c7a4562715cc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:02.857137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:02.857824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.858299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.859006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] PATH_INFO: `/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8/users/04a1868f92a84348bfcd30e19e28ce33/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.879048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5baf609d9644f24ad7dd92f0ab969d8, user_id=04a1868f92a84348bfcd30e19e28ce33, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:02.882783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:02.915279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3608/7242] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:02 2022] PUT /identity/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8/users/04a1868f92a84348bfcd30e19e28ce33/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:02.930474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:02.931013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:02.931450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:02.985478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] MFA Rules not processed for user `04a1868f92a84348bfcd30e19e28ce33`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:02.988222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:03.113648 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3635/7243] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:03.124001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:03.126205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:03.222492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80079c-32c6-43f7-95a8-754f38ce2bb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:03.228558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:03.229607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:03.230141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:03.230655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:03.325837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:03.328475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:03.343688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3609/7244] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:06.622735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:06.639715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51329f70-f728-4c20-a4fb-a62301e5aa84 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:06.645774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:06.647072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:06.647609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:06.648105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:06.768807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:06.772234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:06.803513 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3636/7245] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:08.069999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:08.086351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6366760-c229-47c1-847e-f453f0ec237b service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:08.112508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:08.113728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:08.114312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:08.115100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:08.139825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:08.141480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:08.146679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:08.183718 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3610/7246] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:09.517191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:09.518891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:09.540210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:09.727282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a22ef-2497-4be5-b028-0a17bb70c2c0 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:09.745863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:09.746970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:09.747489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:09.748271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] PATH_INFO: `/v3/users/b2c9634f6bb948c7ac325cfedc006292` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:09.750363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c9634f6bb948c7ac325cfedc006292)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:09.754103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:09.913246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c9634f6bb948c7ac325cfedc006292'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:09.933432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c9634f6bb948c7ac325cfedc006292'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:09.933432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c9634f6bb948c7ac325cfedc006292'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:09.950008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c9634f6bb948c7ac325cfedc006292'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:09.953926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c9634f6bb948c7ac325cfedc006292'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:10.024783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3637/7247] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:09 2022] DELETE /identity/v3/users/b2c9634f6bb948c7ac325cfedc006292 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:12.410953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:12.439735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9d810-32ed-4ae1-849e-e080057fe7ff service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:12.626950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:12.627632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:12.627976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:12.628275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] PATH_INFO: `/v3/projects/6f48249ad675426b831ae7c3cc2a6a02` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:12.637324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f48249ad675426b831ae7c3cc2a6a02)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:12.639432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:12.764542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f48249ad675426b831ae7c3cc2a6a02', 'request_id': 'req-b804f2b7-3adb-4aa4-8935-ffa393b2d588'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:12.809878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f48249ad675426b831ae7c3cc2a6a02', 'request_id': 'req-b804f2b7-3adb-4aa4-8935-ffa393b2d588'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:12.845993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f48249ad675426b831ae7c3cc2a6a02', 'request_id': 'req-b804f2b7-3adb-4aa4-8935-ffa393b2d588'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:12.895193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] The token cache is being invalidate because project 6f48249ad675426b831ae7c3cc2a6a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:12.895500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:12.900315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:12.905788 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3611/7248] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:12 2022] DELETE /identity/v3/projects/6f48249ad675426b831ae7c3cc2a6a02 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:12.909995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:12.915866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:13.000235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bcd73-0594-4d30-957d-dd95fa417cfb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:13.197938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:13.198855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:13.199293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:13.199862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] PATH_INFO: `/v3/users/4be8c34c44a6445f803891e465d9845e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:13.206556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be8c34c44a6445f803891e465d9845e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:13.209617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:13.296690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:13.370628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be8c34c44a6445f803891e465d9845e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:13.380486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be8c34c44a6445f803891e465d9845e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:13.381265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be8c34c44a6445f803891e465d9845e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:13.398896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be8c34c44a6445f803891e465d9845e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:13.399671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9136a26b-2eb4-44d1-8682-eeeddebd7c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be8c34c44a6445f803891e465d9845e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:13.441124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3638/7249] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:12 2022] DELETE /identity/v3/users/4be8c34c44a6445f803891e465d9845e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:18.838519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:18.840106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:18.873889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f2b7-3adb-4aa4-8935-ffa393b2d588 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:19.026851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:19.027587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:19.027787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:19.028062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] PATH_INFO: `/v3/users/e1f7bf58c5d644dca8847f2df70049dc` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:19.029506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f7bf58c5d644dca8847f2df70049dc)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:19.031584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:19.114192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:19.143992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f7bf58c5d644dca8847f2df70049dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:19.144615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f7bf58c5d644dca8847f2df70049dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:19.184306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f7bf58c5d644dca8847f2df70049dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:19.185300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f7bf58c5d644dca8847f2df70049dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:19.206651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f7bf58c5d644dca8847f2df70049dc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:19.252610 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3612/7250] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:18 2022] DELETE /identity/v3/users/e1f7bf58c5d644dca8847f2df70049dc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:19.256974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:19.257499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:19.257583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:19.301309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:19.303364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:19.448285 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3639/7251] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:19.465929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:19.468114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:19.652063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aeeba-adfc-4e61-98c2-02056d198dbd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:19.670400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:19.670832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:19.671215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:19.671553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:19.710839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:19.712363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:19.748712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3613/7252] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:20.433664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:20.436275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:20.470707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11a54-f1ac-4c20-a0e0-b209133a1740 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:20.480375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:20.481494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:20.482413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:20.483266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] PATH_INFO: `/v3/projects/4c5928393e6b474e9d40c3e4f86995b3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:20.485471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5928393e6b474e9d40c3e4f86995b3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:20.488009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:20.568456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5928393e6b474e9d40c3e4f86995b3', 'request_id': 'req-8faab220-0d51-472e-b9f4-8b2bd3304217'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.580784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5928393e6b474e9d40c3e4f86995b3', 'request_id': 'req-8faab220-0d51-472e-b9f4-8b2bd3304217'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.591643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5928393e6b474e9d40c3e4f86995b3', 'request_id': 'req-8faab220-0d51-472e-b9f4-8b2bd3304217'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.610152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] The token cache is being invalidate because project 4c5928393e6b474e9d40c3e4f86995b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:20.610630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.611467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.616879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3640/7253] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:20 2022] DELETE /identity/v3/projects/4c5928393e6b474e9d40c3e4f86995b3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:20.618152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:20.634713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cb-44c5-4001-94d5-09acb0bab59f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:20.764237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:20.764913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:20.765223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:20.765972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] PATH_INFO: `/v3/users/006d4cdbb7bb4fd0986832949b9f5a6d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:20.767309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006d4cdbb7bb4fd0986832949b9f5a6d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:20.769842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:20.891755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006d4cdbb7bb4fd0986832949b9f5a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.892458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006d4cdbb7bb4fd0986832949b9f5a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.903809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:20.909472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006d4cdbb7bb4fd0986832949b9f5a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.912457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006d4cdbb7bb4fd0986832949b9f5a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.952000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30a04bc9-b3b8-437d-841b-3e8864e7db32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006d4cdbb7bb4fd0986832949b9f5a6d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:20.983466 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3614/7254] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:20 2022] DELETE /identity/v3/users/006d4cdbb7bb4fd0986832949b9f5a6d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:21.459498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:21.461323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:21.499407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faab220-0d51-472e-b9f4-8b2bd3304217 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:21.521035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:21.665110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:21.672380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:21.673705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:21.674399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] PATH_INFO: `/v3/projects/500a5538cc5748058cca8aa9cbf5c20e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:21.676355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] RBAC: Authorizing `identity:delete_project(project_id=500a5538cc5748058cca8aa9cbf5c20e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:21.679566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:21.776740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500a5538cc5748058cca8aa9cbf5c20e', 'request_id': 'req-2f459f9d-79b3-4ea0-8ba2-20290ea808df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:21.783869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500a5538cc5748058cca8aa9cbf5c20e', 'request_id': 'req-2f459f9d-79b3-4ea0-8ba2-20290ea808df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:21.797977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500a5538cc5748058cca8aa9cbf5c20e', 'request_id': 'req-2f459f9d-79b3-4ea0-8ba2-20290ea808df'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:21.833480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] The token cache is being invalidate because project 500a5538cc5748058cca8aa9cbf5c20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:21.833480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:21.835559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2f459f9d-79b3-4ea0-8ba2-20290ea808df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:21.838486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3641/7255] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:21 2022] DELETE /identity/v3/projects/500a5538cc5748058cca8aa9cbf5c20e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:21.844089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:21.844663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:21.844663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:21.879333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:21.882745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:21.977032 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3615/7256] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:21.984908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:21.985562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:21.985973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.019787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:22.022162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:22.034193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3642/7257] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:22.039088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.054555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af269d-2b55-4405-a8f8-6329c5ebab5f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.061373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.062056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.062337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.062657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.063370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:22.063677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.065664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.081180 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3616/7258] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:38:22.087127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.101437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8844-a670-4953-b407-70b0dfc68365 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.110158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.111278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.111696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.112094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.113111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.116015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.170081 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3643/7259] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:22 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:38:22.175429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.192481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9285e1f-5c32-44c5-aa34-b9d002d8b098 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.284366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.285377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.285974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.286567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.287453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.289886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.325755 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3617/7260] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:22 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:22.330445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.342247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa317622-aa14-4faa-9021-2abebac2f492 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.347984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.349523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.350076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.350582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.351411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.353540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.366123 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3644/7261] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:22.369609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.382181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b3be7-86d7-4804-b4b4-44c8faaae33b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.387949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.388913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.389395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.389875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.390623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.392712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa52a8c-81f2-439f-8e8e-72b1696b422a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.406459 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3618/7262] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:38:22.410630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.431749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312314a-8182-4176-a725-1f504f67f78d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.439397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.440927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.441309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.441649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] PATH_INFO: `/v3/projects/b8de50150e474b9a8a963a88f437cf44/users/90589d116cc4433b946cf211f4ffa187/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.477804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8de50150e474b9a8a963a88f437cf44, user_id=90589d116cc4433b946cf211f4ffa187, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.481085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:22.519427 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3645/7263] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:22 2022] PUT /identity/v3/projects/b8de50150e474b9a8a963a88f437cf44/users/90589d116cc4433b946cf211f4ffa187/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:22.521205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.521842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.522409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.584535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] MFA Rules not processed for user `90589d116cc4433b946cf211f4ffa187`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:22.586282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:22.648772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:22.793834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3619/7264] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:38:22.804706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:22.807478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:22.914828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:22.938420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c956c7-b03b-49e1-835a-168a99c93bf0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:22.951618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:22.952264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:22.952617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:22.952896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:22.992467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:22.994198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:23.009797 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3646/7265] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:23.039967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:23.235201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4a94a-b9c0-4eea-b5df-541c10d67b2c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:23.242422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:23.243260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:23.247852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:23.248294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] PATH_INFO: `/v3/users/90589d116cc4433b946cf211f4ffa187` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:23.251383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90589d116cc4433b946cf211f4ffa187)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:23.258819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:23.343561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:23.346233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:23.395338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9e3d-76a6-42e8-b65b-84d5b5650334 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:23.408498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:23.409186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:23.409461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:23.409731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] PATH_INFO: `/v3/users/814ca67530eb469badb807f34442cb31` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:23.413404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814ca67530eb469badb807f34442cb31)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:23.421524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:23.425918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90589d116cc4433b946cf211f4ffa187'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.428908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90589d116cc4433b946cf211f4ffa187'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.451671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90589d116cc4433b946cf211f4ffa187'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.453207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90589d116cc4433b946cf211f4ffa187'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.474320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-59d1c545-9ebe-4747-bfef-b496931853f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90589d116cc4433b946cf211f4ffa187'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.525016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3620/7266] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:23 2022] DELETE /identity/v3/users/90589d116cc4433b946cf211f4ffa187 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:23.529269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:23.529668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:23.530711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:23.565575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:23.568213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:23.577319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814ca67530eb469badb807f34442cb31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.590929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814ca67530eb469badb807f34442cb31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.592859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814ca67530eb469badb807f34442cb31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.612921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814ca67530eb469badb807f34442cb31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.614541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-96ab7fb2-e390-4a86-8285-716f9265cc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814ca67530eb469badb807f34442cb31'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:23.646533 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3647/7267] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:23 2022] DELETE /identity/v3/users/814ca67530eb469badb807f34442cb31 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:23.652851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:23.653309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:23.653681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:23.681451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:23.700105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:23.703869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:23.733368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3621/7268] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:23.766835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:23.768286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:23.857784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3648/7269] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:23.877071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e5914-f29b-46dc-9df2-8b2f4912daab None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:23.926631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:23.998531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:23.999320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:24.000846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:24.001174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:24.015340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:24.016975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:24.032675 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3622/7270] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:38:24.053566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fb5d2-e40b-4839-bbd7-0c4f4137ece9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:24.057413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:24.057996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:24.058278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:24.058552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:24.069876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:24.071511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:24.077378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:24.084094 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3649/7271] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:38:25.778650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:25.781993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:25.806757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383edd6-2024-4bc8-ad02-0b0215622df4 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:25.820950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:25.821802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:25.822146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:25.822423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] PATH_INFO: `/v3/projects/b8de50150e474b9a8a963a88f437cf44` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:25.823928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8de50150e474b9a8a963a88f437cf44)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:25.837772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:25.892983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:25.894718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:25.915649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde4a9d-ba9b-4ac6-9e6a-70b184b77c44 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:25.948254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:25.948940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:25.949234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:25.949732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] PATH_INFO: `/v3/projects/e383ade59038492584c05cf8d5581bf4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:25.951473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e383ade59038492584c05cf8d5581bf4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:25.953919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.034514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8de50150e474b9a8a963a88f437cf44', 'request_id': 'req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.036733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e383ade59038492584c05cf8d5581bf4', 'request_id': 'req-72472110-55bd-4de6-b642-309c9487216e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.062031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e383ade59038492584c05cf8d5581bf4', 'request_id': 'req-72472110-55bd-4de6-b642-309c9487216e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.066845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8de50150e474b9a8a963a88f437cf44', 'request_id': 'req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.079793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e383ade59038492584c05cf8d5581bf4', 'request_id': 'req-72472110-55bd-4de6-b642-309c9487216e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.080695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8de50150e474b9a8a963a88f437cf44', 'request_id': 'req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.102055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] The token cache is being invalidate because project b8de50150e474b9a8a963a88f437cf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:26.102247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] The token cache is being invalidate because project e383ade59038492584c05cf8d5581bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:26.102759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.103115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.103938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.105157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d81ca2f5-aaad-45a5-b4ce-b70982221ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.107723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3650/7272] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:25 2022] DELETE /identity/v3/projects/e383ade59038492584c05cf8d5581bf4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:26.110982 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3623/7273] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:25 2022] DELETE /identity/v3/projects/b8de50150e474b9a8a963a88f437cf44 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:26.118597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.118597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:26.123447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213ae7-9502-422f-a0fe-3bc4b0dd3474 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.123995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213ae7-9502-422f-a0fe-3bc4b0dd3474 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.124482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213ae7-9502-422f-a0fe-3bc4b0dd3474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.167775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d213ae7-9502-422f-a0fe-3bc4b0dd3474 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:26.169595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d213ae7-9502-422f-a0fe-3bc4b0dd3474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:26.205704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:26.260192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72472110-55bd-4de6-b642-309c9487216e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.264776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.265638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.266006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.266357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] PATH_INFO: `/v3/users/c8e43f300ee14a43a2018511577dea39` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.269840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e43f300ee14a43a2018511577dea39)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.272492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.320257 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3624/7274] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:26.322154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.322703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.323245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.354779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e43f300ee14a43a2018511577dea39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.363534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:26.365712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:26.367635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e43f300ee14a43a2018511577dea39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.368743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e43f300ee14a43a2018511577dea39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.380314 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3625/7275] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:26.382046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e43f300ee14a43a2018511577dea39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.385856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e43f300ee14a43a2018511577dea39'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:26.386693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.401058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10b3c1-ab33-4024-b0ba-9bc9b724f40a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.409727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.410837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.411286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.411773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.412877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:26.413369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.415451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.436575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3651/7276] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:26 2022] DELETE /identity/v3/users/c8e43f300ee14a43a2018511577dea39 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:26.441705 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3626/7277] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:38:26.443728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.456928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:26.464828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:26.577750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99047cc8-968c-4d2c-921e-b1ad3aef3ebe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.584432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.585101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.585425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.585697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.587064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.593235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.641314 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3652/7278] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:26 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:26.642461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.660164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aba83-5c06-47e5-b490-049717e8506d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.821249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.821810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.822092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.822368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.824785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.828457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.881603 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3627/7279] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:26 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:26.883023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.900775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78aef5-88c5-4dd3-9bef-a8daf4464379 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.918155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.918376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.918638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.918911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.921789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.925273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:26.958625 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3653/7280] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:26.960265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:26.974493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb976-e2ad-46ed-b3ff-51f4a93cfa50 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:26.986602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:26.987232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:26.987514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:26.987788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:26.990642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:26.992337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09931536-9fb8-4d82-b1c3-944368c29554 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:27.024245 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3628/7281] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:27.026309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:27.043391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f1d96-8bd9-4a52-8f0b-3a058c2984ee admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:27.065089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:27.065875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.066055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.066736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] PATH_INFO: `/v3/projects/edf11723d3de4a8c815641c26be1f168/users/1649d5f7da154c17aa2f592136b18ad2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.115575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf11723d3de4a8c815641c26be1f168, user_id=1649d5f7da154c17aa2f592136b18ad2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:27.122115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:27.168091 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3654/7282] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:27 2022] PUT /identity/v3/projects/edf11723d3de4a8c815641c26be1f168/users/1649d5f7da154c17aa2f592136b18ad2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:27.168481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.168481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.168481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.169805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:27.172844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.247845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] MFA Rules not processed for user `1649d5f7da154c17aa2f592136b18ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:27.249207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.319276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da854-07a9-4ecc-aa30-ffe799dcbc5c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:27.330095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:27.332269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.334097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.334491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] PATH_INFO: `/v3/projects/7dd6d03256894f67a217f9f68b84d328` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.337534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd6d03256894f67a217f9f68b84d328)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:27.341286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:27.430934 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3629/7283] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:27.445938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:27.448270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.476357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd6d03256894f67a217f9f68b84d328', 'request_id': 'req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.491958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd6d03256894f67a217f9f68b84d328', 'request_id': 'req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.494917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:27.498548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:27.508435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd6d03256894f67a217f9f68b84d328', 'request_id': 'req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.535219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] The token cache is being invalidate because project 7dd6d03256894f67a217f9f68b84d328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:27.538146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.539997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.542702 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3655/7284] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:27 2022] DELETE /identity/v3/projects/7dd6d03256894f67a217f9f68b84d328 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:27.548000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:27.551642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.592564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00b9ef-1a0d-4e7f-bfe2-1e39c23728ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:27.703957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:27.704956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.705578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.705919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.711728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.715422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1ab80-407f-46c3-a8ad-680e0ed0dca2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:27.731230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:27.731900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.732181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.732455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] PATH_INFO: `/v3/users/04a1868f92a84348bfcd30e19e28ce33` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.734705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a1868f92a84348bfcd30e19e28ce33)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:27.736664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:27.837809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a1868f92a84348bfcd30e19e28ce33'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.851351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a1868f92a84348bfcd30e19e28ce33'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.852333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:27.853422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a1868f92a84348bfcd30e19e28ce33'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.853839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:27.869392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3630/7285] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:27.869945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a1868f92a84348bfcd30e19e28ce33'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.870861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8063f0b1-7b06-4da7-9696-1ed917b7f367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a1868f92a84348bfcd30e19e28ce33'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:27.900346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:27.902324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:27.932911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ebaef-4b71-444d-b1ca-14e3cfe16e62 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:27.935893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3656/7286] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:27 2022] DELETE /identity/v3/users/04a1868f92a84348bfcd30e19e28ce33 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:27.943965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:27.944812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:27.945122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:27.945387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] PATH_INFO: `/v3/users/1649d5f7da154c17aa2f592136b18ad2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:27.946596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1649d5f7da154c17aa2f592136b18ad2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:27.948543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:28.068515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1649d5f7da154c17aa2f592136b18ad2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.069457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1649d5f7da154c17aa2f592136b18ad2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.087691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1649d5f7da154c17aa2f592136b18ad2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.091104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1649d5f7da154c17aa2f592136b18ad2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.120903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1649d5f7da154c17aa2f592136b18ad2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.147313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:28.159587 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3631/7287] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:27 2022] DELETE /identity/v3/users/1649d5f7da154c17aa2f592136b18ad2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:28.165117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:28.165499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:28.165913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:28.191634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:28.193766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:28.284301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3657/7288] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:28.326030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:28.328299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:28.418284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35be4d3-9c28-485d-af2c-763e96b5506a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:28.425759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:28.427868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:28.428482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:28.429305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:28.445082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:28.447464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dd7a4-a1f1-4fb9-afb2-5b230502645b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:28.469991 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3632/7289] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:28.634452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:28.636096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:28.645403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:28.665288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3b02f-52d3-435f-ac44-a484ae21ad74 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:28.720760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:28.724353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:28.725092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:28.733598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] PATH_INFO: `/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:28.739139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5baf609d9644f24ad7dd92f0ab969d8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:28.742537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:28.890399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5baf609d9644f24ad7dd92f0ab969d8', 'request_id': 'req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.915095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5baf609d9644f24ad7dd92f0ab969d8', 'request_id': 'req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.928308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5baf609d9644f24ad7dd92f0ab969d8', 'request_id': 'req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.952081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] The token cache is being invalidate because project e5baf609d9644f24ad7dd92f0ab969d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:28.952712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.956966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7f38149f-4da7-4f0b-b8c0-ed4fedfa7d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:28.961987 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3658/7290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:28 2022] DELETE /identity/v3/projects/e5baf609d9644f24ad7dd92f0ab969d8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:28.967067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:28.967738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:28.967738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.022585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:29.028873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:29.265181 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3633/7291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:29.274980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.275275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.275552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.309983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:29.311983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:29.347237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.350998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3659/7292] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:29.363402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4e853-162f-4f00-814a-c37eec6d2d3e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.373849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.374696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.386835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.387481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.388217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:29.389285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.398326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.427087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3634/7293] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:38:29.431431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.446300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82684-9277-4b81-ba43-ba379c11e9ed None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.453234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.454206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.454680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.455321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.456385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.459384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.510593 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3660/7294] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:29 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:29.511919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.527991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d04cb-e5e2-47e9-9195-8ca39256d2c8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.617465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.618196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.618593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.618980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.620104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.622249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.663128 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3635/7295] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:29 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:29.666992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.679929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f101a-21d8-43c7-aa98-7394764313cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.686835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.687821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.688340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.689025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.690125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.692795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.711112 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3661/7296] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:29.713590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.744984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f88d79-09c5-468e-927c-85b7194117c7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.757215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.757874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.758217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.758553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.759376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.761683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37e0c1-4113-48e8-b8c6-bc49540809d6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.786968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3636/7297] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:29.788574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:29.804711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f56cd1-74f0-4fbf-827f-bf3c80c68a41 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:29.822026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:29.822501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.822781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.823057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] PATH_INFO: `/v3/projects/703c2532c1fe400690f74285bbe9716e/users/915977a496684229bc212e6bbfa591c8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.849337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=703c2532c1fe400690f74285bbe9716e, user_id=915977a496684229bc212e6bbfa591c8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:29.852552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:29.882903 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3662/7298] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:29 2022] PUT /identity/v3/projects/703c2532c1fe400690f74285bbe9716e/users/915977a496684229bc212e6bbfa591c8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:29.887006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:29.887302 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:29.887577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:29.908496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:29.930033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] MFA Rules not processed for user `915977a496684229bc212e6bbfa591c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:29.931349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:30.066515 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3637/7299] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:30.084006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:30.093521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:30.191746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:30.198715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:30.226574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5cc81-f76b-47b5-b950-9a515dcb080c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:30.231554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:30.232592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:30.233131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:30.233614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:30.248350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:30.250516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d816be7-c3a6-4cad-8829-409910ed94bc service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:30.266034 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3663/7300] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:30.381763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23ab09-a36c-45f3-91af-fc2406da3ce7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:30.411507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:30.412312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:30.412699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:30.413087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] PATH_INFO: `/v3/projects/edf11723d3de4a8c815641c26be1f168` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:30.415033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf11723d3de4a8c815641c26be1f168)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:30.428187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:30.533984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf11723d3de4a8c815641c26be1f168', 'request_id': 'req-f9be2903-a379-4d99-b831-8bdc64d2547e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:30.558013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf11723d3de4a8c815641c26be1f168', 'request_id': 'req-f9be2903-a379-4d99-b831-8bdc64d2547e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:30.585960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf11723d3de4a8c815641c26be1f168', 'request_id': 'req-f9be2903-a379-4d99-b831-8bdc64d2547e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:30.618601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] The token cache is being invalidate because project edf11723d3de4a8c815641c26be1f168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:30.619047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:30.619833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f9be2903-a379-4d99-b831-8bdc64d2547e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:30.626227 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3638/7301] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:30 2022] DELETE /identity/v3/projects/edf11723d3de4a8c815641c26be1f168 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:30.627595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b36af-8289-48c0-a425-400e22b711ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:30.627878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b36af-8289-48c0-a425-400e22b711ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:30.628139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b36af-8289-48c0-a425-400e22b711ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:30.686503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-273b36af-8289-48c0-a425-400e22b711ba None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:30.687743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-273b36af-8289-48c0-a425-400e22b711ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:30.735753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:30.834455 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3664/7302] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:38:30.846765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:30.847985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:30.848616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:30.893849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:30.905275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:30.939465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3639/7303] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:30.944938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b36af-8289-48c0-a425-400e22b711ba None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:30.968794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b36af-8289-48c0-a425-400e22b711ba None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:30.987168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:30.990825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:30.991305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:30.992486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:30.993310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:30.994808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:30.998892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.039360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:31.040016 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3665/7304] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:38:31.065491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1747-27d7-4a22-8708-52bf65858e4f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:31.093162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:31.095562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.097359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.097734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.104855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:31.111822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.216231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:31.245593 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3640/7305] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:31 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:31.247301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:31.276291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa1568-1ee8-4ced-a8b1-63d5e8638499 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:31.483018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:31.488057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.488345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.488730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.492234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:31.498020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.538474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:31.540241 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3666/7306] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:31 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:31.556831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c0ef4-0607-4892-911d-ae86c46a09bf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:31.570165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:31.571671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.571948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.573600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.576977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:31.578693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.606532 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3641/7307] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:38:31.611333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:31.625750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f6c0c-cd2c-4203-b1d7-8bdc92dc6d21 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:31.636954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:31.637838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.638314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.638799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.642068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:31.644439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55612da3-ed88-49ca-8b79-cc0b9325ab97 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.685848 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3667/7308] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:31.686599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:31.703351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c000cf-07d7-4e80-9dca-bade75a567ab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:31.712777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:31.713484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.713758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.714029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] PATH_INFO: `/v3/projects/75ee6497e9be4eb69a0a5befa53b3f14/users/959d407dbd6745769a8f8314af352615/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.754910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ee6497e9be4eb69a0a5befa53b3f14, user_id=959d407dbd6745769a8f8314af352615, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:31.758033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:31.786321 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3642/7309] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:31 2022] PUT /identity/v3/projects/75ee6497e9be4eb69a0a5befa53b3f14/users/959d407dbd6745769a8f8314af352615/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:38:31.799485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:31.800129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:31.800506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:31.870528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] MFA Rules not processed for user `959d407dbd6745769a8f8314af352615`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:31.873633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:32.046593 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3668/7310] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:32.055733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:32.058357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:32.199489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a259d9-3eb0-4cfa-a785-1373653e130d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:32.204019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:32.204650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:32.205083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:32.205311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:32.222157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:32.224068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:32.251981 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3643/7311] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:42.034632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:42.242041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:44.752545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:44.755118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:45.036762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be0c2-455c-4886-96e7-1746adf878c9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:45.051278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:45.052720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:45.053054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:45.054607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:45.059687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:45.236280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:45.239974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3e670-c6fe-4753-bef4-ee83c9b2eed6 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:45.266688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3669/7312] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:48.007813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:48.010230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:48.205045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc23601-b102-4a03-8a96-7c5945f6cc42 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:48.232973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:48.238867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:48.239252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:48.239604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] PATH_INFO: `/v3/users/ee957c509b914e3483fd7f7872057652` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:48.253227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee957c509b914e3483fd7f7872057652)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:48.262131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:48.414345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee957c509b914e3483fd7f7872057652'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:48.415344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee957c509b914e3483fd7f7872057652'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:48.427862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee957c509b914e3483fd7f7872057652'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:48.429388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee957c509b914e3483fd7f7872057652'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:48.442152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee957c509b914e3483fd7f7872057652'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:48.476135 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3644/7313] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:48 2022] DELETE /identity/v3/users/ee957c509b914e3483fd7f7872057652 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:48.477738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:48.478194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:48.478573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:48.517637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:48.520083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:48.749495 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3670/7314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:38:48.779020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:48.780610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:49.000682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86da8b-2b00-40a1-9c58-2b4a02bbd517 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:49.010442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:49.012087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:49.012397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:49.013707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:49.038216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:49.042548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310c73-69fc-4890-8ec2-bf879db2f17d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:49.077898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3645/7315] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:50.868123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:50.873185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:50.902153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005784-ab5e-4029-a1c1-63f12ba354db None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:50.929928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:50.930829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:50.938315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:50.942132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] PATH_INFO: `/v3/projects/e3e143f63ae340dab1f1ba739592666a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:50.954135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e143f63ae340dab1f1ba739592666a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:50.960324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:51.171093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:51.210189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e143f63ae340dab1f1ba739592666a', 'request_id': 'req-f86b1c85-635d-472a-b2fc-f8c3c687809b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:51.247453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e143f63ae340dab1f1ba739592666a', 'request_id': 'req-f86b1c85-635d-472a-b2fc-f8c3c687809b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:51.275620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e143f63ae340dab1f1ba739592666a', 'request_id': 'req-f86b1c85-635d-472a-b2fc-f8c3c687809b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:51.312789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] The token cache is being invalidate because project e3e143f63ae340dab1f1ba739592666a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:51.319006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:51.321066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f86b1c85-635d-472a-b2fc-f8c3c687809b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:51.332006 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3671/7316] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:50 2022] DELETE /identity/v3/projects/e3e143f63ae340dab1f1ba739592666a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:51.334823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:51.336145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:51.336350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:51.400808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:51.410649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:51.494883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:51.714677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3646/7317] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:51.724038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:51.726814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:51.726995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:51.798816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:51.802513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:51.820634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3672/7318] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:51.827235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:51.868019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33edf9c-120f-4a87-8d0b-3254a69c39e1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:51.881652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:51.884009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:51.884129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:51.888626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:51.889684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:51.890070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:51.891797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:51.932564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3647/7319] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:38:51.933917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:51.947231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4637280-1d75-4808-8d57-3d6f9ab1900c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:51.963776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:51.964421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:51.966727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:51.967013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:51.969135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:51.977070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:52.064323 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3673/7320] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:51 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:52.065534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:52.082825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb581746-a620-4257-8caf-6e3ed28b5d1a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:52.225385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:52.227018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:52.227301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:52.227574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:52.228220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:52.232276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:52.276275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3648/7321] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:52 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:52.280718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:52.295192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a32f4-9d18-4b6b-b7e1-aa687e0684f8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:52.302116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:52.303172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:52.303536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:52.303879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:52.304602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:52.307158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:52.341610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:52.352398 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3674/7322] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:52.360068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfdda-ffb4-4391-8808-240ea387a137 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:52.374575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:52.376139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:52.376430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:52.376702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:52.380346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:52.382787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dc13b-4408-4bd6-a56c-36334ce54e73 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:52.415159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3649/7323] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:52.419431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:52.438634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ad58-cafc-4244-9aaa-1bf91214c376 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:52.449901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:52.450730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:52.451254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:52.451859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] PATH_INFO: `/v3/projects/a339fd6fa3324a13b345cebe77366ce0/users/45fcfcfb2417448497bf7fedecf261d8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:52.500706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a339fd6fa3324a13b345cebe77366ce0, user_id=45fcfcfb2417448497bf7fedecf261d8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:52.506754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:52.545497 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3675/7324] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:52 2022] PUT /identity/v3/projects/a339fd6fa3324a13b345cebe77366ce0/users/45fcfcfb2417448497bf7fedecf261d8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:52.559312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:52.559846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:52.560441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:52.645342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] MFA Rules not processed for user `45fcfcfb2417448497bf7fedecf261d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:52.647728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:52.868959 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3650/7325] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:52.944559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:52.949275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:53.204726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a26dc-d02a-45a8-b7d3-7f6f67a8873b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:53.225044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:53.225880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:53.226341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:53.226770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:53.266044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:53.267519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40467e-c0be-44cb-9ef7-5c910379cfe1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:53.296359 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3676/7326] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:53.311685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:53.354653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:53.465701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303a9a1-7127-4379-b10b-1427eff5c65c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:53.473682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:53.479358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:53.479903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:53.480149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] PATH_INFO: `/v3/users/45fcfcfb2417448497bf7fedecf261d8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:53.483245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fcfcfb2417448497bf7fedecf261d8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:53.489441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:53.593814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fcfcfb2417448497bf7fedecf261d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:53.594481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fcfcfb2417448497bf7fedecf261d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:53.614928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fcfcfb2417448497bf7fedecf261d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:53.617418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fcfcfb2417448497bf7fedecf261d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:53.640674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fcfcfb2417448497bf7fedecf261d8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:53.681262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3651/7327] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:38:53 2022] DELETE /identity/v3/users/45fcfcfb2417448497bf7fedecf261d8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:53.685793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:53.686219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:53.686601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:53.733071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:53.734700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:53.898621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:53.915858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3677/7328] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:53.938291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:53.939921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:54.162092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9b12d-df68-4eaf-82c2-4148e65fdc28 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:54.169870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:54.170789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:54.171712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:54.172199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:54.201359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:54.203161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:54.232889 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3652/7329] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:38:55.540143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:55.541772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:55.999469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:56.000916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:56.014138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8542c-d1a1-496b-a050-4c78c105227b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:56.035999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:56.036646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.037137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.037423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.040239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:56.091463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:56.093136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34324df-8169-4902-9781-3b13f3510ccd service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:56.111353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425c586-75c9-42cf-b324-751f297f2a51 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:56.116307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3678/7330] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:38:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:38:56.120356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:56.121033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.121328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.121598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] PATH_INFO: `/v3/projects/a339fd6fa3324a13b345cebe77366ce0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.122772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a339fd6fa3324a13b345cebe77366ce0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:56.124839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:56.138960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:56.214151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a339fd6fa3324a13b345cebe77366ce0', 'request_id': 'req-f91b6590-b84b-489d-9878-15edc15b323d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:56.232554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a339fd6fa3324a13b345cebe77366ce0', 'request_id': 'req-f91b6590-b84b-489d-9878-15edc15b323d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:56.244843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a339fd6fa3324a13b345cebe77366ce0', 'request_id': 'req-f91b6590-b84b-489d-9878-15edc15b323d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:56.266808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] The token cache is being invalidate because project a339fd6fa3324a13b345cebe77366ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:38:56.267882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:56.268456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f91b6590-b84b-489d-9878-15edc15b323d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:38:56.286814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3653/7331] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:38:55 2022] DELETE /identity/v3/projects/a339fd6fa3324a13b345cebe77366ce0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:56.292569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.293218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.293502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.334229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:56.335399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:56.507297 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3679/7332] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:56.516270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.516882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.517356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.556694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:56.560905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:56.585710 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3654/7333] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:38:56.588338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:56.603433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5b56-b1ed-4969-b8f3-5032df128ea6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:56.615428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:56.616296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.616723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.617169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.618172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:38:56.618620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:56.621199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:56.653168 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3680/7334] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:38:56.657140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:56.673178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef433-1ed4-4fe8-8638-01f9a512e79c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:56.685089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:56.686021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.686518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.686997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.688625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:56.692895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:56.758212 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3655/7335] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:56 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:56.762176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:56.778056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd7597-747c-4488-9ac1-15dd1ef52d49 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:56.827285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:56.913503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:56.914360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:56.914747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:56.915248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:56.916000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:56.921563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:56.967384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3681/7336] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:56 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:38:56.971691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:56.991629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e3299-8408-4912-a1c6-29f3db49fd77 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:57.009326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:57.009954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.014331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.014790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.015640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:57.027082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:57.051904 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3656/7337] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:57.056282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:57.068702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26f87-4434-4864-9527-c83ea840a2da admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:57.086324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:57.087422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.087863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.088278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.089119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:57.090904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a7fb0-373b-47f3-8bce-d4f088ca5e93 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:57.116957 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3682/7338] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:57.120967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:57.137519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd3dab-e5d3-4f42-9d54-f01a1b611135 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:57.150464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:57.151382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.151990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.152414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] PATH_INFO: `/v3/projects/b5f3711efb384dff8104efdfea5969f7/users/7f8cd547104b4e849e7d700e24bec5a2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.194896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f3711efb384dff8104efdfea5969f7, user_id=7f8cd547104b4e849e7d700e24bec5a2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:57.198328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:57.229499 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3657/7339] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:57 2022] PUT /identity/v3/projects/b5f3711efb384dff8104efdfea5969f7/users/7f8cd547104b4e849e7d700e24bec5a2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:57.242080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.242651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.243135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.306930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] MFA Rules not processed for user `7f8cd547104b4e849e7d700e24bec5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:57.308598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:57.533715 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3683/7340] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:57.538880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:57.681773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de59475-906c-4fc8-872b-d5332cbea77c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:57.687177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:57.687875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.688157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.688423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.689279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:57.691958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:57.748049 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3658/7341] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:57 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:57.751603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:57.797777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9a97-b2cb-4c79-88ec-7ebe72e47b2b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:57.949409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:57.950501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:57.951328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:57.951844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:57.953690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:57.956089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:57.983566 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3684/7342] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:57 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:57.987527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:58.004047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f832f-4d9a-48a5-947e-673ff480f7e2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:58.009898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:58.010643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.011472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.011870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.014792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:58.016688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:58.041531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:58.069195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3659/7343] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:58.076949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e39d0-502c-4f73-a88d-fc6d11f20771 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:58.085203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:58.086360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.086844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.087271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.088270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:58.092420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4923-a4c8-4499-ac30-66e302fead0a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:58.115307 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3685/7344] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:58.119906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:58.132295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8389629-a729-42ba-8068-5b52fce460e2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:58.140950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:58.141676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.141953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.142224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] PATH_INFO: `/v3/projects/f2751d5bcc4f4353a397a548a7ac17d7/users/931930ee530a4b52ad92f70b03dcf4b0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.147208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:58.168529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2751d5bcc4f4353a397a548a7ac17d7, user_id=931930ee530a4b52ad92f70b03dcf4b0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:58.172245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:58.202095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3660/7345] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:58 2022] PUT /identity/v3/projects/f2751d5bcc4f4353a397a548a7ac17d7/users/931930ee530a4b52ad92f70b03dcf4b0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:58.204883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.205430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.205962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.244182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:58.261406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] MFA Rules not processed for user `931930ee530a4b52ad92f70b03dcf4b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:58.264150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:58.461069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3686/7346] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:38:58.462241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:58.662406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a8cd-fd52-486f-b13a-81073bd8f288 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:58.677915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:58.685952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.688154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.688554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.689394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:58.695914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:58.743370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3661/7347] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:38:58 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:58.744722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:58.759718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee47e5-fda5-428d-ae7a-2901b41bbb51 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:58.923101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:58.923908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:58.924032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:58.924276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:58.925867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:58.928137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:58.981444 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3687/7348] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:38:58 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:38:58.985651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:59.032669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294f173-6408-41c4-9bb5-1a01a7c37966 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:59.074521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:59.075766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:59.076058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:59.076328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:59.076984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:59.083332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:59.129072 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3662/7349] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:59.132395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:59.147643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2dc2-436b-42c3-a12c-27addebf0495 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:59.162241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:59.162928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:59.163213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:59.163485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] PATH_INFO: `/v3/projects/a3a660deed87450b853bbf810527bdc5/users/0c2f57803db844528ad3d17e9cde0758/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:59.219188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a660deed87450b853bbf810527bdc5, user_id=0c2f57803db844528ad3d17e9cde0758, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:59.222618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:59.264416 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3688/7350] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:59 2022] PUT /identity/v3/projects/a3a660deed87450b853bbf810527bdc5/users/0c2f57803db844528ad3d17e9cde0758/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:59.268491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:59.295000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95cd6a-ffde-4718-b153-c299996a5b36 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:59.444325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:59.445035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:59.445291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:59.445557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:59.446266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:59.448722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7250-b801-4752-ada0-7f0550c42a03 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:59.487693 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3663/7351] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:38:59.491933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:38:59.525322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384138c8-9a5c-4244-b05a-56aff9365b58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:38:59.543555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:38:59.544477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:59.544896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:59.545373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] PATH_INFO: `/v3/projects/a3a660deed87450b853bbf810527bdc5/users/0c2f57803db844528ad3d17e9cde0758/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:59.548450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a660deed87450b853bbf810527bdc5, user_id=0c2f57803db844528ad3d17e9cde0758, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:38:59.552541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:38:59.572561 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3689/7352] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:38:59 2022] PUT /identity/v3/projects/a3a660deed87450b853bbf810527bdc5/users/0c2f57803db844528ad3d17e9cde0758/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:38:59.582297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:38:59.582947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:38:59.583337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:38:59.712844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] MFA Rules not processed for user `0c2f57803db844528ad3d17e9cde0758`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:38:59.715762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:38:59.892407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:38:59.999260 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3664/7353] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:38:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:00.016066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:00.017855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:00.206324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778cd43-b80e-4aa9-90a2-0e04c93d1276 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:00.212743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:00.214144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:00.214853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:00.215281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:00.238171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:00.243781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:00.249204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:00.276040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3690/7354] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:01.796003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:01.816035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2c18c-8779-49fe-a6f5-005c9d032113 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:01.825357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:01.826469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:01.826913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:01.827319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:01.970032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:01.971488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:02.042698 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3665/7355] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:10.262995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:11.998587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=37 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:16.093773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:16.104543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:16.106230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:16.119097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:16.181603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67c3b6-597a-4f44-8609-6bf05fa00adf service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:16.193725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:16.194985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:16.195271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:16.195542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:16.354586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:16.356218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:16.414536 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3666/7356] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:16.497414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d9509-1290-419c-b759-8c3421c99d57 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:16.522787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:16.523577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:16.523968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:16.524350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:16.532123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:16.575406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:16.577391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba5cd-a083-49fc-86c1-b355b6252700 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:16.610694 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3691/7357] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:19.941697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:19.951003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:20.180405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fefc4-2345-4d56-8046-2847ac454e95 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:20.185594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:20.186529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:20.187010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:20.187487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] PATH_INFO: `/v3/users/74c90c833e4a478fb759871ef3eb6737` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:20.189098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c90c833e4a478fb759871ef3eb6737)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:20.203403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:20.334445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c90c833e4a478fb759871ef3eb6737'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:20.336380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c90c833e4a478fb759871ef3eb6737'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:20.355743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c90c833e4a478fb759871ef3eb6737'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:20.359051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c90c833e4a478fb759871ef3eb6737'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:20.373750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c90c833e4a478fb759871ef3eb6737'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:20.404734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:20.414882 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3667/7358] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:19 2022] DELETE /identity/v3/users/74c90c833e4a478fb759871ef3eb6737 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:20.419421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:20.419930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:20.419930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:20.498511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:20.499861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:20.654867 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3692/7359] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:20.660847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:20.663461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:20.772485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667dff5-5e53-432a-aa6d-05cbed21ae11 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:20.776220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:20.777376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:20.777653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:20.777919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:20.802749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:20.806655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166c77f-be6a-4c56-b2ce-fa88ea84ca38 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:20.873291 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3668/7360] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:21.428087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:21.432610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:21.484259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd990675-6b9a-40e0-96b8-56f9fe224f87 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:21.509329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:21.518521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:21.519006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:21.519341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] PATH_INFO: `/v3/projects/f34fd34ac60744ee9775911907d432c0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:21.521693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34fd34ac60744ee9775911907d432c0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:21.528616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:21.675503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34fd34ac60744ee9775911907d432c0', 'request_id': 'req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:21.693003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34fd34ac60744ee9775911907d432c0', 'request_id': 'req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:21.710130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34fd34ac60744ee9775911907d432c0', 'request_id': 'req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:21.717234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:21.751965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] The token cache is being invalidate because project f34fd34ac60744ee9775911907d432c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:21.752294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:21.756341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb41aed9-3bd6-47f5-b68f-c57b52fc01dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:21.764705 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3693/7361] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:21 2022] DELETE /identity/v3/projects/f34fd34ac60744ee9775911907d432c0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:21.765585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:21.766059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:21.766144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:21.929094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:21.929094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:22.182756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:22.183003 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3669/7362] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:22.183112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:22.183343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:22.232616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:22.235625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:22.274014 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3694/7363] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:22.280649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:22.313033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4ba5-4ef2-455f-9696-48ae799ca380 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:22.349266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:22.349934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:22.350211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:22.350483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:22.351147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:39:22.351448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:22.356873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:22.414164 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3670/7364] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:39:22.415379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:22.435514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858474e3-46ff-45f8-b086-e02e5465a18e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:22.473867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:22.473867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:22.473867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:22.473867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:22.474476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:22.488512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:22.590531 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3695/7365] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:22 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:22.592346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:22.620101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b8fdf-f62a-4346-85d1-0e08f968cd75 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:22.838108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:22.838744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:22.839002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:22.839264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:22.840615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:22.842577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:22.920715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:22.951383 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3671/7366] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:22 2022] POST /identity/v3/users => generated 291 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:22.963749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:23.021142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0531-f3ab-4300-b093-9f117de23ba0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:23.067454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:23.069485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:23.071838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:23.072831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:23.077969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:23.079994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:23.166385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:23.167636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3696/7367] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:23.194079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde5c92-8366-405e-ba9f-c5eb2355ada1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:23.219631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:23.221823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:23.222131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:23.222421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:23.224517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:23.239636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4fc3e-0068-4947-99f3-fb123654d63a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:23.303495 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3672/7368] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:23.308281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:23.336185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb607c-cc51-4b5c-90d8-b5a86e278a26 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:23.355311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:23.356005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:23.356280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:23.356549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] PATH_INFO: `/v3/projects/ee9a12e7cd6f47c8a548bcba06da3912/users/c5f901c60698456cabd5cf4c95caddac/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:23.407475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9a12e7cd6f47c8a548bcba06da3912, user_id=c5f901c60698456cabd5cf4c95caddac, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:23.413892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:23.441037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3697/7369] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:23 2022] PUT /identity/v3/projects/ee9a12e7cd6f47c8a548bcba06da3912/users/c5f901c60698456cabd5cf4c95caddac/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:23.456546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:23.456828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:23.457426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:23.539437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] MFA Rules not processed for user `c5f901c60698456cabd5cf4c95caddac`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:23.542591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:23.831497 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3673/7370] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:23.837940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:23.839778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:24.123164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af65f9-bd9b-4c3a-837c-279d197ccf70 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:24.144521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:24.149974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:24.151356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:24.164853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:24.225982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:24.233384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cbc30-b63d-4505-8331-03b7ad0a8d5d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:24.264041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3698/7371] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:25.763551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:25.766684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:26.002969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980b2f-501e-4eab-b000-0de09b397c32 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:26.018601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:26.019258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:26.019537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:26.019810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] PATH_INFO: `/v3/users/7f8cd547104b4e849e7d700e24bec5a2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:26.021667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8cd547104b4e849e7d700e24bec5a2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:26.025674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:26.128469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8cd547104b4e849e7d700e24bec5a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:26.131579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8cd547104b4e849e7d700e24bec5a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:26.150570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8cd547104b4e849e7d700e24bec5a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:26.154629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8cd547104b4e849e7d700e24bec5a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:26.172783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8cd547104b4e849e7d700e24bec5a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:26.195274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:26.232646 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3674/7372] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:25 2022] DELETE /identity/v3/users/7f8cd547104b4e849e7d700e24bec5a2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:26.238735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:26.239962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:26.240456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:26.289106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:26.295121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:26.555644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3699/7373] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:26.569033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:26.572335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:26.701705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940a78-a8f3-4fcd-b439-84f7ea6553e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:26.714390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:26.715734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:26.717034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:26.719748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:26.759916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:26.766257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:26.786834 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3675/7374] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:27.530217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:27.532773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:27.575497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6959b-0348-4d55-b056-8e6e8c8b02d6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:27.583737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:27.584705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:27.586164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:27.586437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] PATH_INFO: `/v3/projects/b5f3711efb384dff8104efdfea5969f7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:27.589734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f3711efb384dff8104efdfea5969f7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:27.599263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:27.716193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:27.778577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f3711efb384dff8104efdfea5969f7', 'request_id': 'req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:27.806658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f3711efb384dff8104efdfea5969f7', 'request_id': 'req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:27.833587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f3711efb384dff8104efdfea5969f7', 'request_id': 'req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:27.885104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] The token cache is being invalidate because project b5f3711efb384dff8104efdfea5969f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:27.886396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:27.888722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:27.900950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:27.907193 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3700/7375] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:27 2022] DELETE /identity/v3/projects/b5f3711efb384dff8104efdfea5969f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:27.917842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c30b-751b-47fe-bcbd-0c1a37866837 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:28.151360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:28.155351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:28.156085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:28.158035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] PATH_INFO: `/v3/users/931930ee530a4b52ad92f70b03dcf4b0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:28.161681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=931930ee530a4b52ad92f70b03dcf4b0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:28.167816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:28.412237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931930ee530a4b52ad92f70b03dcf4b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:28.418217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931930ee530a4b52ad92f70b03dcf4b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:28.537195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931930ee530a4b52ad92f70b03dcf4b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:28.537195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931930ee530a4b52ad92f70b03dcf4b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:28.553225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931930ee530a4b52ad92f70b03dcf4b0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:28.671151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3676/7376] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:27 2022] DELETE /identity/v3/users/931930ee530a4b52ad92f70b03dcf4b0 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:30.226531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:30.228172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:30.263690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbbc2-bbfe-4cea-b3eb-c7324f530db2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:30.416079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:30.417039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:30.417492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:30.417955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] PATH_INFO: `/v3/projects/f2751d5bcc4f4353a397a548a7ac17d7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:30.422813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2751d5bcc4f4353a397a548a7ac17d7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:30.428700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:30.512762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2751d5bcc4f4353a397a548a7ac17d7', 'request_id': 'req-86ddfe6e-7c8d-486c-baed-3e20612b2e92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:30.524278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2751d5bcc4f4353a397a548a7ac17d7', 'request_id': 'req-86ddfe6e-7c8d-486c-baed-3e20612b2e92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:30.533053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2751d5bcc4f4353a397a548a7ac17d7', 'request_id': 'req-86ddfe6e-7c8d-486c-baed-3e20612b2e92'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:30.555865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] The token cache is being invalidate because project f2751d5bcc4f4353a397a548a7ac17d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:30.556456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:30.557368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:30.562491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3701/7377] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:30 2022] DELETE /identity/v3/projects/f2751d5bcc4f4353a397a548a7ac17d7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:30.564911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:30.566988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:30.608175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707c656-3158-4232-9d92-a2c50342fbfa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:30.642028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:30.902950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:30.904028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:30.904509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:30.905316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] PATH_INFO: `/v3/users/0c2f57803db844528ad3d17e9cde0758` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:30.914069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2f57803db844528ad3d17e9cde0758)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:30.925125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:31.110100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2f57803db844528ad3d17e9cde0758'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:31.111096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2f57803db844528ad3d17e9cde0758'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:31.122015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2f57803db844528ad3d17e9cde0758'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:31.122644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2f57803db844528ad3d17e9cde0758'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:31.134677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-248daa36-7d02-4ff3-82d2-07b5ae368782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2f57803db844528ad3d17e9cde0758'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:31.183707 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3677/7378] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:30 2022] DELETE /identity/v3/users/0c2f57803db844528ad3d17e9cde0758 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:32.354217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:32.357257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:32.382880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddfe6e-7c8d-486c-baed-3e20612b2e92 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:32.535653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:32.576187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:32.576857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:32.577354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:32.577781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] PATH_INFO: `/v3/projects/a3a660deed87450b853bbf810527bdc5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:32.581461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a660deed87450b853bbf810527bdc5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:32.584352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:32.731894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a660deed87450b853bbf810527bdc5', 'request_id': 'req-f74b6f0f-38b6-4489-9e56-711ddbbbea21'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:32.758167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a660deed87450b853bbf810527bdc5', 'request_id': 'req-f74b6f0f-38b6-4489-9e56-711ddbbbea21'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:32.780463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a660deed87450b853bbf810527bdc5', 'request_id': 'req-f74b6f0f-38b6-4489-9e56-711ddbbbea21'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:32.840796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] The token cache is being invalidate because project a3a660deed87450b853bbf810527bdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:32.843433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:32.849561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f74b6f0f-38b6-4489-9e56-711ddbbbea21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:32.857728 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3702/7379] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:32 2022] DELETE /identity/v3/projects/a3a660deed87450b853bbf810527bdc5 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:32.864319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:32.864799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:32.864886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:32.903038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:32.918192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:33.201679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3678/7380] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:33.210963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.211248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.211520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.254029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:33.255383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:33.276819 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3703/7381] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:33.280957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.296448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ad06-91b4-4ffa-a0a5-219b2e1608b8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.309394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.310046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.310325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.310590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.315498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:39:33.315815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:33.317724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:33.355051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3679/7382] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:39:33.359722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.374179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f6244-9d6a-4e49-856f-3749b027f96b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.387656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.390917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.391370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.391781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.395278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:33.399822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:33.462261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3704/7383] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:33 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:33.466816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.490949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05906eee-0f20-42f4-a783-075ad5fc217e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.558737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:33.688046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.693809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.694296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.694780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.696275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:33.704262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:33.739552 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3680/7384] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:33 2022] POST /identity/v3/users => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:39:33.743749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.763458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226ddf6-4086-483e-8feb-e7a23e81c5ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.782702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.784320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.784601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.784872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.785578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:33.787200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:33.821170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3705/7385] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:33.821502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.847381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288d68-8163-4ca7-a79d-5a7e1f57cbc4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.861771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.864169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.864474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.865089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:33.865734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:33.871559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207379d1-eb30-47f2-ba4a-96005b9a39c9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:33.928775 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3681/7386] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:33.932625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:33.943823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3190-d866-406a-be15-a14dcb74ff29 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:33.960693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:33.961419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:33.961699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:33.962028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] PATH_INFO: `/v3/projects/170630fb508d42fc8165feb3e2915115/users/7efdcdb60cc24a63a2b2b285882313ef/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:34.000062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170630fb508d42fc8165feb3e2915115, user_id=7efdcdb60cc24a63a2b2b285882313ef, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:34.006712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:34.043520 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3706/7387] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:33 2022] PUT /identity/v3/projects/170630fb508d42fc8165feb3e2915115/users/7efdcdb60cc24a63a2b2b285882313ef/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:34.055383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:34.055664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:34.056635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:34.150560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] MFA Rules not processed for user `7efdcdb60cc24a63a2b2b285882313ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:34.151788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:34.388551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:34.389384 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3682/7388] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:34.613420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa10cb-db8b-4e1a-a469-fd7d9147bcc4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:34.628158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:34.629679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:34.631884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:34.632402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:34.633211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:34.637458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:34.684821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:34.702875 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3707/7389] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:34 2022] POST /identity/v3/projects => generated 399 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:34.707862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:34.734283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481cd6-e0c1-40c0-a3d2-30b648a9bff4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:34.931240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:34.932662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:34.933192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:34.933846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:34.936558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:34.944504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:35.011338 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3683/7390] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:34 2022] POST /identity/v3/users => generated 306 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:39:35.015501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:35.031007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859571ff-0085-4b01-a9ed-b10acded26d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:35.043119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:35.044004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.045287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.045726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.046541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:35.051023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:35.079199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3708/7391] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:35.083770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:35.099732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e82a6-29d7-421b-b6bc-a26e556a34b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:35.114767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:35.115883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.116287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.116695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] PATH_INFO: `/v3/projects/9a4669986793431d8f9ef670f297e37c/users/5a294d17654a42c59b9b903a8bbc48a0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.152257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4669986793431d8f9ef670f297e37c, user_id=5a294d17654a42c59b9b903a8bbc48a0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:35.156247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:35.159158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:35.194841 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3684/7392] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:35 2022] PUT /identity/v3/projects/9a4669986793431d8f9ef670f297e37c/users/5a294d17654a42c59b9b903a8bbc48a0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:35.198759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:35.216831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca98296-4403-4f60-bc72-d8f1ab52acbd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:35.368638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:35.373344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.373972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.374486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.375584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:35.379191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:35.422836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3709/7393] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:35.424091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:35.442132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41685ba4-ddce-4563-8516-24a50244f05b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:35.458593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:35.459555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.459895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.460312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] PATH_INFO: `/v3/projects/9a4669986793431d8f9ef670f297e37c/users/5a294d17654a42c59b9b903a8bbc48a0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.465972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4669986793431d8f9ef670f297e37c, user_id=5a294d17654a42c59b9b903a8bbc48a0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:35.468624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380be64-b83f-40e1-886f-901bddfc7f5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:35.484537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:35.486966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:35.531357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164eac1-fbb9-4796-86b5-0a0b3283062b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:35.540659 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3685/7394] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:35 2022] PUT /identity/v3/projects/9a4669986793431d8f9ef670f297e37c/users/5a294d17654a42c59b9b903a8bbc48a0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:35.554522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.554709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.554968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.684706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] MFA Rules not processed for user `5a294d17654a42c59b9b903a8bbc48a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:35.697392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:35.792725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:35.793408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:35.793683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:35.793947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] PATH_INFO: `/v3/users/959d407dbd6745769a8f8314af352615` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:35.806232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] RBAC: Authorizing `identity:delete_user(user_id=959d407dbd6745769a8f8314af352615)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:35.809712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:36.016975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959d407dbd6745769a8f8314af352615'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:36.028595 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3686/7395] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:36.039469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959d407dbd6745769a8f8314af352615'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:36.040810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:36.041819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959d407dbd6745769a8f8314af352615'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:36.044442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:36.070086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959d407dbd6745769a8f8314af352615'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:36.081175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-978f5517-f364-4cd8-aac4-97de9b7d808f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959d407dbd6745769a8f8314af352615'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:36.174753 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3710/7396] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:35 2022] DELETE /identity/v3/users/959d407dbd6745769a8f8314af352615 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:36.180605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:36.180973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:36.192314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:36.216460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:36.252025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:36.253841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:36.297634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46de0e-5a3a-41b1-b2fa-6533a58c49ec None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:36.479179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3711/7397] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:36.491190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:36.492499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:36.493117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:36.493721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:36.496759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:36.568540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:36.570252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:36.622197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:36.769662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:36.772754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:36.804658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e7ffb-84df-4bde-bb97-93adc7474df8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:36.818465 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3687/7398] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:36.820298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:36.820930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:36.821225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:36.821490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:36.846306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:36.847756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:36.880068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3712/7399] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:39:37.169128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:37.171314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:37.196249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1cc54-c4ad-479e-84e9-29981f05bc5b service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:37.214917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:37.216122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:37.216596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:37.217428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:37.222616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:37.432179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:37.434184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59107a0-bcd9-49b7-80cc-3153754bdebd service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:37.445519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3688/7400] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:38.601633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:38.603213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:38.660890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e202a-38c9-404e-9043-22ee556aa9fd service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:38.675954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:38.676702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:38.678480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:38.678860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] PATH_INFO: `/v3/projects/75ee6497e9be4eb69a0a5befa53b3f14` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:38.682241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ee6497e9be4eb69a0a5befa53b3f14)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:38.684586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:38.798786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ee6497e9be4eb69a0a5befa53b3f14', 'request_id': 'req-ee53b95b-ae6d-4470-aa90-13039ebf9bef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:38.810337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ee6497e9be4eb69a0a5befa53b3f14', 'request_id': 'req-ee53b95b-ae6d-4470-aa90-13039ebf9bef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:38.820156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ee6497e9be4eb69a0a5befa53b3f14', 'request_id': 'req-ee53b95b-ae6d-4470-aa90-13039ebf9bef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:38.869514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] The token cache is being invalidate because project 75ee6497e9be4eb69a0a5befa53b3f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:38.869808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:38.871274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee53b95b-ae6d-4470-aa90-13039ebf9bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:38.873032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3713/7401] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:38 2022] DELETE /identity/v3/projects/75ee6497e9be4eb69a0a5befa53b3f14 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:38.879071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:38.879635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:38.879635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:38.960725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:38.965681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:39.261057 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3689/7402] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:39.414631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:39.415319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:39.415410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:39.466925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:39.484064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:39.544870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3714/7403] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:39.547079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:39.570343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a98e5-fd7f-4ba5-bfd7-330c2a9e80ac None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:39.587751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:39.589059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:39.589630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:39.590396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:39.591268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:39:39.591854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:39.594275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:39.619636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:39.633226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3690/7404] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:39:39.635961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27305bd-3636-4fa1-9e13-b2104f3a2dcd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:39.642646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:39.643576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:39.644162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:39.644580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:39.646360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:39.649164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:39.707805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:39.709150 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3715/7405] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:39 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:39.744775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07761e7-a812-4bc6-8fdd-b44f064d1ad3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:39.997387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:40.011692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:40.015068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.015551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.016353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.018585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:40.048208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:40.084929 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3691/7406] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:39 2022] POST /identity/v3/users => generated 291 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:40.088707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:40.094608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:40.104627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18799d-0085-4c80-844b-55b2dc55d7f7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:40.121068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:40.122017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.122491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.122813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.123687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:40.126218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:40.159891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:40.165396 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3716/7407] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:40.171359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ff8ed-3a34-43d1-922f-022f5fcc36fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:40.186263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:40.187238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.187758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.188381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.191343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:40.200442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe41568-9ec8-4596-a93a-7d5e9ec8ee70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:40.230041 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3692/7408] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:39:40.234620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:40.261285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c531b-da34-490a-8505-3bdcc8b245d1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:40.279595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:40.280569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.281021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.281437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] PATH_INFO: `/v3/projects/ebe6b545c1f44199a313289eb21fe0b2/users/93b7f4b9ee5e4b85a95f3989557222ee/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.327913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe6b545c1f44199a313289eb21fe0b2, user_id=93b7f4b9ee5e4b85a95f3989557222ee, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:40.331793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:40.364643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3717/7409] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:40 2022] PUT /identity/v3/projects/ebe6b545c1f44199a313289eb21fe0b2/users/93b7f4b9ee5e4b85a95f3989557222ee/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:40.370025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec618c4-7d4c-4979-b974-ec8d5296f764 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.375760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec618c4-7d4c-4979-b974-ec8d5296f764 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.377078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec618c4-7d4c-4979-b974-ec8d5296f764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.418731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eec618c4-7d4c-4979-b974-ec8d5296f764 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:40.421104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eec618c4-7d4c-4979-b974-ec8d5296f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:40.598141 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3693/7410] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:40.606414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:40.608984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:40.858980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5d7dc-c39d-457f-a794-8bf6c212ba58 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:40.878559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:40.879431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:40.879855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:40.880847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:40.900740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:40.902571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:40.931010 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3718/7411] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:42.882453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:42.883031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:42.883348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:42.996511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] MFA Rules not processed for user `93b7f4b9ee5e4b85a95f3989557222ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:42.997945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:43.181869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3694/7412] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:43.194096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:43.195526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:43.285969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c922-fcb2-4ca0-8441-8637cd22cd03 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:43.290491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:43.291628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:43.292555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:43.293731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:43.315574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:43.317879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6db7e7-f302-412d-b1da-0b6783f5bdc7 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:43.369116 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3719/7413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:48.722447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:48.725428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:48.756171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21dcbc8-ea72-42ec-9cfe-333e9f7a164d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:48.770398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:48.771428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:48.771903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:48.772364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] PATH_INFO: `/v3/users/7efdcdb60cc24a63a2b2b285882313ef` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:48.776767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7efdcdb60cc24a63a2b2b285882313ef)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:48.778887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:48.899940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7efdcdb60cc24a63a2b2b285882313ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:48.903888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7efdcdb60cc24a63a2b2b285882313ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:48.921171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7efdcdb60cc24a63a2b2b285882313ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:48.921932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7efdcdb60cc24a63a2b2b285882313ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:48.932438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:48.942802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7efdcdb60cc24a63a2b2b285882313ef'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:49.007915 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3695/7414] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:48 2022] DELETE /identity/v3/users/7efdcdb60cc24a63a2b2b285882313ef => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:49.010292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:49.010676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:49.010834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:49.071087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:49.072316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:49.212138 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3720/7415] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:49.235533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:49.238812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:49.469704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eae128-7018-482c-8587-7fb72125bce3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:49.480059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:49.480758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:49.481067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:49.481340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:49.505578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:49.510320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:49.541860 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3696/7416] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:52.244724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:52.248910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:52.276061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36448-cd7c-453c-9e79-fdd8af7001e7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:52.291630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:52.292446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:52.292941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:52.293428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] PATH_INFO: `/v3/projects/170630fb508d42fc8165feb3e2915115` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:52.296272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170630fb508d42fc8165feb3e2915115)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:52.299243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:52.322449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:52.430975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170630fb508d42fc8165feb3e2915115', 'request_id': 'req-42e4c071-5f67-4310-8f9d-e8cc04421214'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.449035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170630fb508d42fc8165feb3e2915115', 'request_id': 'req-42e4c071-5f67-4310-8f9d-e8cc04421214'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.468882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170630fb508d42fc8165feb3e2915115', 'request_id': 'req-42e4c071-5f67-4310-8f9d-e8cc04421214'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.509361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] The token cache is being invalidate because project 170630fb508d42fc8165feb3e2915115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:52.509656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.519061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.522093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3721/7417] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:52 2022] DELETE /identity/v3/projects/170630fb508d42fc8165feb3e2915115 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:52.526745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:52.552044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596348b7-9a95-49ae-bf47-9a591ea311c9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:52.758394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:52.759225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:52.760056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:52.770287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] PATH_INFO: `/v3/users/5a294d17654a42c59b9b903a8bbc48a0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:52.771896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a294d17654a42c59b9b903a8bbc48a0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:52.776593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:52.917499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a294d17654a42c59b9b903a8bbc48a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.919519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a294d17654a42c59b9b903a8bbc48a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.949670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a294d17654a42c59b9b903a8bbc48a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.953398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a294d17654a42c59b9b903a8bbc48a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.974579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3b13f508-b714-4049-8fb1-21c8d7aa5440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a294d17654a42c59b9b903a8bbc48a0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:52.996375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:53.052761 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3697/7418] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:52 2022] DELETE /identity/v3/users/5a294d17654a42c59b9b903a8bbc48a0 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:55.643751 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:55.645453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:55.681148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c071-5f67-4310-8f9d-e8cc04421214 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:55.918030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:55.919420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:55.920024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:55.920368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] PATH_INFO: `/v3/projects/9a4669986793431d8f9ef670f297e37c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:55.922811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4669986793431d8f9ef670f297e37c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:55.929102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:56.038076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4669986793431d8f9ef670f297e37c', 'request_id': 'req-2573c4a7-522a-4678-8962-d4ec72488996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:56.049390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4669986793431d8f9ef670f297e37c', 'request_id': 'req-2573c4a7-522a-4678-8962-d4ec72488996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:56.062829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4669986793431d8f9ef670f297e37c', 'request_id': 'req-2573c4a7-522a-4678-8962-d4ec72488996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:56.091633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] The token cache is being invalidate because project 9a4669986793431d8f9ef670f297e37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:56.092001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:56.093385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2573c4a7-522a-4678-8962-d4ec72488996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:56.100433 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3722/7419] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:55 2022] DELETE /identity/v3/projects/9a4669986793431d8f9ef670f297e37c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:56.102126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.105588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.105588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.146574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:56.154319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:56.329846 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3698/7420] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:56.337531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.337875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.338214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.388398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:56.391051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:56.419646 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3723/7421] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:56.427241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:56.440951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296e86-4c46-4a76-b58d-d011d7052d5c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:56.451238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:56.452040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.453028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.453028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.453544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:39:56.454572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:56.460443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:56.526413 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3699/7422] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:39:56.539133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:56.551263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9288ec-c4ce-40a0-912c-693cdf52174f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:56.569914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:56.571456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.571456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.571456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.581580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:56.583662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:56.658662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:56.691664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:56.692024 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3724/7423] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:56 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:56.707461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e960528-b6cf-4b63-bf4f-95d744867722 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:56.894570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:56.895226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.895501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.895771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.904185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:56.906320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:56.967997 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3700/7424] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:56 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:56.974207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:56.988573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d686f5-c500-46a5-9f90-7923290e0dea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:56.993409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:56.994026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:56.994358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:56.994633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:56.995280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:56.998195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.011723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3725/7425] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:57.018425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.037381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899eba7-a520-4aab-ae24-32db7c144407 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.043506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.043975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.044371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.044788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.045617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:57.047619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d597e0-dbcf-4f0a-9650-cdeec041d46d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.082512 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3701/7426] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:57.083674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.096120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65456883-3314-47f6-acd5-75c6541efd25 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.101690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.102562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.102937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.103319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] PATH_INFO: `/v3/projects/ff46e6ba4baf48b2b9b8baa72331022a/users/97a6bfa667354fa9b38c5f606b1d941c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.135846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff46e6ba4baf48b2b9b8baa72331022a, user_id=97a6bfa667354fa9b38c5f606b1d941c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:57.140176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.177534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.178029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.178138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.186168 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3726/7427] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:57 2022] PUT /identity/v3/projects/ff46e6ba4baf48b2b9b8baa72331022a/users/97a6bfa667354fa9b38c5f606b1d941c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:57.221939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] MFA Rules not processed for user `97a6bfa667354fa9b38c5f606b1d941c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:57.223091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:57.334239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:57.389381 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3702/7428] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:57.394488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.543415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4790e67-c1e5-4722-a2fe-76a2a106d106 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.554906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.555546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.555829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.556100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.556807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:57.558993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.572982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.574470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:57.598499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f67a-ae06-40e8-8974-589d7c306d43 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.611793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.612489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.612804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.615078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] PATH_INFO: `/v3/users/bc1f3d7dd96243f098ab58f5b758d986` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.628321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1f3d7dd96243f098ab58f5b758d986)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:57.633657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.637217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3727/7429] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:57 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:39:57.640736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.746653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1f3d7dd96243f098ab58f5b758d986'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:57.747435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1f3d7dd96243f098ab58f5b758d986'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:57.761317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1f3d7dd96243f098ab58f5b758d986'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:57.762102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dab94-6678-48b8-a317-4253de3ec44e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.762740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1f3d7dd96243f098ab58f5b758d986'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:57.768378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.769360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.769691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.770028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.770610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:57.772591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:57.774003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-bd47818e-8ded-4f4a-8341-f7af5299e188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1f3d7dd96243f098ab58f5b758d986'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:57.800863 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3728/7430] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:39:57 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:39:57.814939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:57.817374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:57.833606 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3703/7431] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:39:57 2022] DELETE /identity/v3/users/bc1f3d7dd96243f098ab58f5b758d986 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:57.837895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.838591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.839904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.849652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d397a-6f2d-4f7e-96ff-c3044a461f18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:57.904576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:57.906392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:57.948033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:57.993764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:57.994402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:57.994683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:57.994951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:57.995610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.002135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.021039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3729/7432] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:58.030791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.052553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8d4bf-91de-4a30-a5b1-05726d7e8425 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:58.059092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3704/7433] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:58.062712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:58.063300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.063591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.063863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] PATH_INFO: `/v3/projects/c9744c2427b2451b80435d02a896836d/users/d00cb5dfb6c94223852599bc24e3ca6c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.073884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.076305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:58.116198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9744c2427b2451b80435d02a896836d, user_id=d00cb5dfb6c94223852599bc24e3ca6c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.119052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.138904 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3730/7434] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:58 2022] PUT /identity/v3/projects/c9744c2427b2451b80435d02a896836d/users/d00cb5dfb6c94223852599bc24e3ca6c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:58.144350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.195188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93798a7-0a80-4b01-a159-5dcf036caf92 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:58.207943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:58.286968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:58.287983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.288649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.289205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.292817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51787e9-771a-4f7e-b84a-710ad6565736 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:58.304884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.305300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:58.305892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.306175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.306446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.307625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.308098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.311723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59aa45-f15b-4ff5-816d-b3383dd073e9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.323615 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3705/7435] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:58.336927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3731/7436] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:39:58.339002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.363827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1a71-e502-4933-85a9-571aca0b51cf service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:58.369769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:58.370450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.370722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.370994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] PATH_INFO: `/v3/projects/c9744c2427b2451b80435d02a896836d/users/d00cb5dfb6c94223852599bc24e3ca6c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.381780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9744c2427b2451b80435d02a896836d, user_id=d00cb5dfb6c94223852599bc24e3ca6c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.387602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.415732 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3706/7437] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:39:58 2022] PUT /identity/v3/projects/c9744c2427b2451b80435d02a896836d/users/d00cb5dfb6c94223852599bc24e3ca6c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:39:58.544908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.545221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.545497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.585169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] MFA Rules not processed for user `d00cb5dfb6c94223852599bc24e3ca6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:58.586989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:58.715998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3732/7438] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:58.725786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.727913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:58.796840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:58.799270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:58.891100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24fb95-59bb-4dc4-b0e4-daf915a68e23 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:58.892953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:58.914679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:58.916637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:58.917276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:58.917657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:58.949740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:58.951370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:58.965573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3707/7439] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:39:59.005671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a3792-65fd-4ec4-a52c-6d925c007318 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:59.025653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:59.027772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.029359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.029761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] PATH_INFO: `/v3/projects/bf31f179890e416abf1ffc0336844a43` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.032778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf31f179890e416abf1ffc0336844a43)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:59.038623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:59.103570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:59.106343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:59.139023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0226ff-34f5-4f2f-a1bd-fe91109c1559 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:59.166282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf31f179890e416abf1ffc0336844a43', 'request_id': 'req-b6880081-f7a2-44d0-8973-a10acbde11f8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:59.197171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf31f179890e416abf1ffc0336844a43', 'request_id': 'req-b6880081-f7a2-44d0-8973-a10acbde11f8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:59.216311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf31f179890e416abf1ffc0336844a43', 'request_id': 'req-b6880081-f7a2-44d0-8973-a10acbde11f8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:59.257675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] The token cache is being invalidate because project bf31f179890e416abf1ffc0336844a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:39:59.260517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:59.263737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6880081-f7a2-44d0-8973-a10acbde11f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:39:59.268159 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3733/7440] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:39:58 2022] DELETE /identity/v3/projects/bf31f179890e416abf1ffc0336844a43 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:39:59.278278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.279279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.279279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.319003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:59.319901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.320818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.321324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.326954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:59.356528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:59.358109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:59.504602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:59.506482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07f1fc-651a-43e5-bb42-b485a88dbc32 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:59.513814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:39:59.531192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3708/7441] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:39:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:39:59.540786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.541120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.541341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.544579 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3734/7442] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:59.634566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:39:59.636079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:39:59.693711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3709/7443] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:39:59.695829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:59.721180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b36ad2-841a-4e8a-b918-7c0f4a630db0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:59.741086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:59.742188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.742188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.742188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.742958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:39:59.743189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:59.744816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:39:59.798940 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3735/7444] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:39:59.802513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:39:59.841233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db6e4-1af9-44f3-9a50-bd61918511c5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:39:59.866848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:39:59.867565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:39:59.867845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:39:59.878912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:39:59.879737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:39:59.893630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.038935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:00.055990 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3710/7445] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:39:59 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:00.066022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac28730-4b9e-44d4-ab8d-a36cef04d65b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:00.234891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:00.314527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:00.319400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.321432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.322850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.324768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:00.328020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.391860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3736/7446] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:00 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:00.396511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:00.414417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b025-316c-4d88-bf99-2cf200eecc89 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:00.430405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:00.431417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:00.433228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.433512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.433786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.433983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:00.434442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:00.436289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.484539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121881-0f64-493b-96b4-da6b45f441e1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:00.491393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:00.492190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.492844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.493108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] PATH_INFO: `/v3/users/97a6bfa667354fa9b38c5f606b1d941c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.494508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a6bfa667354fa9b38c5f606b1d941c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:00.496533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.505921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3711/7447] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:00.513347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:00.536782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef97e7-0758-4559-af63-ddf795e89e68 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:00.545512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:00.546502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.547060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.547468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.548343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:00.550320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.570785 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3712/7448] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:00.571885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:00.585242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb0540-16f4-4eed-88db-acef8b248e0e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:00.606023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:00.606926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.607270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.607702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] PATH_INFO: `/v3/projects/34fcbfa72e924213a1dd508b816c63b6/users/1c8c97d8847a42d8ac326d357960facd/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.650639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a6bfa667354fa9b38c5f606b1d941c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:00.650825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fcbfa72e924213a1dd508b816c63b6, user_id=1c8c97d8847a42d8ac326d357960facd, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:00.657776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf5608-7d40-4201-9338-07abddb1f2bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:00.670642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a6bfa667354fa9b38c5f606b1d941c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:00.671425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a6bfa667354fa9b38c5f606b1d941c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:00.684625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a6bfa667354fa9b38c5f606b1d941c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:00.687160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fce09dd6-f284-4d0e-841c-50dc8ea13a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a6bfa667354fa9b38c5f606b1d941c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:00.687680 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3713/7449] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:00 2022] PUT /identity/v3/projects/34fcbfa72e924213a1dd508b816c63b6/users/1c8c97d8847a42d8ac326d357960facd/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:00.700858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.701137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.705603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.761140 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3737/7450] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:00 2022] DELETE /identity/v3/users/97a6bfa667354fa9b38c5f606b1d941c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:40:00.768524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:00.772571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:00.773158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:00.776136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] MFA Rules not processed for user `1c8c97d8847a42d8ac326d357960facd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:00.777983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:00.808891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:00.812526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:00.990343 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3738/7451] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:01.001044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:01.005856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:01.011206 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3714/7452] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:01.021083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:01.028726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:01.218427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd3fe8-2702-4dff-8121-c18e37ba3c08 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:01.232421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:01.234945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:01.235425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:01.235717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:01.258701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:01.270263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64355e-be59-47b9-8a50-bcc8bf3f7c12 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:01.274602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:01.284242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2957bfb-3068-49cf-82c9-3414f18d4ea2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:01.284419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:01.286841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:01.293649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:01.294644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:01.330283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:01.332027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:01.346861 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3715/7453] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:01.347206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3739/7454] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:01.370417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:01.376593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:01.470496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df216-e094-45bb-85dc-c1519e4861ae service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:01.494717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:01.497834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:01.537823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:01.537823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] PATH_INFO: `/v3/users/1c8c97d8847a42d8ac326d357960facd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:01.537823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8c97d8847a42d8ac326d357960facd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:01.537823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:01.562171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:01.711532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8c97d8847a42d8ac326d357960facd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:01.713191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8c97d8847a42d8ac326d357960facd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:01.729107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8c97d8847a42d8ac326d357960facd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:01.729961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8c97d8847a42d8ac326d357960facd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:01.744443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8c97d8847a42d8ac326d357960facd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:01.794366 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3716/7455] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:01 2022] DELETE /identity/v3/users/1c8c97d8847a42d8ac326d357960facd => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:01.796064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:01.796354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:01.796624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:01.834299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:01.835601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:02.101984 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3740/7456] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:02.227845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:02.229864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:02.239939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:02.241404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:02.265531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d52c9-8a80-4884-9d20-c774f3cc1f57 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:02.286543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:02.289235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:02.289532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:02.289901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] PATH_INFO: `/v3/projects/ff46e6ba4baf48b2b9b8baa72331022a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:02.294709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff46e6ba4baf48b2b9b8baa72331022a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:02.298548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:02.463331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff46e6ba4baf48b2b9b8baa72331022a', 'request_id': 'req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:02.481760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff46e6ba4baf48b2b9b8baa72331022a', 'request_id': 'req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:02.489221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff46e6ba4baf48b2b9b8baa72331022a', 'request_id': 'req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:02.512245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] The token cache is being invalidate because project ff46e6ba4baf48b2b9b8baa72331022a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:02.513034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:02.513690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:02.515468 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3741/7457] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:02 2022] DELETE /identity/v3/projects/ff46e6ba4baf48b2b9b8baa72331022a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:40:02.520312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:02.523624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:02.573512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e14a8e-a5ff-4534-a35b-886a5e7966c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:02.812633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20dc1-0245-46ba-b944-cf2e6cc8c3d7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:02.846153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:02.857941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:02.859565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:02.859882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] PATH_INFO: `/v3/users/d00cb5dfb6c94223852599bc24e3ca6c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:02.864689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00cb5dfb6c94223852599bc24e3ca6c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:02.871523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:02.873733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:02.874365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:02.874641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:02.874909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:02.877901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:02.918512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:02.920621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:02.975238 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3717/7458] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:02.981755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:03.044185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00cb5dfb6c94223852599bc24e3ca6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:03.060926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00cb5dfb6c94223852599bc24e3ca6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:03.062679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00cb5dfb6c94223852599bc24e3ca6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:03.083282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00cb5dfb6c94223852599bc24e3ca6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:03.084177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00cb5dfb6c94223852599bc24e3ca6c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:03.127136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3742/7459] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:02 2022] DELETE /identity/v3/users/d00cb5dfb6c94223852599bc24e3ca6c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:04.200083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:04.204971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:04.269323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13b841-7551-428d-b5fe-9ea3723be6d3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:04.432280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:04.462765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:04.464843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:04.464843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:04.464843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] PATH_INFO: `/v3/projects/34fcbfa72e924213a1dd508b816c63b6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:04.465465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fcbfa72e924213a1dd508b816c63b6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:04.467449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:04.584604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:04.587664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:04.644055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a92e43-3487-46ea-9a84-f81cc8497848 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:04.653281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fcbfa72e924213a1dd508b816c63b6', 'request_id': 'req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:04.683294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fcbfa72e924213a1dd508b816c63b6', 'request_id': 'req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:04.716428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fcbfa72e924213a1dd508b816c63b6', 'request_id': 'req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:04.775156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] The token cache is being invalidate because project 34fcbfa72e924213a1dd508b816c63b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:04.777837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:04.785190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4e8c0321-7c5d-4976-a5c9-4fb3ff489789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:04.795519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3718/7460] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:04 2022] DELETE /identity/v3/projects/34fcbfa72e924213a1dd508b816c63b6 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:04.802471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47234-9029-4b52-a643-c2856286f955 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:04.802834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47234-9029-4b52-a643-c2856286f955 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:04.803337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f47234-9029-4b52-a643-c2856286f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:04.816536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:04.826825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:04.831303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:04.834739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] PATH_INFO: `/v3/projects/c9744c2427b2451b80435d02a896836d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:04.841845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9744c2427b2451b80435d02a896836d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:04.852308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:04.868359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33f47234-9029-4b52-a643-c2856286f955 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:04.869626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33f47234-9029-4b52-a643-c2856286f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:04.905422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3719/7461] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:05.093004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9744c2427b2451b80435d02a896836d', 'request_id': 'req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:05.128162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9744c2427b2451b80435d02a896836d', 'request_id': 'req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:05.133013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.133317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.133600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.158131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9744c2427b2451b80435d02a896836d', 'request_id': 'req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:05.221067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] The token cache is being invalidate because project c9744c2427b2451b80435d02a896836d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:05.221285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:05.224160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0bb734c5-e3ea-4cc0-a068-b3599ddbf88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:05.235716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:05.237772 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3743/7462] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:04 2022] DELETE /identity/v3/projects/c9744c2427b2451b80435d02a896836d => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:05.250139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3645fb-fae6-4fdb-96d1-b446dc6e805a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.251047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:05.252619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3645fb-fae6-4fdb-96d1-b446dc6e805a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.254595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3645fb-fae6-4fdb-96d1-b446dc6e805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.356752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6c3645fb-fae6-4fdb-96d1-b446dc6e805a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:05.358740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6c3645fb-fae6-4fdb-96d1-b446dc6e805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:05.437172 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3720/7463] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:05.443451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:05.463808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195978-f733-47fa-99c9-c5d60108b091 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:05.478147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:05.479342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:05.480334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.480705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.481114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.481871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:05.483130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:05.489575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:05.522688 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3721/7464] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:05.526777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:05.552791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25e012-fc28-4f7a-8598-a0ddf82416b9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:05.585692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:05.588889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.590872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.593392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.594285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:05.596589 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3744/7465] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:05.599237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:05.607971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.608250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.608778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.655862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:05.662972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:05.685293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3745/7466] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:05.692320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:05.693614 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3722/7467] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:05.698867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:05.755009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d587-1cbd-4204-a31c-2ac88baff8cf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:05.841321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:05.907539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b609a3-fb52-4c2a-bf19-06e28397ce1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:05.945642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:05.946299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.946591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.947049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.947705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:05.949683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:05.961902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:05.962532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:05.962807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:05.963079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:05.963741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:05.964038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:05.965690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:05.997342 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3723/7469] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:05.997859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:05.998217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3746/7469] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:06.001531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.019628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ad3b-e6d1-4f9b-9d29-414b63dda240 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.024842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3988e5-0fe7-405f-9a94-9c2d1ad18c1c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.031228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.032054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.032337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.032607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.035530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.036292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.038260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.038260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.038260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.038522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.040261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.042186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.056703 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3747/7470] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:06.064354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.082828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ce0b-095b-4fe3-a5c4-cf582e172e20 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.093240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.093885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.094224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.094495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.096180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.100237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.104014 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3724/7471] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:05 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:06.106355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.130495 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3748/7472] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:06.139687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.177653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e31ad8-a55f-42fc-989a-cae6a048fab6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.369895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29d79-c7b2-4889-a4b1-9682643e111e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.383227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.387563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.389978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.391677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.392620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.395234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.396165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.398341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.398786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] PATH_INFO: `/v3/projects/be4b56d7b12146d49dc6ca502ec35d83/users/e3cda318ac99428a86e49e3d056dd93b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.399397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.439978 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3725/7473] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:06 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:06.443888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.454351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4b56d7b12146d49dc6ca502ec35d83, user_id=e3cda318ac99428a86e49e3d056dd93b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.461687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20097ed6-a9f3-4f16-a291-fc26e7db8abd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.467372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.468714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.470004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.470742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.471655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.480300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.480578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3fab6-26fb-41d3-843b-fbabac39da79 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.508755 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3726/7474] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:06.512453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.542822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca0f9-6d02-4a8b-be7c-5df256c456cd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.551563 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3749/7475] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:06 2022] PUT /identity/v3/projects/be4b56d7b12146d49dc6ca502ec35d83/users/e3cda318ac99428a86e49e3d056dd93b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:06.561643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.561976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.562336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.677036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] MFA Rules not processed for user `e3cda318ac99428a86e49e3d056dd93b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:06.680016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:06.702964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:06.751499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.753619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.755196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.755745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.758004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.760494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.777912 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3727/7476] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:06.782576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.803768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead752-b146-4bc1-8cfa-20686a8b7036 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.811310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:06.812014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.812312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.816809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] PATH_INFO: `/v3/projects/6e5c9617462144ba92b45587cd63baf0/users/79ed67ddea594ddb80821bf1e13a4009/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.867295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5c9617462144ba92b45587cd63baf0, user_id=79ed67ddea594ddb80821bf1e13a4009, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:06.871687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d2469-1f4d-4c87-aab9-1a8b2cc2cc14 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:06.883258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:06.902861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3750/7477] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:06.908085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:06.913062 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3728/7478] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:06 2022] PUT /identity/v3/projects/6e5c9617462144ba92b45587cd63baf0/users/79ed67ddea594ddb80821bf1e13a4009/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:06.925131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:06.925423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:06.925698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:06.949829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c0b0a-7d6c-4770-b0cb-d6353c179ad4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:06.995081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] MFA Rules not processed for user `79ed67ddea594ddb80821bf1e13a4009`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:06.996503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:07.155771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.157433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.161291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.161826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.162694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.166107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.175458 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3729/7479] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:07.183864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.186318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:07.256366 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3751/7480] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:07.260812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.345513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694652-3060-4938-8005-b13ad80eda5d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.391044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a1a17-0cbb-4200-88b6-a5bb316d0556 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.402775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.404116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.405308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.405696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.409018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.417779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.472080 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3752/7481] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:07 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:07.475547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.482997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.485810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.487577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.489331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.502084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be613c02-a816-465d-9284-8680ced0e6fe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.515582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.517501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.518023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.518393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.520441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.525566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.552057 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3753/7482] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:07.558786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.590449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2281e0-c033-4e0b-ade9-b1ede87a9e39 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.603510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.606569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.606980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.609612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] PATH_INFO: `/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597/users/1a0295951bd54cdba53414a1cb20e08c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.619550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:07.638467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:07.641562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.644007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.656600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cab82ccc2b644dca9fc6d76ea2ee597, user_id=1a0295951bd54cdba53414a1cb20e08c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.664551 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3730/7483] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:07.670300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.700216 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3754/7484] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:07 2022] PUT /identity/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597/users/1a0295951bd54cdba53414a1cb20e08c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:07.704058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.726415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bc637-e9dc-4775-9316-a85b72f9438a service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.846337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.848476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.849208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.849761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.852647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.857736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184987bc-5ce1-4540-a42d-523b7f2c51ce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.882091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3731/7485] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:07.886097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:07.904979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cedc90-54ba-4c69-89d5-6f6ce1fbb873 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:07.922570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:07.923572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.923947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.924322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] PATH_INFO: `/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597/users/1a0295951bd54cdba53414a1cb20e08c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:07.931648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cab82ccc2b644dca9fc6d76ea2ee597, user_id=1a0295951bd54cdba53414a1cb20e08c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:07.941789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:07.970053 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3755/7486] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:07 2022] PUT /identity/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597/users/1a0295951bd54cdba53414a1cb20e08c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:07.983063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:07.984676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:07.985791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:08.113288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] MFA Rules not processed for user `1a0295951bd54cdba53414a1cb20e08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:08.114733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:08.452957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3732/7487] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:08.458448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:08.460318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:08.617880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf1394-8e96-4918-b85c-3b249472fe8a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:08.631066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:08.631706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:08.631986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:08.632261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:08.657803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:08.659673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:08.693301 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3756/7488] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:08.821641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:08.843554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1b0f2-fa56-4665-b86b-21ae04a0b932 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:08.854886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:08.855664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:08.856047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:08.856421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:09.033959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:09.036305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c51e62-9d50-4a98-9713-d6e11ad296ff service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:09.065817 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3733/7489] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:11.044517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:11.046171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:11.247159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faca8d4-c20d-4b9c-b8ec-837af3388452 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:11.260811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:11.262364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:11.263522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:11.265265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] PATH_INFO: `/v3/users/c5f901c60698456cabd5cf4c95caddac` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:11.269844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f901c60698456cabd5cf4c95caddac)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:11.275053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:11.382119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f901c60698456cabd5cf4c95caddac'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:11.402553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f901c60698456cabd5cf4c95caddac'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:11.403564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f901c60698456cabd5cf4c95caddac'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:11.421826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f901c60698456cabd5cf4c95caddac'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:11.424085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f901c60698456cabd5cf4c95caddac'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:11.471806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:11.505032 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3757/7490] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:11 2022] DELETE /identity/v3/users/c5f901c60698456cabd5cf4c95caddac => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:11.509526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:11.509967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:11.510131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:11.550818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:11.552100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:11.576672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:11.729361 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3734/7491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:11.741018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:11.742543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:11.884847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cbc4-0fb9-47e4-b788-ab494defc8c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:11.895613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:11.896488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:11.896880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:11.897753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:11.923115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:11.924879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ffc22-5d87-4b51-baf6-0690161db5d8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:11.956612 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3758/7492] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:12.438526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:12.440631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:12.468785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a8c1-d935-44de-a3fb-e1dc2d623d26 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:12.493855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:12.494780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:12.495353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:12.496461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] PATH_INFO: `/v3/projects/ee9a12e7cd6f47c8a548bcba06da3912` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:12.498333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9a12e7cd6f47c8a548bcba06da3912)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:12.501326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:12.598455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9a12e7cd6f47c8a548bcba06da3912', 'request_id': 'req-eab1ef08-c77d-4262-86dc-42fd7037d87d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:12.612353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9a12e7cd6f47c8a548bcba06da3912', 'request_id': 'req-eab1ef08-c77d-4262-86dc-42fd7037d87d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:12.622068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9a12e7cd6f47c8a548bcba06da3912', 'request_id': 'req-eab1ef08-c77d-4262-86dc-42fd7037d87d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:12.650706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] The token cache is being invalidate because project ee9a12e7cd6f47c8a548bcba06da3912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:12.653301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:12.654357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-eab1ef08-c77d-4262-86dc-42fd7037d87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:12.657817 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3735/7493] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:12 2022] DELETE /identity/v3/projects/ee9a12e7cd6f47c8a548bcba06da3912 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:12.664632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:12.665792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:12.666703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:12.699742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:12.702698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:12.900264 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3759/7494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:12.903843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:12.904123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:12.904386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:12.937923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:12.940057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:12.959149 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3736/7495] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:12.965846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:12.984578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6fc7c-fdd8-4f26-9f5b-329fa58fc058 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:12.997754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:12.998726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:12.999164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:12.999584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.000853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:13.001637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.009223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.039092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3760/7496] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:13.043772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.058254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18534c9d-245e-4a4e-8446-86c7a7edaae9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.073223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.073843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.074145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.074877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.075541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.077591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.168746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3737/7497] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:13 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:13.172927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.188794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3947d-9f4d-43c9-b1de-206a1c6ab233 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.331679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.332649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.333170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.333610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.334303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.338134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.417090 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3761/7498] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:13 2022] POST /identity/v3/users => generated 280 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:13.421032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.441567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458efbc-03de-4f89-b6ab-7c8e1ee6f0ab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.446732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.447628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.447905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.448249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.449436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.451448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.479014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.481134 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3738/7499] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:13.506719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c584c80-bce8-42d1-8252-2628a2f4715d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.519051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.519846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.520237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.520633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.521441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.525482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5a5fb-4717-4987-8138-deeba04ae7b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.554936 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3762/7500] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:13.555260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.570662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d2266-b327-4f0d-99a4-e06d64173aaf admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.583847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.584725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.587826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.588336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] PATH_INFO: `/v3/projects/b1ac1ceadabf446c888a36f0f8276f93/users/6622f51b810a48758cfa706f36be94fb/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.615092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ac1ceadabf446c888a36f0f8276f93, user_id=6622f51b810a48758cfa706f36be94fb, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:13.618658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:13.641826 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3739/7501] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:13 2022] PUT /identity/v3/projects/b1ac1ceadabf446c888a36f0f8276f93/users/6622f51b810a48758cfa706f36be94fb/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:13.653493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.654182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.654733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:13.667510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:13.707609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] MFA Rules not processed for user `6622f51b810a48758cfa706f36be94fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:13.709520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:13.850068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3763/7502] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:13.858253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:13.861360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:13.950949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:13.990660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f22dba-ae99-49fd-86bd-1f5c70dbbb32 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:13.994516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:13.995137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:13.995673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:13.995953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:14.008522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:14.010124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:14.021878 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3740/7503] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:18.659132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:18.660787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:18.822540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:18.824065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:18.871167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659f845-b12a-4d80-b9eb-ed372960eabe service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:18.909943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:18.910837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:18.911278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:18.911669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:18.919570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:19.005430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6802-f1db-405a-beab-d6cf97bec08d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:19.029891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:19.030891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:19.031865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:19.034716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:19.039131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:19.090697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:19.099391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:19.178422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3764/7504] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:19.223185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:19.224669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:19.279052 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3741/7505] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:22.643601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:22.645135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:22.877103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:22.882801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:22.899990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e43e-6ed4-4b36-8602-140674eabc8f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:22.908143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9249-cd1f-4ef8-b475-b986697ad552 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:22.913171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:22.915211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:22.916031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:22.916165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:22.916467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:22.916760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] PATH_INFO: `/v3/users/915977a496684229bc212e6bbfa591c8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:22.917193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:22.917634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:22.920352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:22.924221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915977a496684229bc212e6bbfa591c8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:22.934490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:22.972569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:23.136867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915977a496684229bc212e6bbfa591c8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:23.138776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915977a496684229bc212e6bbfa591c8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:23.161713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:23.175704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140639ae-95b1-4b80-86bd-f0d6ac6bdca4 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:23.181281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915977a496684229bc212e6bbfa591c8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:23.183097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915977a496684229bc212e6bbfa591c8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:23.204968 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3765/7506] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:40:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:40:23.229330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915977a496684229bc212e6bbfa591c8'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:23.385330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3742/7507] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:22 2022] DELETE /identity/v3/users/915977a496684229bc212e6bbfa591c8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:23.387148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:23.387737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:23.388177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:23.460520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:23.461927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:23.732808 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3766/7508] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:23.773609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:23.776518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:23.962362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:24.025876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c1cb-7941-4233-a8f3-0dd09c31f401 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:24.041013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:24.042058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:24.042580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:24.043062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:24.063072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:24.065138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516905b-f050-4fc3-9dec-ac6a8583a859 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:24.084794 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3743/7509] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:25.549617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:25.552073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:25.571654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05aa3-8f80-43b9-97fa-38c420fe3dd9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:25.588312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:25.590368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:25.590938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:25.591648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] PATH_INFO: `/v3/projects/703c2532c1fe400690f74285bbe9716e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:25.593203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703c2532c1fe400690f74285bbe9716e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:25.625675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:25.804629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703c2532c1fe400690f74285bbe9716e', 'request_id': 'req-46db3ce9-5888-4e73-9196-a7cf6c38f411'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:25.824834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703c2532c1fe400690f74285bbe9716e', 'request_id': 'req-46db3ce9-5888-4e73-9196-a7cf6c38f411'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:25.849110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703c2532c1fe400690f74285bbe9716e', 'request_id': 'req-46db3ce9-5888-4e73-9196-a7cf6c38f411'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:25.917770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] The token cache is being invalidate because project 703c2532c1fe400690f74285bbe9716e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:25.918022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:25.920608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46db3ce9-5888-4e73-9196-a7cf6c38f411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:25.928492 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3767/7510] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:25 2022] DELETE /identity/v3/projects/703c2532c1fe400690f74285bbe9716e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:25.933231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:25.934318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:25.934776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:25.990610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:25.993075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:26.173752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3744/7511] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:26.178623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:26.179070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:26.179446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:26.222731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:26.224423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:26.260537 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3768/7512] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:26.264719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:26.289710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad79e-8090-4378-b761-560cbaa9fce7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:26.334314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:26.339188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:26.339503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:26.339746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:26.342854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:26.343327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:26.349120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:26.388887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3745/7513] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:26.404643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:26.429958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3091b6-9b18-4909-b9d1-de1f16d0d6d8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:26.441286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:26.445219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:26.447524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:26.447928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:26.462008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:26.485899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:26.577640 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3769/7514] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:26 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:26.581705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:26.603909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643f1ad-a759-4a42-b1a3-0f2604bde544 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:26.794666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:26.795735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:26.796145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:26.802324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:26.803678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:26.809567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:26.910083 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3746/7515] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:26 2022] POST /identity/v3/users => generated 295 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:26.913880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:26.932234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207d9e2-e213-435d-8db6-6307010fc3f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:26.952533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:26.957721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:26.959050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:26.960653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:26.961523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:26.969275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.017298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:27.019200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:27.019344 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3770/7516] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:27.026398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:27.044428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cd105-8b0a-4dc1-9f6c-5454d47c573b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:27.050455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652429-7d60-45d1-9697-1240c6032608 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:27.060049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:27.060749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.061056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.061332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] PATH_INFO: `/v3/users/79ed67ddea594ddb80821bf1e13a4009` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.064081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ed67ddea594ddb80821bf1e13a4009)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:27.064780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:27.065447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.065726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.066017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.067610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.068122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:27.076569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.082289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:27.110161 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3771/7517] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:27.115311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:27.135346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefbf8a-d633-4f9e-be80-0b1a23173152 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:27.144618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:27.145848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.151273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.151763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] PATH_INFO: `/v3/projects/c258682c06904cf290ba9aa55fcbbe73/users/d528bd56e90c4d6babf2b7c340c2b623/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.193418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ed67ddea594ddb80821bf1e13a4009'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:27.195178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ed67ddea594ddb80821bf1e13a4009'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:27.207193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c258682c06904cf290ba9aa55fcbbe73, user_id=d528bd56e90c4d6babf2b7c340c2b623, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:27.211787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40c72a-cc7e-4988-a698-885dd88bbee5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.222348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ed67ddea594ddb80821bf1e13a4009'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:27.223707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ed67ddea594ddb80821bf1e13a4009'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:27.231590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:27.243209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e95a8d8a-9bd7-482c-85db-b5d1c3d2b255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ed67ddea594ddb80821bf1e13a4009'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:27.253732 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3772/7518] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:27 2022] PUT /identity/v3/projects/c258682c06904cf290ba9aa55fcbbe73/users/d528bd56e90c4d6babf2b7c340c2b623/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:27.269639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.270011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.270355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.298753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3747/7519] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:27 2022] DELETE /identity/v3/users/79ed67ddea594ddb80821bf1e13a4009 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:27.304714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.305117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.305429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.371480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] MFA Rules not processed for user `d528bd56e90c4d6babf2b7c340c2b623`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:27.372939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:27.389704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:27.391674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:27.555306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3748/7520] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:27.592188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:27.594290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:27.606539 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3773/7521] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:27.620399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:27.621596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:27.752391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29bd84-7d16-440d-9963-b61b91188a9f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:27.764304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5cf1a-fe1e-4529-b4fb-683a3f379a4d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:27.767458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:27.768097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.768372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.768657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.769150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:27.769890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:27.770176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:27.770446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:27.799338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:27.800571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:27.804103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ce0b-f985-46b2-be51-59d020be9a2f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.807117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:27.830440 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3774/7522] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:27.849086 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3749/7523] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:28.832726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:28.835880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:28.900023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaf57-8d2c-4cde-99ac-bf94f5a7ef74 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:28.917115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:28.919523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:28.920011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:28.920812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] PATH_INFO: `/v3/projects/6e5c9617462144ba92b45587cd63baf0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:28.924931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5c9617462144ba92b45587cd63baf0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:28.928403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:29.058733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5c9617462144ba92b45587cd63baf0', 'request_id': 'req-8e425a68-f5c4-4267-9b35-78f310041630'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:29.086948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5c9617462144ba92b45587cd63baf0', 'request_id': 'req-8e425a68-f5c4-4267-9b35-78f310041630'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:29.095830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:29.100414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5c9617462144ba92b45587cd63baf0', 'request_id': 'req-8e425a68-f5c4-4267-9b35-78f310041630'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:29.133390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] The token cache is being invalidate because project 6e5c9617462144ba92b45587cd63baf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:29.134014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:29.136384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8e425a68-f5c4-4267-9b35-78f310041630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:29.141579 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3775/7524] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:28 2022] DELETE /identity/v3/projects/6e5c9617462144ba92b45587cd63baf0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:29.147062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.148250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.148703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.195693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:29.197615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:29.366765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3750/7525] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:29.377493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.378092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.378435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.434484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:29.435904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:29.460572 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3776/7526] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:29.464943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:29.486036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4667a0-0fdb-47a7-99c2-9112760f4c44 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:29.504439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:29.505287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.505575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.505864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.506874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:29.507201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:29.511018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:29.554282 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3751/7527] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:29.556444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:29.574886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac56a53-4e5b-4730-9322-f5cc71f1c1f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:29.582709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:29.583638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.584034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.584490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.585185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:29.587435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:29.647724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:29.650896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:29.672615 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3777/7528] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:29 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:29.675226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:29.683643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f514c7-676b-4a11-ba93-8ed4d5902cb8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:29.693052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:29.852879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5794a-7329-4391-b687-faffbcd51f63 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:29.871306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:29.872298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.872727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.873320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.879236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:29.884964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:29.897966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:29.898712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:29.899118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:29.899605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] PATH_INFO: `/v3/users/e3cda318ac99428a86e49e3d056dd93b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:29.903007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cda318ac99428a86e49e3d056dd93b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:29.905203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:29.974593 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3778/7529] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:29 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:29.975730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:30.003941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99248-c560-4273-ad76-3254a5036fe9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:30.022808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:30.024342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.024784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.025376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.026192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:30.027986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:30.055591 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3779/7530] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:30.062694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:30.090744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f115d-f65d-4402-87dc-1ef91f0fb528 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:30.107997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:30.109297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.112299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.112729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.115559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:30.120417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:30.136080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cda318ac99428a86e49e3d056dd93b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:30.139678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cda318ac99428a86e49e3d056dd93b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:30.153540 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3780/7531] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:30.154904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:30.164065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cda318ac99428a86e49e3d056dd93b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:30.164864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cda318ac99428a86e49e3d056dd93b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:30.187186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-403e86d0-0e6a-482c-a181-260474b471f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cda318ac99428a86e49e3d056dd93b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:30.190672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640775e-504e-41fa-823f-69f5317095f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:30.203683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:30.204762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.205267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.205697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] PATH_INFO: `/v3/projects/dd133cec4ca14729a6dd03a36ba5a7af/users/e4dd2c3b9b684160aa8511d85b5ec446/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.230635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3752/7532] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:29 2022] DELETE /identity/v3/users/e3cda318ac99428a86e49e3d056dd93b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:30.232761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54aff-5810-4380-9385-a4958adc597b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.233863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54aff-5810-4380-9385-a4958adc597b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.234189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54aff-5810-4380-9385-a4958adc597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.249342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd133cec4ca14729a6dd03a36ba5a7af, user_id=e4dd2c3b9b684160aa8511d85b5ec446, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:30.258347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486db3d0-3544-43d4-906f-6848d3521e72 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:30.294624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3781/7533] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:30 2022] PUT /identity/v3/projects/dd133cec4ca14729a6dd03a36ba5a7af/users/e4dd2c3b9b684160aa8511d85b5ec446/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:30.297825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.299549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.299900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.317397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-19a54aff-5810-4380-9385-a4958adc597b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:30.322730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19a54aff-5810-4380-9385-a4958adc597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:30.345198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:30.348750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:30.493404 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3753/7534] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:30.517348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54aff-5810-4380-9385-a4958adc597b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:30.518865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-19a54aff-5810-4380-9385-a4958adc597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:30.585960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:30.602179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3782/7535] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:30.611299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:30.613329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:30.619705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:30.651042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54aff-5810-4380-9385-a4958adc597b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:30.665589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:30.676079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.678369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.679296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.701964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:30.705801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:30.739650 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3754/7536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:30.762444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240704-9887-4b2e-be26-5cacfa1ea769 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:30.809726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:30.811339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:30.813492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:30.813935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:30.836141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:30.842600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:30.866466 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3783/7537] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:31.943181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:31.949736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:31.977634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d701-86ff-4595-bdf1-651ed70f9c1f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:31.984269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:31.985304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:31.987763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:31.988729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] PATH_INFO: `/v3/projects/be4b56d7b12146d49dc6ca502ec35d83` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:31.992225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4b56d7b12146d49dc6ca502ec35d83)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:31.995936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:32.097159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4b56d7b12146d49dc6ca502ec35d83', 'request_id': 'req-947f112e-6f59-4e21-a47e-beb290921d0b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.107089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4b56d7b12146d49dc6ca502ec35d83', 'request_id': 'req-947f112e-6f59-4e21-a47e-beb290921d0b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.119818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4b56d7b12146d49dc6ca502ec35d83', 'request_id': 'req-947f112e-6f59-4e21-a47e-beb290921d0b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.150984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] The token cache is being invalidate because project be4b56d7b12146d49dc6ca502ec35d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:32.152702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.155441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-947f112e-6f59-4e21-a47e-beb290921d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.166052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:32.167159 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3755/7538] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:31 2022] DELETE /identity/v3/projects/be4b56d7b12146d49dc6ca502ec35d83 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:32.177760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14914aa6-8c3d-4108-be38-b216d5d64b66 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:32.314283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:32.314943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:32.315223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:32.315496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] PATH_INFO: `/v3/users/1a0295951bd54cdba53414a1cb20e08c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:32.316669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0295951bd54cdba53414a1cb20e08c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:32.318790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:32.404314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0295951bd54cdba53414a1cb20e08c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.425818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0295951bd54cdba53414a1cb20e08c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.427822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0295951bd54cdba53414a1cb20e08c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.453409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0295951bd54cdba53414a1cb20e08c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.455163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0295951bd54cdba53414a1cb20e08c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:32.502644 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3784/7539] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:32 2022] DELETE /identity/v3/users/1a0295951bd54cdba53414a1cb20e08c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:40:33.029294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:33.030146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:33.031321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:33.101205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] MFA Rules not processed for user `e4dd2c3b9b684160aa8511d85b5ec446`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:33.102948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:33.305657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3756/7540] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:33.340860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:33.342533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:33.435692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:33.509224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7901-b9b4-4e9c-82ec-e58189275b5a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:33.522954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:33.524105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:33.524632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:33.525174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:33.547016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:33.559169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308675f-a6de-460c-af96-4ed532946dff service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:33.584545 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3785/7541] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:33.729966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:33.731838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:33.915706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:33.976356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc2ebe-4b64-410c-ae63-3159bddacbf8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:34.004908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:34.005740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.006021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.006401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] PATH_INFO: `/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.007470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cab82ccc2b644dca9fc6d76ea2ee597)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:34.010614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:34.172566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cab82ccc2b644dca9fc6d76ea2ee597', 'request_id': 'req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.193252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cab82ccc2b644dca9fc6d76ea2ee597', 'request_id': 'req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.212479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cab82ccc2b644dca9fc6d76ea2ee597', 'request_id': 'req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.238812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] The token cache is being invalidate because project 6cab82ccc2b644dca9fc6d76ea2ee597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:34.239684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.241102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.263969 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3757/7542] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:33 2022] DELETE /identity/v3/projects/6cab82ccc2b644dca9fc6d76ea2ee597 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:34.265613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29022-6bd6-41d7-9f00-a83516672bc9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.266373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29022-6bd6-41d7-9f00-a83516672bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.271825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce29022-6bd6-41d7-9f00-a83516672bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.353737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0ce29022-6bd6-41d7-9f00-a83516672bc9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:34.356439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0ce29022-6bd6-41d7-9f00-a83516672bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:34.537715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:34.540292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:34.563313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3786/7543] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:34.570684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.571104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.571589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.573767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2fe9-13d5-4527-9cd1-9a51051dd8e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:34.585706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:34.586634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.587101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.587582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] PATH_INFO: `/v3/users/6622f51b810a48758cfa706f36be94fb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.605460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6622f51b810a48758cfa706f36be94fb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:34.607985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:34.667318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:34.671740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:34.696744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3787/7544] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:34.699913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:34.717500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6622f51b810a48758cfa706f36be94fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.719292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6622f51b810a48758cfa706f36be94fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.727566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051a82-ca72-43a0-9b62-c2f3deb593a6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:34.752508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:34.753188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.753791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.764254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6622f51b810a48758cfa706f36be94fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.764694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.769037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6622f51b810a48758cfa706f36be94fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.769594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:34.769911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:34.771925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:34.782532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-196e5da2-c718-49a8-bba4-193ca8d7d30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6622f51b810a48758cfa706f36be94fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:34.806532 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3788/7545] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:34.811107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:34.817129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:34.850620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673758-d5b8-4107-a5ee-b47926c2dd44 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:34.866496 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3758/7546] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:34 2022] DELETE /identity/v3/users/6622f51b810a48758cfa706f36be94fb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:40:34.868835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:34.869669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.869954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.870695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:34.870989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:34.871126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.871266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:34.871671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:34.878356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:34.925132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:34.926563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:34.959568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3789/7547] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:34 2022] POST /identity/v3/projects => generated 355 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:34.964221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.050647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:35.075173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbef613-47b7-4249-b945-fa15076b9652 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.084739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.085625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.085912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.086190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.087130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.089206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.096137 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3759/7548] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:35.103633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.105456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:35.146788 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3790/7549] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:34 2022] POST /identity/v3/users => generated 278 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:35.152061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.174677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c25260-4cac-4ec3-9ea3-b718633847e9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.185134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.185871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.186151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.186460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.190006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.194888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.220378 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3791/7550] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:35.225222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.240290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:35.248420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc247-213c-4094-81ff-f406dd0c5cdb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.261823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.262460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.262742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.263295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.263967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.268810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.285041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e937fa-f51a-48cc-be63-590421af1ed1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.288920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3792/7551] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:35.293305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.320981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f0661-7fe9-423d-b228-19c509a8ebd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.334989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.335683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.335962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.336233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] PATH_INFO: `/v3/projects/6b26e1446e594e8e9e80ec3a294eb807/users/1ec7e8c046664d5ab406d1e0e62d1308/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.378518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b26e1446e594e8e9e80ec3a294eb807, user_id=1ec7e8c046664d5ab406d1e0e62d1308, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.391948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3adc-ad21-40d3-9bb7-c126b65b772f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.422159 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3793/7552] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:35 2022] PUT /identity/v3/projects/6b26e1446e594e8e9e80ec3a294eb807/users/1ec7e8c046664d5ab406d1e0e62d1308/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:35.433466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.434032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.434482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.461312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.462090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.462483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.462901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.507105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.508880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] MFA Rules not processed for user `1ec7e8c046664d5ab406d1e0e62d1308`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:35.510000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.511035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:35.584246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3760/7553] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:35.585909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.587722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:35.605128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b243-9fa8-46f0-a8e8-0fb63ea40ea5 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.676557 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3794/7554] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:35.677773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:35.840150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afb6bc-dafe-4089-834d-2635f1e74777 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:35.846233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.847055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.847526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.847890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] PATH_INFO: `/v3/users/4064b8b6e24149d48f3ab0699e61c175` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.852673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4064b8b6e24149d48f3ab0699e61c175)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.859203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.859891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:35.860545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:35.860827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:35.861128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:35.861782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:35.863886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:35.922931 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3795/7555] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:35 2022] POST /identity/v3/projects => generated 357 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:35.926630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.031045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:36.036828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4064b8b6e24149d48f3ab0699e61c175'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.037773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4064b8b6e24149d48f3ab0699e61c175'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.054604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4064b8b6e24149d48f3ab0699e61c175'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.055897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4064b8b6e24149d48f3ab0699e61c175'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.060622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:36.084052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4064b8b6e24149d48f3ab0699e61c175'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.132448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690fbc3-b978-45de-b31e-ba4007364b0e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.141273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.142280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.142715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.143258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.144271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.146421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.171955 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3761/7556] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:35 2022] DELETE /identity/v3/users/4064b8b6e24149d48f3ab0699e61c175 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:36.173236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.176267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.212112 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3796/7557] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:35 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:36.217201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.222362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.252171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691c222-6dbb-4e93-b315-323a872d1fb3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.289951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4ec1-58ff-4667-bf6b-cfdb9b948c88 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.296925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.297720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.298042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.298311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] PATH_INFO: `/v3/projects/b1ac1ceadabf446c888a36f0f8276f93` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.299640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ac1ceadabf446c888a36f0f8276f93)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.304090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.373653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ac1ceadabf446c888a36f0f8276f93', 'request_id': 'req-151290c4-61a6-4a9d-9c43-1379bc19a2d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.384506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ac1ceadabf446c888a36f0f8276f93', 'request_id': 'req-151290c4-61a6-4a9d-9c43-1379bc19a2d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.395168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.396643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.398629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.399030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ac1ceadabf446c888a36f0f8276f93', 'request_id': 'req-151290c4-61a6-4a9d-9c43-1379bc19a2d0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.399395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.401229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.403994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.431034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] The token cache is being invalidate because project b1ac1ceadabf446c888a36f0f8276f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:36.431034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.431034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-151290c4-61a6-4a9d-9c43-1379bc19a2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.431480 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3797/7558] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:40:36.431588 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3762/7559] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:36 2022] DELETE /identity/v3/projects/b1ac1ceadabf446c888a36f0f8276f93 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:36.431672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.431672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.447862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.447862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.447862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.459822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aba02-aaa7-44dc-ac8f-4159dea7a49d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.490767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:36.493371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.562871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:36.568111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.569022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.569383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.569735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] PATH_INFO: `/v3/projects/71499305faa14b7a8d6090e912ab71c7/users/cfb262710b1347c19302424d6adae13b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.584407 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3763/7560] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:36.590388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.592676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.595619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71499305faa14b7a8d6090e912ab71c7, user_id=cfb262710b1347c19302424d6adae13b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.598870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cfbcc-a6b4-496e-9695-e5c9d0ebf245 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.607254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73481e0-6a70-4526-90a1-efb5b54bbe9c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.615293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3798/7561] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:36 2022] PUT /identity/v3/projects/71499305faa14b7a8d6090e912ab71c7/users/cfb262710b1347c19302424d6adae13b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:36.616875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.617250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.617646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.641722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:36.642964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.693299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.697634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.697634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.697634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] PATH_INFO: `/v3/projects/ba79606e524741829336d54b9d93ea63` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.699802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba79606e524741829336d54b9d93ea63)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.701898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.725817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:36.746865 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3799/7562] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:36.749635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.762453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198de61-6ab8-48e2-8800-4702351e4984 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.812967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba79606e524741829336d54b9d93ea63', 'request_id': 'req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.839043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba79606e524741829336d54b9d93ea63', 'request_id': 'req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.849349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.850318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.850677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.851042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.852245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.854512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.871124 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3800/7563] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:36.872147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.875158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba79606e524741829336d54b9d93ea63', 'request_id': 'req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.884526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d89ee9-2622-4b26-813a-5c408b6da2be admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.901117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.901117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.901117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.901117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.901491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:36.901491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:36.901491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:36.947298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] The token cache is being invalidate because project ba79606e524741829336d54b9d93ea63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:36.947883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.948696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:36.950502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3764/7564] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:36 2022] DELETE /identity/v3/projects/ba79606e524741829336d54b9d93ea63 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:36.951416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:36.962370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:36.983640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c56132-1dbe-41e1-bcd7-0b99ee2858ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:36.991105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:36.992175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:36.992685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:36.993228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] PATH_INFO: `/v3/projects/71499305faa14b7a8d6090e912ab71c7/users/cfb262710b1347c19302424d6adae13b/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:36.996863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71499305faa14b7a8d6090e912ab71c7, user_id=cfb262710b1347c19302424d6adae13b, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.002879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b566c-a1a1-4b4b-98f7-49424e40cc15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.022428 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3765/7565] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:36 2022] PUT /identity/v3/projects/71499305faa14b7a8d6090e912ab71c7/users/cfb262710b1347c19302424d6adae13b/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:37.024408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43119c3-4781-4b18-bc75-fa8b2e08c53d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.025082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43119c3-4781-4b18-bc75-fa8b2e08c53d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.026086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43119c3-4781-4b18-bc75-fa8b2e08c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.057289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d43119c3-4781-4b18-bc75-fa8b2e08c53d None None] MFA Rules not processed for user `e4dd2c3b9b684160aa8511d85b5ec446`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:37.058520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d43119c3-4781-4b18-bc75-fa8b2e08c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.088652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3801/7566] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:37.089655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.093995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.111934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1bfc-7c0a-4cef-a74f-10a689c9c399 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.133869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3766/7567] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:37.138266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.138266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.138266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.182872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] MFA Rules not processed for user `cfb262710b1347c19302424d6adae13b`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:37.184385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.197586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:37.249668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.250556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.250831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.251144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] PATH_INFO: `/v3/users/8413a8725d6d4561ae3a851486c29a69` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.253507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413a8725d6d4561ae3a851486c29a69)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.255440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.315588 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3767/7568] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:37.322033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.322033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.326721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413a8725d6d4561ae3a851486c29a69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:37.341313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413a8725d6d4561ae3a851486c29a69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:37.342309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413a8725d6d4561ae3a851486c29a69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:37.361352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c399f7-9703-4db4-a3c1-65ca9f42bc52 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.365446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413a8725d6d4561ae3a851486c29a69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:37.366913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413a8725d6d4561ae3a851486c29a69'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:37.369711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.370444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.370791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.371132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.371856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.373951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.384385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:37.396240 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3802/7569] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:37 2022] DELETE /identity/v3/users/8413a8725d6d4561ae3a851486c29a69 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:37.397986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.400325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.453900 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3768/7570] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:37 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:37.455433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.459624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.574990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fbd17-4983-4a6c-876b-05c9cd4db19b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.672805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999c9ab-9965-4f0c-9531-6a1bd65fbfac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.688706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.689441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.689989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.690104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.690755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.693556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.705223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.706111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.706815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.707233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.710951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.724879 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3769/7571] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:37 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:37.728980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.755447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dba8-c8b7-4134-a3d9-3b0d868640bb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.766315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.771555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.771810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.772051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.772729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.774946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.788033 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3770/7572] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:40:37.792209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.817072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f4a78-a75b-4d2c-986e-5cbeb2815956 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.825303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.825649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.827966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.828091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.828293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.828552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.829222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.835827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:37.844067 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3803/7573] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:37.845143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.852399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:37.918656 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3771/7574] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:37.927643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:37.959269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcec98-37d0-4dc2-9235-dd1aaeeff72b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:37.964980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:37.967284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:37.967619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:37.968504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] PATH_INFO: `/v3/projects/ca4729e6e4bb4c95baa0db113450ea07/users/3aad5538ba304b9ab8694f5b04b493b8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:37.995665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4729e6e4bb4c95baa0db113450ea07, user_id=3aad5538ba304b9ab8694f5b04b493b8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:37.999797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.008889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e564b-532a-4ca6-9ff3-fb6038c69636 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.013204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.013719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.013991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.014262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.018890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.027285 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3772/7575] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:37 2022] PUT /identity/v3/projects/ca4729e6e4bb4c95baa0db113450ea07/users/3aad5538ba304b9ab8694f5b04b493b8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:38.031805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.031805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.041545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.043177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.055700 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3804/7576] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:38.056923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.060705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:38.065448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:38.076530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4b4e3-de8a-4873-afdb-007a26a8bcee service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.136720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560266b-2ae7-46a8-b1ee-4ece8469cdfe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.151551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.152199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.152473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.152740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] PATH_INFO: `/v3/projects/92905cba15d146cfbf6b9a73ffe13778` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.153919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92905cba15d146cfbf6b9a73ffe13778)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.156178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.158046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.159762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.160228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.160648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.164664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.224496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92905cba15d146cfbf6b9a73ffe13778', 'request_id': 'req-784f60ce-9c66-40d4-9018-bf3876198232'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:38.237898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92905cba15d146cfbf6b9a73ffe13778', 'request_id': 'req-784f60ce-9c66-40d4-9018-bf3876198232'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:38.269651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92905cba15d146cfbf6b9a73ffe13778', 'request_id': 'req-784f60ce-9c66-40d4-9018-bf3876198232'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:38.278598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.280057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb9378-1039-4c94-ad6b-5b57d852c18a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.291075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] The token cache is being invalidate because project 92905cba15d146cfbf6b9a73ffe13778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:38.291448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:38.293747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-784f60ce-9c66-40d4-9018-bf3876198232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:38.295406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3773/7577] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:38 2022] DELETE /identity/v3/projects/92905cba15d146cfbf6b9a73ffe13778 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:38.298636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.298843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.299103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.311071 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3805/7578] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:38.313914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6ba59-1b20-4fa7-a7b2-fb46add0cb59 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.314020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6ba59-1b20-4fa7-a7b2-fb46add0cb59 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.314601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6ba59-1b20-4fa7-a7b2-fb46add0cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.336840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:38.337627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.359411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d9a6ba59-1b20-4fa7-a7b2-fb46add0cb59 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:38.361186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d9a6ba59-1b20-4fa7-a7b2-fb46add0cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.484647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3774/7579] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:38.495565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.497976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.508381 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3806/7580] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:38.544631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.544631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.544631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.601435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:38.605798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:38.634391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3807/7581] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:38.651354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.674178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e544a-d2da-4c40-9faf-f864bbabee19 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.686708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.690636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.691427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.691999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.693104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:38.693478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.695164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.699460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd960e5-d1a5-4879-86f5-8e782783bdc6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.713048 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3808/7582] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:40:38.713222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.713222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.713222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.713222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.715729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.727646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:38.732054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.734366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c76d-6f2c-477d-8d57-3de7148dfc36 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.735160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.740242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.740875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.741136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.741454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.742167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.744042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:38.758661 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3775/7583] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:38.780821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3809/7584] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:38.782559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:38.797895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf0d3-a724-489d-9c86-507ba41d2ae7 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:38.978164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:38.979434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:38.979729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:38.980002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:38.980715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:38.982897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.020190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3776/7585] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:38 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:39.024528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:39.062178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4bc2-8d1a-4121-96b5-dfd97745b0ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:39.073563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:39.075007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.075439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.075890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.076745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:39.079459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.093655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3810/7586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:39.097924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:39.113884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50931a6a-c067-481a-bcb8-1cf777e63987 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:39.123038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:39.124628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.125094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.125515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.126315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:39.128766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f309bee-72c3-4860-a6a4-bff9de932de2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.146301 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3777/7587] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:40:39.150210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:39.163608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba60e3-00ce-41af-9350-c32f3475f9cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:39.176732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:39.177453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.178153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.178153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] PATH_INFO: `/v3/projects/31f27aec34714d7bba536906c9d9aa2c/users/661a7db853734f9fa204a0a74959e4bc/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.181598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:39.206935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f27aec34714d7bba536906c9d9aa2c, user_id=661a7db853734f9fa204a0a74959e4bc, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:39.211268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.232203 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3811/7588] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:39 2022] PUT /identity/v3/projects/31f27aec34714d7bba536906c9d9aa2c/users/661a7db853734f9fa204a0a74959e4bc/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:39.239253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.240202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.240706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.317153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:39.318387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:39.438817 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3778/7589] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:39.449969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:39.532292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5d95-c59f-436c-9e36-d241e156baf6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:39.548682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:39.550295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.550674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.551045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.564934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:39.566836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454211-6202-4c80-afbc-3553bffc8fca service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.581412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:39.582283 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3812/7590] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:39.583198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:39.797772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.798086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.798571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.820011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752830b-3102-4edc-9484-f4335fd562a9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:39.838343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:39.838988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:39.842616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:39.856972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:39.863437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:39.873391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] MFA Rules not processed for user `3aad5538ba304b9ab8694f5b04b493b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:39.877264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:39.896526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:39.898304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:39.938678 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3779/7591] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:40:40.144076 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3813/7592] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:40.149304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.152187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:40.185587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:40.196265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae595af5-4f15-4eb4-bc3e-8caeecb0e10f service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.218854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.219666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.220254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.220551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.221647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.223740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.286243 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3780/7593] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:40 2022] POST /identity/v3/projects => generated 401 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:40.290007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.304011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb553cf-c8ff-4939-abc6-201255d5459c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.379988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.380753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.381081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.381358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.382522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.385754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.416062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3814/7594] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:40 2022] POST /identity/v3/users => generated 307 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:40.420756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.439034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92cea0-8161-4a72-b9e7-c5d638c5c10a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.459320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.463233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.463546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.464456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.464640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.468191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.485710 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3781/7595] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:40.487237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.501680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:40.518347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2759f3-8f0b-4dc0-8f85-0a1f0de4cee7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.525332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.526364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.527016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.527449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] PATH_INFO: `/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4/users/ecd89a5555c14846998698ee752f61db/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.573266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b0afb4ec73422babd2c7378dd0dfd4, user_id=ecd89a5555c14846998698ee752f61db, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.579044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.605461 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3815/7596] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:40 2022] PUT /identity/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4/users/ecd89a5555c14846998698ee752f61db/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:40.611142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.625263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d7c66-61b6-4297-a730-b6261e7f8a1a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.757574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.758459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.758817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.759281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.760068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.762350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62afa168-a361-4b16-b216-4e164a444be9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.805843 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3782/7597] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:40:40.814254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:40.861622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f7fc6-fc22-40e1-b13b-c41d0dcece24 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:40.900927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:40.901998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:40.902707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:40.903223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] PATH_INFO: `/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4/users/ecd89a5555c14846998698ee752f61db/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:40.910044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b0afb4ec73422babd2c7378dd0dfd4, user_id=ecd89a5555c14846998698ee752f61db, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:40.915369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:40.954511 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3816/7598] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:40 2022] PUT /identity/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4/users/ecd89a5555c14846998698ee752f61db/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:42.883000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:42.883522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:42.883891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:42.998695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] MFA Rules not processed for user `ecd89a5555c14846998698ee752f61db`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:43.005575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:43.224664 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3783/7599] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:47.039341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:47.291779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4820d39-e130-4b18-a8bf-be7294044bf2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:47.307479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:47.308144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:47.308421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:47.308693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] PATH_INFO: `/v3/users/3aad5538ba304b9ab8694f5b04b493b8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:47.309905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aad5538ba304b9ab8694f5b04b493b8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:47.311951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:47.440505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aad5538ba304b9ab8694f5b04b493b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:47.457919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aad5538ba304b9ab8694f5b04b493b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:47.460217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aad5538ba304b9ab8694f5b04b493b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:47.476736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aad5538ba304b9ab8694f5b04b493b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:47.481395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aad5538ba304b9ab8694f5b04b493b8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:47.529038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3817/7600] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:47 2022] DELETE /identity/v3/users/3aad5538ba304b9ab8694f5b04b493b8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:49.297024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:49.321558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867b973-987e-4062-9e94-56290f82bf7b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:49.468205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:49.494401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:49.495203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:49.495574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:49.495962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] PATH_INFO: `/v3/projects/ca4729e6e4bb4c95baa0db113450ea07` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:49.501491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4729e6e4bb4c95baa0db113450ea07)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:49.503549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:49.644635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4729e6e4bb4c95baa0db113450ea07', 'request_id': 'req-7a62a3e7-1811-459d-a949-b875131b96ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:49.657370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4729e6e4bb4c95baa0db113450ea07', 'request_id': 'req-7a62a3e7-1811-459d-a949-b875131b96ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:49.670017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4729e6e4bb4c95baa0db113450ea07', 'request_id': 'req-7a62a3e7-1811-459d-a949-b875131b96ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:49.702408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] The token cache is being invalidate because project ca4729e6e4bb4c95baa0db113450ea07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:49.703079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:49.704198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:49.706185 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3784/7601] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:49 2022] DELETE /identity/v3/projects/ca4729e6e4bb4c95baa0db113450ea07 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:49.711333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:49.712448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:49.742340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1318-fa93-480a-8ee8-0f7da92b9599 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:49.860965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:49.898598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:49.899455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:49.899827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:49.900195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] PATH_INFO: `/v3/users/ecd89a5555c14846998698ee752f61db` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:49.903244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd89a5555c14846998698ee752f61db)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:49.906192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:50.032924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd89a5555c14846998698ee752f61db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:50.050679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd89a5555c14846998698ee752f61db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:50.051505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd89a5555c14846998698ee752f61db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:50.070543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd89a5555c14846998698ee752f61db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:50.072382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a2d3707e-5180-4706-b59b-2214383b6213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd89a5555c14846998698ee752f61db'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:50.169375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3818/7602] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:49 2022] DELETE /identity/v3/users/ecd89a5555c14846998698ee752f61db => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:50.253452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:50.255476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:50.443750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a3e7-1811-459d-a949-b875131b96ab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:50.543576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:50.543855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:50.544132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:50.555253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:50.556086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:50.556526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:50.557325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:50.559547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:50.590224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] MFA Rules not processed for user `661a7db853734f9fa204a0a74959e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:50.592362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:50.678862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:50.682832 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3819/7603] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:50.763388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:50.766174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:50.841319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:50.843603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03d385-ed32-493b-a390-86a118b17d23 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:50.913403 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3785/7604] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:50.915093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:50.915516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:50.915785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:50.960870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] MFA Rules not processed for user `661a7db853734f9fa204a0a74959e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:50.964218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:50.970015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:50.988633 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3786/7605] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:51.003994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67238988-b018-4d05-b86f-bff2fff62e4a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:51.004134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:51.005728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:51.021741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:51.022674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.023110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.023559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] PATH_INFO: `/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.028395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b0afb4ec73422babd2c7378dd0dfd4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:51.033483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:51.046290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26653240-ae61-4705-91fe-ca32a8e24127 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:51.057289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:51.059411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.059849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.061892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.087432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:51.089538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da7fe6-c90f-496b-bbdd-bd860b9cdc63 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:51.118123 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3787/7606] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:51.139308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b0afb4ec73422babd2c7378dd0dfd4', 'request_id': 'req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:51.146470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b0afb4ec73422babd2c7378dd0dfd4', 'request_id': 'req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:51.153618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b0afb4ec73422babd2c7378dd0dfd4', 'request_id': 'req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:51.196833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] The token cache is being invalidate because project 18b0afb4ec73422babd2c7378dd0dfd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:40:51.197249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:51.199783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:51.202979 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3820/7607] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:40:50 2022] DELETE /identity/v3/projects/18b0afb4ec73422babd2c7378dd0dfd4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:51.207918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4cf2-b4b7-44df-bccd-9e4baf4df224 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.208282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4cf2-b4b7-44df-bccd-9e4baf4df224 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.208495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4cf2-b4b7-44df-bccd-9e4baf4df224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.218776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:51.222279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:51.321523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c13b4cf2-b4b7-44df-bccd-9e4baf4df224 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:51.323661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c13b4cf2-b4b7-44df-bccd-9e4baf4df224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:51.525329 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3788/7608] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:40:51.530166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.530726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.531018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.555299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346468f-c3fd-40ea-a29d-0f6370fcf0c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:51.569208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:51.572295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.572575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.572846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.581484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:51.601370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:51.601370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:51.618437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3789/7609] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:51.619586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:51.647141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455d4b8-bf66-4d5b-b4a7-897958a07be3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:51.667949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:51.669877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.670185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.670488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.671197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:40:51.671806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:51.673582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:51.746314 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3790/7610] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:40:51.751268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:51.786734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187a8c8-8dd3-4667-841d-4876d6a5b85b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:51.798911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:51.799548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:51.799826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:51.800099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:51.801451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:51.805323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:51.838946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:51.840705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:51.864388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3791/7611] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:51 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:51.869111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:51.900293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3821/7612] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:51.992819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb90022-0a1a-47c1-9f72-8a3cd97ef047 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:52.011650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:52.012322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.012600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.012875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.013547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:52.022003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:52.050374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:52.079609 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3792/7613] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:51 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:52.080884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:52.100528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3521a-9247-47b2-a159-4de90b3f38f5 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:52.111352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:52.112624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.112821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.113223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.117983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:52.121813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:52.152500 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3822/7614] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:52.154139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:52.184570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4658b6-d431-4ebd-9a20-92c8c0ad12f9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:52.208371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:52.209374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.209835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.210272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.211314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:52.224008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc6259-ffe4-4e5f-bc12-17d1981b1583 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:52.270982 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3793/7615] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:52.272568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:52.282545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:52.289237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21259-e21e-49d4-b97e-8695aef34d83 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:52.307817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:52.314493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.315143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.315790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] PATH_INFO: `/v3/projects/b6114995a20c4faa949441b95812bdeb/users/bcbdef0d361f4a93a8f3e08a214ab3b5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.363625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6114995a20c4faa949441b95812bdeb, user_id=bcbdef0d361f4a93a8f3e08a214ab3b5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:52.366923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:52.401574 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3823/7616] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:52 2022] PUT /identity/v3/projects/b6114995a20c4faa949441b95812bdeb/users/bcbdef0d361f4a93a8f3e08a214ab3b5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:52.402521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.402810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.403089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.443730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] MFA Rules not processed for user `bcbdef0d361f4a93a8f3e08a214ab3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:52.445032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:52.538119 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3794/7617] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:52.543049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:52.751615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d0da-b425-4a6e-8251-b2bd12465acd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:52.783600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:52.789356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:52.790650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:52.790979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:52.793372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:52.797308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:52.910281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3824/7618] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:40:52 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:40:52.914317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:52.960171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ad65-d508-4642-8a95-baeb206293c6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:53.127074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:53.127721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.128075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.128412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.129216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:53.131242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:53.198893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:53.202444 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3795/7619] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:40:52 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:40:53.215883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff0cf-7c0a-40f0-b95f-021121d167dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:53.241577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:53.243600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.244039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.245527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.247328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:53.252035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:53.315088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3825/7620] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:53.317903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:53.345925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa1d9-334e-462c-a197-55a3b6da1045 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:53.357615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:53.359136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.359436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.359674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] PATH_INFO: `/v3/projects/397d6f7ccfe44dc2b1b3b61053205204/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.410046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=397d6f7ccfe44dc2b1b3b61053205204, user_id=8ec04fc1f5dd405b8bb4983fc8fdb6ab, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:53.412831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:53.470789 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3796/7621] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:53 2022] PUT /identity/v3/projects/397d6f7ccfe44dc2b1b3b61053205204/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:53.474847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:53.501649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124449-6711-4cff-a50f-e791eb5f7247 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:53.735135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:53.735135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.740126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.740553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.743603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:53.746911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0b7e-6d18-45f3-bf2b-8e4d16ccf4f0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:53.809384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3826/7622] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:40:53.815371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:53.835532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4071d-8e58-4b28-9516-c9c7f837e49e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:53.849831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:53.850575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.853610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.853937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] PATH_INFO: `/v3/projects/397d6f7ccfe44dc2b1b3b61053205204/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.859940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=397d6f7ccfe44dc2b1b3b61053205204, user_id=8ec04fc1f5dd405b8bb4983fc8fdb6ab, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:53.870404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:53.906723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3797/7623] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:40:53 2022] PUT /identity/v3/projects/397d6f7ccfe44dc2b1b3b61053205204/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:40:53.917463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:53.918288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:53.919230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:53.971060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] MFA Rules not processed for user `8ec04fc1f5dd405b8bb4983fc8fdb6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:40:53.972484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:54.063004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:54.136639 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3827/7624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:40:54.161160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:54.165462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:54.251553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:54.368965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6e348-db85-466a-bf8b-5988ea649e1e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:54.374735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:54.375409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:54.375685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:54.375951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:54.389724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:54.392061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:54.415546 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3798/7625] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:54.583703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:54.624755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b449dc0-9bab-43be-93b3-b1632166eded None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:54.640786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:54.641493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:54.641958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:54.642170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:54.852323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:54.856529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:54.871592 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3828/7626] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:58.097956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:58.100962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:58.307395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d940f-74a2-47b1-a33e-1738e4623a17 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:58.323890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:58.324518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:58.324790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:58.325079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:58.327016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:58.352311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:58.354356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78de71d-f229-4173-bd7c-f68b39262724 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:58.370765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3799/7627] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:40:59.539986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:40:59.542079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:40:59.722644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a6aa1-936c-4b52-ba63-b06a48a71ed4 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:40:59.735478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:40:59.736222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:59.736507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:59.736774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] PATH_INFO: `/v3/users/d528bd56e90c4d6babf2b7c340c2b623` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:40:59.740735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d528bd56e90c4d6babf2b7c340c2b623)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:40:59.749108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:40:59.884128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd528bd56e90c4d6babf2b7c340c2b623'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:59.901699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd528bd56e90c4d6babf2b7c340c2b623'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:59.902378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd528bd56e90c4d6babf2b7c340c2b623'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:59.912724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd528bd56e90c4d6babf2b7c340c2b623'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:59.913664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd528bd56e90c4d6babf2b7c340c2b623'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:40:59.942462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:40:59.964947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3829/7628] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:40:59 2022] DELETE /identity/v3/users/d528bd56e90c4d6babf2b7c340c2b623 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:40:59.967972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:40:59.968616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:40:59.968616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:00.015785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:00.017058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:00.208508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3800/7629] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:00.209422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:00.213024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:00.402046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8846-9843-4564-882a-8b3f2458d205 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:00.418744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:00.419514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:00.420971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:00.421293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:00.443728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:00.448149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83c36c-a6e9-431e-ba98-3bf7d1a542d2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:00.538832 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3830/7630] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:01.115933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.117985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:01.142200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e03ed-7a68-4cb1-8a35-3951a537a8bc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.151261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.152249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.152864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.153305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] PATH_INFO: `/v3/projects/c258682c06904cf290ba9aa55fcbbe73` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.155228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c258682c06904cf290ba9aa55fcbbe73)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.158338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.257225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:01.263195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c258682c06904cf290ba9aa55fcbbe73', 'request_id': 'req-19243c4b-f8d7-44e9-abd8-84c4cc971832'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:01.277736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c258682c06904cf290ba9aa55fcbbe73', 'request_id': 'req-19243c4b-f8d7-44e9-abd8-84c4cc971832'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:01.297534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c258682c06904cf290ba9aa55fcbbe73', 'request_id': 'req-19243c4b-f8d7-44e9-abd8-84c4cc971832'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:01.320017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] The token cache is being invalidate because project c258682c06904cf290ba9aa55fcbbe73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:01.320305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:01.321750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-19243c4b-f8d7-44e9-abd8-84c4cc971832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:01.328381 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3801/7631] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:01 2022] DELETE /identity/v3/projects/c258682c06904cf290ba9aa55fcbbe73 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:01.334730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.336019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.336661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.370409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:01.372634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:01.457915 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3831/7632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:01.466328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.467442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.468207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.506429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:01.507743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:01.516828 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3802/7633] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:01.521950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.533926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910587-e866-4d8f-918d-0639395aaad4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.539828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.540454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.540454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.546393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.547586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:01.548274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.550277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.568395 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3832/7634] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:01.572316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.583941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daff74-5597-4e5c-b021-d9c208cda5f9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.590126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.590748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.591026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.591299 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.592131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.594334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.627563 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3803/7635] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:01 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:01.632302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.647564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25ffe5-44f5-404e-8346-2de8af1b6a59 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.723512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.724215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.724570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.724942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.725645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.727595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.754120 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3833/7636] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:01 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:01.758658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.786403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcb56-3ed0-42a4-8771-aff3e968c89a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.809511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.810370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.813392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.813738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.817033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.822117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.854731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3804/7637] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:01.861662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.882867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607207a-91e0-47c6-82ef-8c46a5e99dc0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.898390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.899309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.899756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.900179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:01.901193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:01.903112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb573726-d0e6-44d5-b3d6-60377446cf0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:01.918207 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3834/7638] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:01.925972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:01.956110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc9c3-42ed-4df5-b73f-d12adf30669d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:01.962322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:01.963001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:01.963276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:01.963545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] PATH_INFO: `/v3/projects/79a339cc5db643808022cf6e080fc9d5/users/c0d13a891f6445a2b12c8b30182df7e2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.002171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a339cc5db643808022cf6e080fc9d5, user_id=c0d13a891f6445a2b12c8b30182df7e2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:02.008928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:02.050217 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3805/7639] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:01 2022] PUT /identity/v3/projects/79a339cc5db643808022cf6e080fc9d5/users/c0d13a891f6445a2b12c8b30182df7e2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:02.052064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:02.052536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:02.052951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.062572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:02.118783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] MFA Rules not processed for user `c0d13a891f6445a2b12c8b30182df7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:02.120405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:02.232853 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3835/7640] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:02.238290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:02.363453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18b99-6004-4ea5-b1ae-5ec72bb2aaf7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:02.369177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:02.369855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:02.370123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:02.370505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.371223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:02.373854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:02.407256 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3806/7641] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:02 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:02.411037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:02.446007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef208c7-b2c9-43dd-ad8e-7376b077f44c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:02.585402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:02.586390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:02.586786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:02.587222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.588892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:02.591341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:02.627582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3836/7642] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:02 2022] POST /identity/v3/users => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:02.628934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:02.647250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08d7bf-86db-4f26-9624-0af408e413b5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:02.653971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:02.656074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:02.656592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:02.656969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.657788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:02.659720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:02.683201 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3807/7643] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:02.688613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:02.711728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5310a-3430-4906-9a03-e7b2ee2e50a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:02.719998 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:02.721003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:02.721997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:02.722538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] PATH_INFO: `/v3/projects/0715cffedd40429f9755053f748669f2/users/6ffde37ad3364246b878de50a1fbef50/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:02.752319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0715cffedd40429f9755053f748669f2, user_id=6ffde37ad3364246b878de50a1fbef50, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:02.766067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:02.812486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3837/7644] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:02 2022] PUT /identity/v3/projects/0715cffedd40429f9755053f748669f2/users/6ffde37ad3364246b878de50a1fbef50/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:02.813864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:02.830497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e7fb4-995c-40fa-9be2-f0454135cb0f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:03.100086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:03.136237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:03.139372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:03.142338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:03.142807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:03.143726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:03.146271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a96c4-00ae-4cd6-a3a3-0669f9a39349 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:03.175410 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3808/7645] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:03.176800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:03.194555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bfe9c-14f1-4352-bfb9-a5511e4c6b09 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:03.222675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:03.223591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:03.224136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:03.224593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] PATH_INFO: `/v3/projects/0715cffedd40429f9755053f748669f2/users/6ffde37ad3364246b878de50a1fbef50/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:03.236298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0715cffedd40429f9755053f748669f2, user_id=6ffde37ad3364246b878de50a1fbef50, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:03.239151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:03.270919 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3838/7646] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:03 2022] PUT /identity/v3/projects/0715cffedd40429f9755053f748669f2/users/6ffde37ad3364246b878de50a1fbef50/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:03.282280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367193-5451-49fa-b206-c703b03290ba None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:03.282877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367193-5451-49fa-b206-c703b03290ba None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:03.282877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc367193-5451-49fa-b206-c703b03290ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:03.347116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bc367193-5451-49fa-b206-c703b03290ba None None] MFA Rules not processed for user `6ffde37ad3364246b878de50a1fbef50`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:03.348516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc367193-5451-49fa-b206-c703b03290ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:03.563046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3809/7647] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:03.568127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:03.572603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:03.741367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:03.794096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028b5e-07f4-4969-9699-7d713f44fc96 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:03.802575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:03.803329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:03.803698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:03.804161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:03.917028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:03.918686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:03.938523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3839/7648] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:07.214706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:07.215960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:07.216511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:07.293717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] MFA Rules not processed for user `e4dd2c3b9b684160aa8511d85b5ec446`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:07.303817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:07.521877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3810/7649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:08.990768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:08.993876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:09.198499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a619-d860-48dd-96c4-fbd1b7271b74 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:09.226100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:09.228185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:09.228185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:09.228185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:09.248068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:09.289952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:09.291412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:09.304713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3840/7650] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:12.261528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:12.264791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:12.293986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46099f07-28df-4dda-8e84-dd873468b05c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:12.307433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:12.308826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:12.309918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:12.311240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:12.337818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:12.339428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9aab4-2e9a-4815-bf3b-a2415eeaad89 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:12.393508 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3811/7651] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:16.006350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:16.008336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:16.226221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a142cac-85bb-4bb0-8d53-dfa944c5e9a1 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:16.242169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:16.242841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:16.243155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:16.246985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] PATH_INFO: `/v3/users/1ec7e8c046664d5ab406d1e0e62d1308` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:16.254013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec7e8c046664d5ab406d1e0e62d1308)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:16.258510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:16.361273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:16.400011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec7e8c046664d5ab406d1e0e62d1308'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:16.413500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec7e8c046664d5ab406d1e0e62d1308'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:16.414583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec7e8c046664d5ab406d1e0e62d1308'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:16.444396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec7e8c046664d5ab406d1e0e62d1308'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:16.448347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec7e8c046664d5ab406d1e0e62d1308'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:16.509318 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3841/7652] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:16 2022] DELETE /identity/v3/users/1ec7e8c046664d5ab406d1e0e62d1308 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:16.511067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:16.511574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:16.511679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:16.588226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:16.589529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:16.911158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:16.989193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3812/7653] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:16.996333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:17.006617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:17.250522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae679-faff-4e9a-9a3a-16ba4b04503e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:17.255999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:17.256782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:17.256907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:17.257192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:17.295454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:17.297215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:17.329368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3842/7654] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:41:18.172304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:18.173828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:18.203416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c43c-18c3-490c-8610-7487c03b8e99 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:18.219626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:18.220304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:18.220603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:18.221636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] PATH_INFO: `/v3/projects/6b26e1446e594e8e9e80ec3a294eb807` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:18.223294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b26e1446e594e8e9e80ec3a294eb807)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:18.239583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:18.374036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b26e1446e594e8e9e80ec3a294eb807', 'request_id': 'req-fc124ee7-c003-44a9-b262-a33b4a3d02bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.384923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b26e1446e594e8e9e80ec3a294eb807', 'request_id': 'req-fc124ee7-c003-44a9-b262-a33b4a3d02bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.397564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b26e1446e594e8e9e80ec3a294eb807', 'request_id': 'req-fc124ee7-c003-44a9-b262-a33b4a3d02bc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.410793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] The token cache is being invalidate because project 6b26e1446e594e8e9e80ec3a294eb807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:18.411603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.412478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.414631 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3813/7655] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:18 2022] DELETE /identity/v3/projects/6b26e1446e594e8e9e80ec3a294eb807 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:18.418298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:18.446946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183041-1bed-48ef-9d68-334a128f29fa service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:18.598091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:18.598833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:18.599004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:18.599972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] PATH_INFO: `/v3/users/cfb262710b1347c19302424d6adae13b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:18.613893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb262710b1347c19302424d6adae13b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:18.621182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:18.703750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb262710b1347c19302424d6adae13b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.705892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:18.717265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb262710b1347c19302424d6adae13b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.727344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb262710b1347c19302424d6adae13b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.742297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb262710b1347c19302424d6adae13b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.743192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8d9a651-5b95-4afb-bf6e-5b41ebf809e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb262710b1347c19302424d6adae13b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:18.771703 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3843/7656] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:18 2022] DELETE /identity/v3/users/cfb262710b1347c19302424d6adae13b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:19.504918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:19.506777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:19.532380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc124ee7-c003-44a9-b262-a33b4a3d02bc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:19.677971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:19.678619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:19.679098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:19.679541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] PATH_INFO: `/v3/projects/71499305faa14b7a8d6090e912ab71c7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:19.681038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=71499305faa14b7a8d6090e912ab71c7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:19.683348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:19.775631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71499305faa14b7a8d6090e912ab71c7', 'request_id': 'req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:19.787741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71499305faa14b7a8d6090e912ab71c7', 'request_id': 'req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:19.797950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71499305faa14b7a8d6090e912ab71c7', 'request_id': 'req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:19.834255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] The token cache is being invalidate because project 71499305faa14b7a8d6090e912ab71c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:19.835218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:19.836189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a859a6c3-91c8-4fb3-bff0-7edba0dba0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:19.839590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3814/7657] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:19 2022] DELETE /identity/v3/projects/71499305faa14b7a8d6090e912ab71c7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:19.844769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:19.845777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:19.845777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:19.884981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:19.886230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:19.995714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:19.995994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:19.996265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:19.996503 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3844/7658] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:20.034803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:20.036713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:20.050093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3815/7659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:20.054510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.067109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860989e-2dc4-4bca-8a58-d53bd50b6fe3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.074035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.074987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.075546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.076792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.078588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:20.079445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.081450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.101505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.108435 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3845/7660] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:20.108735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:20.115760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bef3cd-d517-46c2-8c67-aa663cfafc4c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.122041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.123525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.124245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.124769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.125748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.127914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.191167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3816/7661] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:20 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:20.197878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.217425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37d84-91cc-4107-a4f0-505bae1d6c74 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.335918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.337162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.337723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.338281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.340209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.344237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.391669 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3846/7662] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:20 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:20.392380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.406692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ee26-ecb9-4bce-b6e4-038c059dc9d4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.420561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.421211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.422694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.422694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.423033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.424641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.439786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3817/7663] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:20.441266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.477096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38d34-c7d6-4ff2-a47b-c27ae75d70f7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.487474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.489903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.490376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.490857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.491900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.494180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c2709-4e11-48d4-b32c-719f04b35769 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.549385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.551672 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3847/7664] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:20.581229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c3e5c-0414-4eaa-ad3b-72b20d365f35 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:20.589819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:20.590506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.590782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.591417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] PATH_INFO: `/v3/projects/31db1bd3f0d04adaa53cffc524ee7e08/users/f63d7ac2fcf645faaa7b2273e93e78f0/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.648153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31db1bd3f0d04adaa53cffc524ee7e08, user_id=f63d7ac2fcf645faaa7b2273e93e78f0, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:20.653634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:20.677268 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3818/7665] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:20 2022] PUT /identity/v3/projects/31db1bd3f0d04adaa53cffc524ee7e08/users/f63d7ac2fcf645faaa7b2273e93e78f0/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:20.691792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:20.692061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:20.692304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:20.781213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] MFA Rules not processed for user `f63d7ac2fcf645faaa7b2273e93e78f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:20.784182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:20.842301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:20.927339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:20.954943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:20.964748 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3848/7666] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:20.968212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.138678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2a64f-a880-47b5-a7ab-b11060127a24 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.145143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.145764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009fad-8d3e-4a35-8e13-685e7f5b46f5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.146616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.147098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.147583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.148613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.151428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.154698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.155349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.155779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.156053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.159960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:21.191921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.193770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.206262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3849/7667] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:20 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:21.207236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.225395 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3819/7668] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:21.298679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943543-69b5-42c0-b2b0-9799c1577a2f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.306005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.306788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.307151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.307515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.308258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.310356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.340372 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3850/7669] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:21 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:21.345190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.359033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391501b1-3357-4f01-91ad-ed96b75d5adf service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.364506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.365211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.365486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.365753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.366388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.367977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.380302 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3820/7670] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:41:21.384484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.396370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5fa6-14f3-4c43-992d-74139194db28 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.401776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.402452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.402731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.403002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] PATH_INFO: `/v3/projects/f0dffd56302f453ca6244e278e112f7c/users/cee84d3379bd406da89f42d474d068da/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.420442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dffd56302f453ca6244e278e112f7c, user_id=cee84d3379bd406da89f42d474d068da, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.423146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.443428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.443870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3851/7671] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:21 2022] PUT /identity/v3/projects/f0dffd56302f453ca6244e278e112f7c/users/cee84d3379bd406da89f42d474d068da/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:21.455495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f10e3-cae8-48f5-a1b4-8e32d54f589d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.536771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.537356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.537632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.537904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.538942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.540673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00f35e-8ddf-4ea5-9b8c-b4961f49a956 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.558826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.561276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3821/7672] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:21.571179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b941fd6-82f4-48d4-bf23-ac180e8a0f5d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.576878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.578923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.578923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.578923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] PATH_INFO: `/v3/projects/f0dffd56302f453ca6244e278e112f7c/users/cee84d3379bd406da89f42d474d068da/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.581655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dffd56302f453ca6244e278e112f7c, user_id=cee84d3379bd406da89f42d474d068da, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.583799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.592380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:21.597339 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3852/7673] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:21 2022] PUT /identity/v3/projects/f0dffd56302f453ca6244e278e112f7c/users/cee84d3379bd406da89f42d474d068da/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:21.609331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.609622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.609900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.649548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] MFA Rules not processed for user `cee84d3379bd406da89f42d474d068da`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:21.651139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:21.694041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:21.788901 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3822/7674] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:21.801966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:21.804001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:21.909540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732f47-84c3-4be2-93ab-1b8a115df9d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:21.913301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:21.914049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:21.915014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:21.915014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:21.925386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:21.926992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d16b9-9584-45df-a81d-129beb0deddc service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:21.967009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3853/7675] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:22.065887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:22.083530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cd806-0c3f-41d6-9136-3d8f5016ab12 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:22.088117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:22.088760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:22.089140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:22.089482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:22.188799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:22.190454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:22.202724 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3823/7676] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:23.550513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:23.551067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:23.551718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:23.658553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] MFA Rules not processed for user `c0d13a891f6445a2b12c8b30182df7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:23.660944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:23.814433 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3854/7677] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:32.196792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=50 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:32.383224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:32.384636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:32.664723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6553-5048-49b5-96d8-7c1e0a7aca12 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:32.675574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:32.676044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:32.676322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:32.676681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:32.683801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:32.708802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:32.711375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a49d0-33cd-4b14-accb-aac283cc8588 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:32.713601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:32.716197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:32.785599 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3824/7678] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:32.895434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:32.895722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:32.895993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:32.964847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] MFA Rules not processed for user `93b7f4b9ee5e4b85a95f3989557222ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:32.979500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:33.034895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c386f-bc36-41fe-ad1a-35871fd11c63 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:33.067407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:33.068943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:33.075061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:33.076426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] PATH_INFO: `/v3/users/661a7db853734f9fa204a0a74959e4bc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:33.081590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661a7db853734f9fa204a0a74959e4bc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:33.093202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:33.240665 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3825/7679] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:33.242433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:33.246239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:33.253323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661a7db853734f9fa204a0a74959e4bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.257880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:33.272179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661a7db853734f9fa204a0a74959e4bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.272867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661a7db853734f9fa204a0a74959e4bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.285591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c852f-e9b3-4570-b233-9f559f1b2205 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:33.288027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661a7db853734f9fa204a0a74959e4bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.289374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-2aeb6a7f-05c6-4b10-9474-57a4ac9b57c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661a7db853734f9fa204a0a74959e4bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.299224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:33.300361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:33.300907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:33.301523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] PATH_INFO: `/v3/users/bcbdef0d361f4a93a8f3e08a214ab3b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:33.305297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbdef0d361f4a93a8f3e08a214ab3b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:33.307545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:33.332848 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3855/7680] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:32 2022] DELETE /identity/v3/users/661a7db853734f9fa204a0a74959e4bc => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:33.445484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbdef0d361f4a93a8f3e08a214ab3b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.448283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbdef0d361f4a93a8f3e08a214ab3b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.462426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbdef0d361f4a93a8f3e08a214ab3b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.468247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbdef0d361f4a93a8f3e08a214ab3b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.482531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbdef0d361f4a93a8f3e08a214ab3b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:33.516108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3826/7681] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:33 2022] DELETE /identity/v3/users/bcbdef0d361f4a93a8f3e08a214ab3b5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:33.521467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:33.521754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:33.522027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:33.563980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:33.567388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:33.683519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3856/7682] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:33.707458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:33.709440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:33.725529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:33.886022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf62fe-8f92-4dbc-8c64-b7d4d0971710 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:33.894215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:33.895566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:33.897052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:33.897487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:33.920536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:33.926240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e49f7-4495-46b3-bc81-da4ddc492fa0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:33.959592 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3827/7683] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:34.117827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:34.119459 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:34.160746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc366-2876-4362-902d-544e71f36f48 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:34.196410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:34.198737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.202354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.205873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] PATH_INFO: `/v3/projects/31f27aec34714d7bba536906c9d9aa2c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.212156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f27aec34714d7bba536906c9d9aa2c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:34.221388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:34.414056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f27aec34714d7bba536906c9d9aa2c', 'request_id': 'req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:34.430884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f27aec34714d7bba536906c9d9aa2c', 'request_id': 'req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:34.449384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f27aec34714d7bba536906c9d9aa2c', 'request_id': 'req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:34.473311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] The token cache is being invalidate because project 31f27aec34714d7bba536906c9d9aa2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:34.473618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:34.477062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fbf1ea0e-7036-4b93-9120-360ac9a3bcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:34.481375 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3857/7684] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:34 2022] DELETE /identity/v3/projects/31f27aec34714d7bba536906c9d9aa2c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:34.486694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.487078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.487158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.531505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:34.532750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:34.695712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3828/7685] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:34.703525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.703808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.703995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.738051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:34.757559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:34.782523 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3858/7686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:34.786739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:34.800120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0bc0-475c-460e-ad37-35cdd96647e7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:34.812293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:34.815801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.817735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.818684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.822800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:34.824424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:34.828753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:34.870633 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3829/7687] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:34.876372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:34.881660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:34.888754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:34.890734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c85d-bf9f-49f3-a2d5-da3250556a69 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:34.902640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:34.903784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.904661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe89631-ce90-403d-8f2a-d4d785464f93 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:34.905236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.905523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.907208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:34.909650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:34.910205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:34.910466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:34.911149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] PATH_INFO: `/v3/projects/b6114995a20c4faa949441b95812bdeb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:34.912309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6114995a20c4faa949441b95812bdeb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:34.914780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:34.920946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:34.987914 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3859/7688] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:34 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:41:34.991629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:35.040747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:35.083948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6114995a20c4faa949441b95812bdeb', 'request_id': 'req-c7179f8f-a62d-4216-82bb-aa7b44bf048e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.099328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6114995a20c4faa949441b95812bdeb', 'request_id': 'req-c7179f8f-a62d-4216-82bb-aa7b44bf048e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.117201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6114995a20c4faa949441b95812bdeb', 'request_id': 'req-c7179f8f-a62d-4216-82bb-aa7b44bf048e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.117458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303a8e-cf21-4341-b2ed-edd69813dc77 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:35.159411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] The token cache is being invalidate because project b6114995a20c4faa949441b95812bdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:35.159728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.161497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.165054 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3830/7689] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:34 2022] DELETE /identity/v3/projects/b6114995a20c4faa949441b95812bdeb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:35.168134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:35.170476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:35.220595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:35.220595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.220595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.220595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.221375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:35.222937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:35.225093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:35.288227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3860/7690] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:34 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:41:35.292654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:35.300938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:35.313171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179f8f-a62d-4216-82bb-aa7b44bf048e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:35.319483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:35.320859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.321607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.321881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] PATH_INFO: `/v3/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.323409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec04fc1f5dd405b8bb4983fc8fdb6ab)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:35.327060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:35.338370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76c1-b471-4782-9d6c-7928e9c4b038 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:35.353408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:35.354046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.356937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.357240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.357931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:35.363375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:35.390445 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3861/7691] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:35.394626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:35.415600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91560c1a-6409-4f62-b55e-35f29689fea5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:35.431613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec04fc1f5dd405b8bb4983fc8fdb6ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.431796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:35.432375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec04fc1f5dd405b8bb4983fc8fdb6ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.432510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.432655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.432919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.433737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:35.435918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:35.443109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec04fc1f5dd405b8bb4983fc8fdb6ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.444027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec04fc1f5dd405b8bb4983fc8fdb6ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.458220 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3862/7692] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:35.461980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:35.462562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-98bfdfac-3387-4883-8ae6-ae4c8516e3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec04fc1f5dd405b8bb4983fc8fdb6ab'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:35.466388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:35.498801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed02b1-3b57-4144-aeb9-2f832978a6dc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:35.503088 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3831/7693] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:35 2022] DELETE /identity/v3/users/8ec04fc1f5dd405b8bb4983fc8fdb6ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:35.521691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:35.522897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.523206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.523651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] PATH_INFO: `/v3/projects/7ad8f804fd884b80b1bb36b1228e350c/users/3b2a5118e0334c86b8c4cf7d3daec8c5/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.578517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad8f804fd884b80b1bb36b1228e350c, user_id=3b2a5118e0334c86b8c4cf7d3daec8c5, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:35.581558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfa72b-6cf9-4dc0-9cba-8bd4825a0e83 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:35.606487 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3863/7694] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:35 2022] PUT /identity/v3/projects/7ad8f804fd884b80b1bb36b1228e350c/users/3b2a5118e0334c86b8c4cf7d3daec8c5/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:35.618229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.618617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.619306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.698817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:35.701321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:35.851301 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3832/7695] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:35.852712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c042-e266-4a46-9d83-43eec23c5f0c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:35.853155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c042-e266-4a46-9d83-43eec23c5f0c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:35.853721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c042-e266-4a46-9d83-43eec23c5f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:35.897506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0b86c042-e266-4a46-9d83-43eec23c5f0c None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:35.904059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0b86c042-e266-4a46-9d83-43eec23c5f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:35.961176 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3864/7696] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:35.999153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:36.000703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.042046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:36.139117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253c5c-5b41-45a4-9756-3cf9b98b2eae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:36.145317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:36.146397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.146397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.146771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.158462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:36.160611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:36.181658 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3833/7697] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:36.217251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.217769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.218241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.240850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:36.243551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.259259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:36.260725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.263543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3865/7698] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:36.294399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:36.300781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.405394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5499f-9b02-4e0c-b870-6c654fd43ca7 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:36.410246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:36.411491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.411766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.412036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] PATH_INFO: `/v3/projects/397d6f7ccfe44dc2b1b3b61053205204` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.413618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397d6f7ccfe44dc2b1b3b61053205204)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:36.415683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:36.451509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:36.461452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffbf6-7dc6-41e2-b4a1-93b99aa8f090 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:36.468530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:36.470483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.471157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.471661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] PATH_INFO: `/v3/users/f63d7ac2fcf645faaa7b2273e93e78f0` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.473272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63d7ac2fcf645faaa7b2273e93e78f0)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:36.476236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:36.495910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397d6f7ccfe44dc2b1b3b61053205204', 'request_id': 'req-820d1ba6-729b-471b-8664-765fd9a3f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.509507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397d6f7ccfe44dc2b1b3b61053205204', 'request_id': 'req-820d1ba6-729b-471b-8664-765fd9a3f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.521571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397d6f7ccfe44dc2b1b3b61053205204', 'request_id': 'req-820d1ba6-729b-471b-8664-765fd9a3f204'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.554743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] The token cache is being invalidate because project 397d6f7ccfe44dc2b1b3b61053205204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:36.555158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.557022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-820d1ba6-729b-471b-8664-765fd9a3f204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.573195 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3834/7699] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:36 2022] DELETE /identity/v3/projects/397d6f7ccfe44dc2b1b3b61053205204 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:36.578497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f4ac-fe0b-478b-80d1-5064bbab4db5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.580663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f4ac-fe0b-478b-80d1-5064bbab4db5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.582422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41f4ac-fe0b-478b-80d1-5064bbab4db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.596710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63d7ac2fcf645faaa7b2273e93e78f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.625930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a41f4ac-fe0b-478b-80d1-5064bbab4db5 None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:36.627511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a41f4ac-fe0b-478b-80d1-5064bbab4db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.628738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63d7ac2fcf645faaa7b2273e93e78f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.634143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63d7ac2fcf645faaa7b2273e93e78f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.670500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63d7ac2fcf645faaa7b2273e93e78f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.672628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ee8c4a87-ffe1-4ace-ae49-4726104272fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63d7ac2fcf645faaa7b2273e93e78f0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:36.716787 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3866/7700] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:36 2022] DELETE /identity/v3/users/f63d7ac2fcf645faaa7b2273e93e78f0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:36.718828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c5cf0-ae35-4a7b-8b67-a6fdba339d2a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.719332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c5cf0-ae35-4a7b-8b67-a6fdba339d2a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.719853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c5cf0-ae35-4a7b-8b67-a6fdba339d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.745917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:36.767341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f78c5cf0-ae35-4a7b-8b67-a6fdba339d2a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:36.769783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f78c5cf0-ae35-4a7b-8b67-a6fdba339d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.795983 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3835/7701] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:36.797234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cabc61-c93d-4d4f-9c33-1b5e36b7b518 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.797571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cabc61-c93d-4d4f-9c33-1b5e36b7b518 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.797844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cabc61-c93d-4d4f-9c33-1b5e36b7b518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:36.867521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f7cabc61-c93d-4d4f-9c33-1b5e36b7b518 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:36.872604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f7cabc61-c93d-4d4f-9c33-1b5e36b7b518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:36.967952 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3867/7702] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:36.970837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:36.971276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:36.971706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.006474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:37.010801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.027453 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3836/7703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:37.045167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.045470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.045809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.097306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:37.098673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.115578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3837/7704] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:37.119913 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3868/7705] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:37.120463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.121483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.124873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.167905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba43f1-34b1-4f3a-ae30-7d0804d22824 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.175290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.176193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.176590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.176948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.177855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:37.177972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.179709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9222941-a440-4f14-b361-bfed1e7d4215 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.232799 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3869/7706] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:37.234604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.235980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.236369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.241989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90d28-ccb1-4c93-bd30-274aff1d4e16 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.250942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.251788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.252148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.252445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.268084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.269487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.274991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] MFA Rules not processed for user `3b2a5118e0334c86b8c4cf7d3daec8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:37.277736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.282737 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3838/7707] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:37.284347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.290826 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3870/7708] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:37.317173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3dd4-92bf-477e-ae0d-f3dd49c59af9 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.319200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.321284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.326426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.327115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.327395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.327668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.328320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.330318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.344516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:37.368657 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3839/7709] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:37 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:37.369486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb2b27-3a9f-4956-964e-50bd041cfd8d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.370244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.500536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75887c-b488-403c-8708-8f139e0926fa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.518578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.519649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.520002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.520466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] PATH_INFO: `/v3/users/3b2a5118e0334c86b8c4cf7d3daec8c5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.521036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.521653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.521936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.522191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.522430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2a5118e0334c86b8c4cf7d3daec8c5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.525525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.526905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.529667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.542883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:37.569203 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3840/7710] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:37 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:37.571439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.589212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8091-b739-40eb-bb3a-ada5ec1a826c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.610831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.611394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.611680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.613085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.614523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.617974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.628336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2a5118e0334c86b8c4cf7d3daec8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:37.639183 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3841/7711] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:41:37.639531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2a5118e0334c86b8c4cf7d3daec8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:37.640768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2a5118e0334c86b8c4cf7d3daec8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:37.643800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.650433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2a5118e0334c86b8c4cf7d3daec8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:37.651844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0a00512b-f1a1-47de-972c-b74cd9c7ae2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2a5118e0334c86b8c4cf7d3daec8c5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:37.656375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181bd17-2dc1-4e5e-822e-ebd33aa6e696 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.662158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.663068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.663616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.663764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.664530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.666647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.680708 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3842/7712] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:37.682826 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3871/7713] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:37 2022] DELETE /identity/v3/users/3b2a5118e0334c86b8c4cf7d3daec8c5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:37.688009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.690077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.690648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.691175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.691632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.708557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6132-eec2-4106-82f5-4e806260bee6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:37.716607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:37.717952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.812107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3872/7714] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:37.823061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.824532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.824783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:37.825573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:37.825896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:37.826243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] PATH_INFO: `/v3/projects/ed858596ebc747ba93a5da183ae379ef/users/7355f02d28b74d359e29b812dbf056fd/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:37.843297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed858596ebc747ba93a5da183ae379ef, user_id=7355f02d28b74d359e29b812dbf056fd, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:37.846303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:37.864288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3843/7715] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:37 2022] PUT /identity/v3/projects/ed858596ebc747ba93a5da183ae379ef/users/7355f02d28b74d359e29b812dbf056fd/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:37.871456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:37.873048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:37.874806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:37.939598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d819-46ce-4285-b1f1-36eb3f09d2c4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.004347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4898d-e2c9-4e3e-a683-e32b4b94a37e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.027114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.029902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.030773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.031223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.031515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.031636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.031818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] PATH_INFO: `/v3/projects/31db1bd3f0d04adaa53cffc524ee7e08` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.032276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.033039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=31db1bd3f0d04adaa53cffc524ee7e08)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.035116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.046928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.050430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a5689-413b-4a81-b539-4b752179bea6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.064088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3873/7716] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:41:38.065648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.065960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.066194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.101442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] MFA Rules not processed for user `7355f02d28b74d359e29b812dbf056fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:38.101692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31db1bd3f0d04adaa53cffc524ee7e08', 'request_id': 'req-4f370b61-1221-4d20-9c88-3cbcfbdadbff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.102653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.111697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31db1bd3f0d04adaa53cffc524ee7e08', 'request_id': 'req-4f370b61-1221-4d20-9c88-3cbcfbdadbff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.113553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:38.126164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31db1bd3f0d04adaa53cffc524ee7e08', 'request_id': 'req-4f370b61-1221-4d20-9c88-3cbcfbdadbff'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.139443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] The token cache is being invalidate because project 31db1bd3f0d04adaa53cffc524ee7e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:38.139951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.140693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.142330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3844/7717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:37 2022] DELETE /identity/v3/projects/31db1bd3f0d04adaa53cffc524ee7e08 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:38.146698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.148358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.188575 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3874/7718] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:38.193558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.195212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.240449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370b61-1221-4d20-9c88-3cbcfbdadbff admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.245632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.247395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.247882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.248244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] PATH_INFO: `/v3/users/cee84d3379bd406da89f42d474d068da` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.250186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee84d3379bd406da89f42d474d068da)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.253070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.287411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedfc3b-58ea-483c-9e84-6df0584d4b50 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.311139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.312820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.313508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.313891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.314804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.317267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.326795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee84d3379bd406da89f42d474d068da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.327908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee84d3379bd406da89f42d474d068da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.340664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee84d3379bd406da89f42d474d068da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.341594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee84d3379bd406da89f42d474d068da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.347100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:38.351271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee84d3379bd406da89f42d474d068da'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.375928 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3875/7719] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:38 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:41:38.376871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.379336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.379971 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3845/7720] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:38 2022] DELETE /identity/v3/users/cee84d3379bd406da89f42d474d068da => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:38.462560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505f394-f360-4e78-9111-3e08a5974692 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.537580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.538728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.539167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.539601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.540500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.542992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.573692 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3876/7721] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:38 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:38.577802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.593692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9d87-921b-4824-9303-f82b7fb246bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.603487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.605104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.606558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.607002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.607779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.608514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.610421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.612694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.633370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3846/7722] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:38.637525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.648317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998e4e-6f35-40f2-acaa-6528c3bb3713 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.652405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfcd73-a253-402f-abaf-3ec3bf338d6e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.659511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.661994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.662282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.662558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] PATH_INFO: `/v3/projects/0f5bc300b4fe4efb989424c54d219177/users/00cdb47ccfad4b81a3ad5dce3f268d13/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.675149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.676070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.676511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.676960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] PATH_INFO: `/v3/projects/7ad8f804fd884b80b1bb36b1228e350c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.678972 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad8f804fd884b80b1bb36b1228e350c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.681100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.701778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5bc300b4fe4efb989424c54d219177, user_id=00cdb47ccfad4b81a3ad5dce3f268d13, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.705149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:38.728565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3847/7723] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:38 2022] PUT /identity/v3/projects/0f5bc300b4fe4efb989424c54d219177/users/00cdb47ccfad4b81a3ad5dce3f268d13/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:38.732448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:38.754332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad8f804fd884b80b1bb36b1228e350c', 'request_id': 'req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.763718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad8f804fd884b80b1bb36b1228e350c', 'request_id': 'req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.771040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad8f804fd884b80b1bb36b1228e350c', 'request_id': 'req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.791684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:38.794888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] The token cache is being invalidate because project 7ad8f804fd884b80b1bb36b1228e350c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:38.795263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.796316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9a11cfc8-d1f3-4919-92fb-60c6051b4be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:38.802534 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3877/7724] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:38 2022] DELETE /identity/v3/projects/7ad8f804fd884b80b1bb36b1228e350c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:38.804221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de19c-922a-4b38-ac6f-ed5d2175eadd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.804602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de19c-922a-4b38-ac6f-ed5d2175eadd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.804973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536de19c-922a-4b38-ac6f-ed5d2175eadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.830185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-536de19c-922a-4b38-ac6f-ed5d2175eadd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:38.831619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-536de19c-922a-4b38-ac6f-ed5d2175eadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:38.841378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2cb77-5a5a-4d57-9a6a-ab3a5e3b3b00 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:38.847323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:38.943352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3878/7725] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:38.954322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.955263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.956210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.963962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:38.965151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:38.965151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:38.966262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:38.967561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:38.975291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.002567 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3848/7726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:39.004079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.007067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:39.008030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.010969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.028676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473b6e3-62c2-4c8d-ae0f-be509899fa29 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.037179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3879/7727] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:39.038531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.047418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.049209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d13c9-121f-4f53-83a1-c576a3b5c0cf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.049588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.050054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.050804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] PATH_INFO: `/v3/projects/0f5bc300b4fe4efb989424c54d219177/users/00cdb47ccfad4b81a3ad5dce3f268d13/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.053669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5bc300b4fe4efb989424c54d219177, user_id=00cdb47ccfad4b81a3ad5dce3f268d13, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.055502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.056198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.056567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.056911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.058027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:39.058445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.058927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1da17-fa12-4a67-905d-da252b0126fd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.061396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.077213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3880/7728] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:39.089684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.091543 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3849/7729] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:39 2022] PUT /identity/v3/projects/0f5bc300b4fe4efb989424c54d219177/users/00cdb47ccfad4b81a3ad5dce3f268d13/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:39.093752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.094272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.096094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.097561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e62e-df99-41c9-a28b-f4dc9fb3f2fb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.143230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] MFA Rules not processed for user `00cdb47ccfad4b81a3ad5dce3f268d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:39.144448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.171562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.172338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.172616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.172882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.173778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.176087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.213769 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3881/7730] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:39.217946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.248692 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3850/7731] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:39.257253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.261816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.347775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:39.363804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa858be-6103-4070-8a79-2e70710042a4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.368815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.369469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.369745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.370013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.370845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.373415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.382708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2cb4d-d8a4-4cab-9b38-6356a669b3b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.400766 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3882/7732] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:39.404941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.406815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.424011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a949-12e8-4586-8c2c-394d57863ed8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.429170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.429830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.430112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.430382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] PATH_INFO: `/v3/projects/f0dffd56302f453ca6244e278e112f7c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.431711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0dffd56302f453ca6244e278e112f7c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.433691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.441551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:39.454838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.455471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.455831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.456150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.505717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0dffd56302f453ca6244e278e112f7c', 'request_id': 'req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:39.517645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0dffd56302f453ca6244e278e112f7c', 'request_id': 'req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:39.528787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0dffd56302f453ca6244e278e112f7c', 'request_id': 'req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:39.544520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.546303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c787973-3ad6-43e9-bdbc-d0166cc3715f service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.551790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] The token cache is being invalidate because project f0dffd56302f453ca6244e278e112f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:39.552353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:39.552968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:39.555872 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3883/7733] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:39 2022] DELETE /identity/v3/projects/f0dffd56302f453ca6244e278e112f7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:39.556814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.558636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.558908 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3851/7734] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:41:39.561660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.561952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.562199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.592416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:39.593856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.671839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a7945-88bd-4cb9-baee-bc88bb0c2509 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.684808 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3852/7735] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:39.686559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.688100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.688922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.689211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.689327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.689665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.691307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.693640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3514-e688-4d34-8a70-b9de37c73630 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.706907 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3884/7736] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:39.708426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.709383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.709692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.748285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:39.749991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.760764 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3885/7737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:39.761909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.765757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:39.774559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cd89-2cc9-4946-b71d-2a3a27c6dbfb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.784556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.784868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.785217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.785519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.786203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.787799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.793637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eb3af-2a16-44d6-8711-49c53e305a2c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.800840 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3886/7738] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:39.801773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.802092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.803136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.803419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.803694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.807623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:39.818351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df37d3-4659-477a-8fc7-0f5419a371f4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.826718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.827505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.827783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.828130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.829285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:39.829555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.832093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.857291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3887/7739] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:39.859419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.870706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3f5ac-7b20-469a-9272-580e11f98811 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:39.876662 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:39.877367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.877646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.879035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] PATH_INFO: `/v3/projects/da9043193b3048cb97e5ac594245eec0/users/5f3a74130071425e9e3ae2bc419c1ac8/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.899216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.901049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.902378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9043193b3048cb97e5ac594245eec0, user_id=5f3a74130071425e9e3ae2bc419c1ac8, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:39.906895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4626e-56e0-4ef1-bbf5-35f116f5228b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:39.917220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3853/7740] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:39.918855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:39.924733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3888/7741] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:39 2022] PUT /identity/v3/projects/da9043193b3048cb97e5ac594245eec0/users/5f3a74130071425e9e3ae2bc419c1ac8/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:39.936073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:39.936436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:39.936765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:39.961405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6549b2-97b1-4a0c-8ec2-b42c2f2c5b75 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.013678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] MFA Rules not processed for user `5f3a74130071425e9e3ae2bc419c1ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:40.015510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:40.040910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.042306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.042928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.044813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.045700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.048050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.055647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:40.100812 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3854/7742] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:40.102925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.169781 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3889/7743] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:40.181921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.197640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369c32-620c-4a65-a63f-a3b2bd0b151e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.260777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a33d7c-8fe6-44d9-89b9-9e8822d7cc97 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.270350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.271930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.272209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.272477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.273831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.276485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.311278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.313856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.318058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.318328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] PATH_INFO: `/v3/users/5f3a74130071425e9e3ae2bc419c1ac8` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.321834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3a74130071425e9e3ae2bc419c1ac8)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.327237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.331762 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3855/7744] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:40 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:40.333710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.358035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234ed1-2182-477c-b595-c62b956084eb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.366880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.367518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.367970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.368554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.370893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.376961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.381353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:40.415581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3856/7745] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:40.417511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.431916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb515a3-21c9-4b2a-8626-e1895355bb7f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.441354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.442304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.442842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.443312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.444598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.450465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.478167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3857/7746] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:40.481481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.486374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3a74130071425e9e3ae2bc419c1ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:40.503324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f503-337e-4be6-9da3-3f44db776363 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:40.506473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3a74130071425e9e3ae2bc419c1ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:40.507406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3a74130071425e9e3ae2bc419c1ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:40.511306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:40.512016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.512333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.512649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] PATH_INFO: `/v3/projects/374f6e63bd8f4f598801defb36a967f9/users/c516dfcf7dd44e61b0ec81ed0137b652/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.521080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3a74130071425e9e3ae2bc419c1ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:40.534657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f6e63bd8f4f598801defb36a967f9, user_id=c516dfcf7dd44e61b0ec81ed0137b652, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:40.536208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cdb904e1-ca9f-4a9f-9134-cde6378291ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3a74130071425e9e3ae2bc419c1ac8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:40.538052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1012-6d6d-4977-810d-0cce66c582b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:40.564155 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3858/7747] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:40 2022] PUT /identity/v3/projects/374f6e63bd8f4f598801defb36a967f9/users/c516dfcf7dd44e61b0ec81ed0137b652/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:40.581277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.582322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.596549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3890/7748] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:40 2022] DELETE /identity/v3/users/5f3a74130071425e9e3ae2bc419c1ac8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:40.596745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.598847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:40.599139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:40.600234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:40.654384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:40.656314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:40.839892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:40.904078 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3891/7749] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:40.942428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:40.953257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:41.033732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] MFA Rules not processed for user `c516dfcf7dd44e61b0ec81ed0137b652`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:41.037024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:41.123504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8d441-9949-448c-ac2c-e8a788d88d35 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.128075 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.128890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.129305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.129681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.144619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.146524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.179711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3892/7750] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:41.257820 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3859/7751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 681 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:41.262220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.264078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:41.291403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606fbd4-1f56-4988-b1e7-91899c0be655 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.298339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.299198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.299537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.299875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.300697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.303653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.339230 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3893/7752] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:41 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:41.344190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.360258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033324a-8e09-433a-aade-fbfb1cb850df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.440706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.441360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.441630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.441896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.442515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.445586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.476014 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3860/7753] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:41 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:41.481628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.498642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f909282-0b84-4998-ac65-f01a0a323949 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.517106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.518786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.519300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.519845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.521307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.523665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.542713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3894/7754] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:41.547417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.558535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d851155-5f3c-4605-882d-ced49810ade8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.567697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.568734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.569454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.569658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] PATH_INFO: `/v3/projects/4af0fa3cc22c48458df92d10f2319198/users/cc3b67bcb57d4b0380436d45783a3520/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.592568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af0fa3cc22c48458df92d10f2319198, user_id=cc3b67bcb57d4b0380436d45783a3520, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.595892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.647168 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3861/7755] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:41 2022] PUT /identity/v3/projects/4af0fa3cc22c48458df92d10f2319198/users/cc3b67bcb57d4b0380436d45783a3520/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:41.651388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.671408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0329d1d-a16b-4658-88c5-7fad30347b3a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.854260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.854883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.861471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.861471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.861471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.862659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.915638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.917527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:41.930027 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3895/7756] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:41:41.940478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:41.948895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfb778-a30e-4525-81d3-d0965ab44397 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:41.954404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:41.954804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:41.955046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:41.955528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] PATH_INFO: `/v3/projects/da9043193b3048cb97e5ac594245eec0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:41.956753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9043193b3048cb97e5ac594245eec0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:41.958817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:41.973508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:41.985531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665c30c-256b-44e0-8809-aeb1e6f129e3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.004956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.006830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.008636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.008952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] PATH_INFO: `/v3/projects/4af0fa3cc22c48458df92d10f2319198/users/cc3b67bcb57d4b0380436d45783a3520/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.013646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af0fa3cc22c48458df92d10f2319198, user_id=cc3b67bcb57d4b0380436d45783a3520, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.021076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45400d-8ee0-445d-979e-4719068d4167 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.036137 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3896/7757] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:41 2022] PUT /identity/v3/projects/4af0fa3cc22c48458df92d10f2319198/users/cc3b67bcb57d4b0380436d45783a3520/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:42.048252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.048624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.049505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.050838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9043193b3048cb97e5ac594245eec0', 'request_id': 'req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:42.063237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9043193b3048cb97e5ac594245eec0', 'request_id': 'req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:42.073037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9043193b3048cb97e5ac594245eec0', 'request_id': 'req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:42.101889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] The token cache is being invalidate because project da9043193b3048cb97e5ac594245eec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:42.102186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:42.104011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c1f85072-6ccc-402f-8b0c-493c1d7ad1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:42.111974 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3862/7758] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:41 2022] DELETE /identity/v3/projects/da9043193b3048cb97e5ac594245eec0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:42.113621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dcc-1698-411b-bf09-3d725ce78b6c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.113903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dcc-1698-411b-bf09-3d725ce78b6c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.114265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f7dcc-1698-411b-bf09-3d725ce78b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.136217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] MFA Rules not processed for user `cc3b67bcb57d4b0380436d45783a3520`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:42.140675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c20f7dcc-1698-411b-bf09-3d725ce78b6c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:42.142149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c20f7dcc-1698-411b-bf09-3d725ce78b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.146604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.192052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:42.238791 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3863/7759] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:42.248437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.248822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.249502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.280758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:42.282112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.293898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3864/7760] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:42.298233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.308906 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3897/7761] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:42.310064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.313267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.323445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d1754-e677-4c2a-8d15-b0fd3c5c72d1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.334351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.335017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.335316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.335593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.337203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:42.337203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.338670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.364564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3865/7762] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:42.367197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.380065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d849de-c1c1-4b84-834c-1d559200fa59 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.388759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.389643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.389925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.390266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.391003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.393375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.447752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3866/7763] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/projects => generated 363 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:41:42.453933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.461119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cf880-dbae-420e-8d12-7d8c73c7a13f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.572304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a885932-0701-471b-b6cc-00a811e1f700 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.579088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.580619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.581250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.581528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.582451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.585026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.596320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:42.626296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.629154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.629500 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3867/7764] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:42.629630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.629987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.631495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.632200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.645858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea625f1-4216-4c86-8ec4-825901e723a9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.652727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.653613 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.653786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.654120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.654842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.656516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.668958 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3868/7765] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:42.674020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.691602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f753e5b-dde3-4673-867e-505a7f073210 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.698559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.700339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.700695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.701065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.701830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.703855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.721098 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3869/7766] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:42.722386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.728303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.729932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1943c38-927a-46e4-8b6e-888512e322b7 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.735870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec84edd-53f1-4dcc-ad2c-2e0e1d53e2f6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:42.742255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:42.742937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.743215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.743483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5/users/a4c81d21eabf414e8d4c1583b0eaba2b/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.763133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3898/7767] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:42.771007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d609d9c28b1e41dbb1397732022376b5, user_id=a4c81d21eabf414e8d4c1583b0eaba2b, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:42.774196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:42.805091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3870/7768] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:42 2022] PUT /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5/users/a4c81d21eabf414e8d4c1583b0eaba2b/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:42.814325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0ee-77b0-4cc7-ac24-b7697ac6e449 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:42.814616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0ee-77b0-4cc7-ac24-b7697ac6e449 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:42.814883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae0ee-77b0-4cc7-ac24-b7697ac6e449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:42.852821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-095ae0ee-77b0-4cc7-ac24-b7697ac6e449 None None] MFA Rules not processed for user `a4c81d21eabf414e8d4c1583b0eaba2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:42.854130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-095ae0ee-77b0-4cc7-ac24-b7697ac6e449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:42.887908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:42.968887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3899/7769] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:42.984795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:42.986972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:43.110162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03e453-996b-4a78-a2c0-7c181bb00854 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.135735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.136501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.136740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.137330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.157736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.160338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.180221 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3871/7770] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:43.205266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddad01-6b17-457f-9107-80d17be81a16 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.205523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddad01-6b17-457f-9107-80d17be81a16 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.205791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddad01-6b17-457f-9107-80d17be81a16 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.208546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3900/7771] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:41:43.215672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:41:43.237271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:43.258032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f474a-a016-40c2-a71c-65fb3922565f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.280279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c81d21eabf414e8d4c1583b0eaba2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd609d9c28b1e41dbb1397732022376b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.280927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.283314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.283314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.283560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorizing `identity:get_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.287323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.289701 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3872/7772] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:41:43 2022] GET /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 363 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:43.332295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d511-569c-47b4-9e37-b0e54eb08226 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.332635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d511-569c-47b4-9e37-b0e54eb08226 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.332791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472d511-569c-47b4-9e37-b0e54eb08226 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.337213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3901/7773] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:41:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:41:43.343752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:41:43.345916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:43.373263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:43.385618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03c75c-33f6-4a99-9ff8-e2c6897a6c95 tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.392833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c81d21eabf414e8d4c1583b0eaba2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd609d9c28b1e41dbb1397732022376b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.394253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.394674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.395113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.396864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorizing `identity:get_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.399863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.406171 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3873/7774] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:41:43 2022] GET /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 363 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:43.447009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6ad7-4d62-4859-8a45-6db3f68d00df None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.447293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6ad7-4d62-4859-8a45-6db3f68d00df None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.447563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b6ad7-4d62-4859-8a45-6db3f68d00df None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.449033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3902/7775] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:41:43.458748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:41:43.485550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:43.520401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4393ace-a4f4-45d2-8b68-531422b60faf tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.537437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c81d21eabf414e8d4c1583b0eaba2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd609d9c28b1e41dbb1397732022376b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.538145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.538686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.538968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.540231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorizing `identity:get_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.542724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.546095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3874/7776] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:41:43 2022] GET /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 363 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:43.590616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221ec5-a9e1-4ccb-bf56-bb5c954de508 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.592406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221ec5-a9e1-4ccb-bf56-bb5c954de508 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.592928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd221ec5-a9e1-4ccb-bf56-bb5c954de508 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.596969 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3903/7777] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:41:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:41:43.602518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:41:43.627579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:43.646402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48612-0628-4a85-bd03-5119f9476e2a tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.657373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c81d21eabf414e8d4c1583b0eaba2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd609d9c28b1e41dbb1397732022376b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.658130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.658409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.658738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.662657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorizing `identity:get_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.666079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.670559 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3875/7778] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:41:43 2022] GET /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 363 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:43.742527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59847ad-d728-4b9e-acbf-7b7b5f711ef6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.743126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59847ad-d728-4b9e-acbf-7b7b5f711ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.743305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59847ad-d728-4b9e-acbf-7b7b5f711ef6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.745040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3904/7779] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 16:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 16:41:43.763651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 16:41:43.803582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:43.833181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6e8f5-f31f-4542-a524-3fe399f05a4e tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:43.837973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c81d21eabf414e8d4c1583b0eaba2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd609d9c28b1e41dbb1397732022376b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:43.838908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:43.839320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:43.839715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:43.842002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorizing `identity:get_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:43.861760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b70bb-7ad3-4f2c-a6ac-74a8f7349ebe tempest-QuotasTestJSON-775862124 tempest-QuotasTestJSON-775862124-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:43.864412 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3876/7780] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 16:41:43 2022] GET /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 363 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:43.963601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59847ad-d728-4b9e-acbf-7b7b5f711ef6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:44.083831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59847ad-d728-4b9e-acbf-7b7b5f711ef6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:44.089622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:44.090596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:44.091631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:44.091913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] PATH_INFO: `/v3/users/a4c81d21eabf414e8d4c1583b0eaba2b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:44.094547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c81d21eabf414e8d4c1583b0eaba2b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:44.097569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:44.231122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c81d21eabf414e8d4c1583b0eaba2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:44.251424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c81d21eabf414e8d4c1583b0eaba2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:44.252547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c81d21eabf414e8d4c1583b0eaba2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:44.272786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c81d21eabf414e8d4c1583b0eaba2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:44.273412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c81d21eabf414e8d4c1583b0eaba2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:44.320305 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3905/7781] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:43 2022] DELETE /identity/v3/users/a4c81d21eabf414e8d4c1583b0eaba2b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:44.321598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c71f3-92a9-4bc7-8f70-e41552179a6e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:44.322107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c71f3-92a9-4bc7-8f70-e41552179a6e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:44.323343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c71f3-92a9-4bc7-8f70-e41552179a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:44.358838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-254c71f3-92a9-4bc7-8f70-e41552179a6e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:44.375454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-254c71f3-92a9-4bc7-8f70-e41552179a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:44.442173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:44.476300 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3877/7782] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:44.486741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:44.488565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:44.642166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:44.683361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512604df-1d72-4571-812f-7948540b1494 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:44.686978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:44.686978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:44.686978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:44.698851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:44.700924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:44.701474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:44.702758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:44.723740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:44.725604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:44.728471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:44.729883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:44.740908 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3906/7783] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:44.856102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3878/7784] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:44.924081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:44.925658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:45.091318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f324df5-d999-4516-be0b-331328ba5b6c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:45.098579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:45.099471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.100372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.100838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.115715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:45.118094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eecf2-e9c1-4cca-81ba-2a6f36a294d1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:45.129723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3907/7785] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:41:45.313133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:45.314917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:45.360078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da3457-ae21-47cc-bcd3-9bc79ab77949 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:45.365468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:45.366176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.366750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.366750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] PATH_INFO: `/v3/projects/d609d9c28b1e41dbb1397732022376b5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.374592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d609d9c28b1e41dbb1397732022376b5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:45.391254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:45.536189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd609d9c28b1e41dbb1397732022376b5', 'request_id': 'req-52eb70f0-d608-4ea8-92d8-9a72cc920b40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:45.553056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd609d9c28b1e41dbb1397732022376b5', 'request_id': 'req-52eb70f0-d608-4ea8-92d8-9a72cc920b40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:45.562192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd609d9c28b1e41dbb1397732022376b5', 'request_id': 'req-52eb70f0-d608-4ea8-92d8-9a72cc920b40'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:45.597073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] The token cache is being invalidate because project d609d9c28b1e41dbb1397732022376b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:45.597073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:45.597073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-52eb70f0-d608-4ea8-92d8-9a72cc920b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:45.597073 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3879/7786] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:45 2022] DELETE /identity/v3/projects/d609d9c28b1e41dbb1397732022376b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:45.606419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.606731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.606977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.655055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:45.662758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:45.754330 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3908/7787] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:45.767776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.768349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.768457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.802811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:45.804224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:45.829174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3880/7788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:45.831018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:45.857093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fe55c-ebe3-4724-a06c-a7ea2bd4272d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:45.884515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:45.886070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.886502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.887537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.888420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:45.888946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:45.894982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:45.956939 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3909/7789] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:45.964364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:45.980432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0acbe-90b1-4889-9bec-4cae2d337385 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:45.990351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:45.991298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:45.991678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:45.992046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:45.994273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:45.997781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:46.061892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:46.062123 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3881/7790] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:45 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:46.085650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764bde4-3529-4a08-9e50-a4e1ccc58641 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:46.227517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:46.228241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:46.228547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:46.228780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:46.233526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:46.247918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:46.286984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:46.329652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3910/7791] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:46 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:41:46.331758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:46.348911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea929c-6b7b-4cf2-91f4-e0536163aa16 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:46.359824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:46.361348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:46.362270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:46.362952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:46.364333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:46.367919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:46.389402 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3882/7792] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:46.390135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:46.404370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5ca10-53f1-4b0c-8e1c-b8b64f5ff2d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:46.419990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:46.421364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:46.421646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:46.421921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:46.422588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:46.425172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1005f-1796-45ad-b0cb-73a76305b6a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:46.498635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3911/7793] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:46.501440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:46.520752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feba486-405b-4110-85fa-d65ac99f0423 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:46.537793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:46.538888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:46.539710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:46.541363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] PATH_INFO: `/v3/projects/6a21baa51def4325acc1fd235a923c4b/users/2c9875f51852442f89c7038b12bd7966/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:46.614643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a21baa51def4325acc1fd235a923c4b, user_id=2c9875f51852442f89c7038b12bd7966, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:46.617325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:46.675533 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3883/7794] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:46 2022] PUT /identity/v3/projects/6a21baa51def4325acc1fd235a923c4b/users/2c9875f51852442f89c7038b12bd7966/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:46.682549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:46.682988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:46.683373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:46.775232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] MFA Rules not processed for user `2c9875f51852442f89c7038b12bd7966`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:46.776628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:46.936656 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3912/7795] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:46.938045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:46.966823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:47.051851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2420-a288-4807-afa4-0b9b17f542b7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:47.070784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:47.072697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.073160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.073729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.075294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:47.078032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:47.164866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3884/7796] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:46 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:47.167655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:47.190015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fdb0d-274b-41c4-897c-e1918ec5d873 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:47.352797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:47.353484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.353762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.354035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.354693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:47.359377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:47.401535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:47.409733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3913/7797] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:47 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:47.416709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a035-b7ac-4fab-bcc8-fcbc314d208e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:47.424605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:47.425281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.425652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.425929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.426768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:47.429195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:47.451594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:47.460372 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3885/7798] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:47.470340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc0d8-975e-41a2-a280-a2f917ac920d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:47.477786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:47.478539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.478918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.479530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.480223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:47.482686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb81f6d-da82-4fa2-9039-5b5bc0eb9099 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:47.498242 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3914/7799] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:41:47.502630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:47.520237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08c0c-0557-4d8d-803c-a13c6b9945c3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:47.534428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:47.537915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.538205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.538487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] PATH_INFO: `/v3/projects/25528096438d4e7ba9732386fdeed37a/users/7727f3c9f47b4b0e9c25edf36a0056c2/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.582874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25528096438d4e7ba9732386fdeed37a, user_id=7727f3c9f47b4b0e9c25edf36a0056c2, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:47.585468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:47.627759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3886/7800] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:47 2022] PUT /identity/v3/projects/25528096438d4e7ba9732386fdeed37a/users/7727f3c9f47b4b0e9c25edf36a0056c2/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:47.640906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d7f-cb0d-4ae9-9133-7906b9eb688e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:47.643267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d7f-cb0d-4ae9-9133-7906b9eb688e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:47.643554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3d7f-cb0d-4ae9-9133-7906b9eb688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:47.762603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9f8f3d7f-cb0d-4ae9-9133-7906b9eb688e None None] MFA Rules not processed for user `7727f3c9f47b4b0e9c25edf36a0056c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:47.768774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9f8f3d7f-cb0d-4ae9-9133-7906b9eb688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:47.869401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:47.907654 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3915/7801] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:47.912092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:48.101341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb7a-18c7-488e-b6bd-22250997b91c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:48.116871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9875f51852442f89c7038b12bd7966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a21baa51def4325acc1fd235a923c4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:48.117575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:48.117854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:48.118117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] PATH_INFO: `/v3/users/2c9875f51852442f89c7038b12bd7966/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:48.120600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] RBAC: Authorizing `identity:list_user_projects(user_id=2c9875f51852442f89c7038b12bd7966)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:48.123000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3765c-3eeb-47d8-b6b2-4dd49e9af1e3 tempest-IdentityV3ProjectsTest-308658284 tempest-IdentityV3ProjectsTest-308658284-project] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:48.284251 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3887/7802] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Oct 18 16:41:47 2022] GET /identity/v3/users/2c9875f51852442f89c7038b12bd7966/projects => generated 515 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:48.289083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:48.289939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:48.290373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:48.369377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] MFA Rules not processed for user `2c9875f51852442f89c7038b12bd7966`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:48.372857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:48.397506 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3916/7803] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:48.402285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:48.403278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:48.403642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:48.480272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] MFA Rules not processed for user `2c9875f51852442f89c7038b12bd7966`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:48.482224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:48.611991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:48.681007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.models.token_model [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] User 2c9875f51852442f89c7038b12bd7966 has no access to project 25528096438d4e7ba9732386fdeed37a {{(pid=81775) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 18 16:41:48.686194 n-d-858383-14 devstack@keystone.service[81775]: WARNING keystone.server.flask.application [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.78: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 18 16:41:48.699919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3888/7804] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:48 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 299 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 18 16:41:48.706522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:48.901175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eaa62-4a02-4113-bda4-6c4bead26342 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:48.908233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:48.909460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:48.909848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:48.910418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] PATH_INFO: `/v3/users/2c9875f51852442f89c7038b12bd7966` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:48.912148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9875f51852442f89c7038b12bd7966)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:48.914902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:49.035782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9875f51852442f89c7038b12bd7966'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.047139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9875f51852442f89c7038b12bd7966'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.047797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9875f51852442f89c7038b12bd7966'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.050301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:49.052951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:49.057135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9875f51852442f89c7038b12bd7966'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.057844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-32f0dc15-87e8-4771-983f-2845c9d9affa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9875f51852442f89c7038b12bd7966'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.088529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec419d-af18-4edc-9831-099c9fc5bf7d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:49.091153 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3917/7805] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:48 2022] DELETE /identity/v3/users/2c9875f51852442f89c7038b12bd7966 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:49.102586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:49.103307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:49.103585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:49.130785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:49.133272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:49.212735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:49.259281 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3918/7806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:49.271055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:49.272554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:49.308305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:49.317232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:49.317521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:49.317800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] PATH_INFO: `/v3/users/7355f02d28b74d359e29b812dbf056fd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:49.330093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7355f02d28b74d359e29b812dbf056fd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:49.343113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:49.421646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448fa8-8c84-4593-abec-3c3049939a31 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:49.428967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:49.430375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:49.430656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:49.432083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:49.458920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:49.460775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bcdce-f200-44a4-bd97-910c22ae811a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:49.486860 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3919/7807] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:49.549191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7355f02d28b74d359e29b812dbf056fd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.549924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7355f02d28b74d359e29b812dbf056fd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.577377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7355f02d28b74d359e29b812dbf056fd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.578360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7355f02d28b74d359e29b812dbf056fd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.600479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7355f02d28b74d359e29b812dbf056fd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:49.660364 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3889/7808] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:49 2022] DELETE /identity/v3/users/7355f02d28b74d359e29b812dbf056fd => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:49.664454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:49.664789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:49.665376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:49.723550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:49.725495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:49.882252 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3920/7809] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:49.904586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:49.906072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:50.089602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167cf9-49e8-41fe-a955-6af5cbdac4aa admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:50.103771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:50.104920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:50.105358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:50.105703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:50.128569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:50.133138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb2a87-e085-45db-9789-92667d4ea0c3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:50.149316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3890/7810] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:50.345824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:50.347322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:50.365987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85ff4-229d-452a-9b82-f0025d80ff6a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:50.379687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:50.382595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:50.382875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:50.383149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] PATH_INFO: `/v3/users/c516dfcf7dd44e61b0ec81ed0137b652` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:50.389978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c516dfcf7dd44e61b0ec81ed0137b652)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:50.394599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:50.529027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c516dfcf7dd44e61b0ec81ed0137b652'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:50.540665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c516dfcf7dd44e61b0ec81ed0137b652'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:50.542901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c516dfcf7dd44e61b0ec81ed0137b652'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:50.580337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c516dfcf7dd44e61b0ec81ed0137b652'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:50.583739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c516dfcf7dd44e61b0ec81ed0137b652'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:50.648308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:50.665066 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3921/7811] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:50 2022] DELETE /identity/v3/users/c516dfcf7dd44e61b0ec81ed0137b652 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:50.667132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:50.667591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:50.667686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:50.678561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:50.716189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:50.717393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:50.860372 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3891/7812] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:50.903172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:50.905117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:50.923177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:50.924930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:50.942684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152618d-66e4-4bd3-820a-464bbf19b2a9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:50.973033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:50.974029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:50.974463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:50.975029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] PATH_INFO: `/v3/projects/6a21baa51def4325acc1fd235a923c4b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:50.977514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a21baa51def4325acc1fd235a923c4b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:50.979589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:51.119250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a21baa51def4325acc1fd235a923c4b', 'request_id': 'req-b025ec73-8abb-4af9-8d31-b0727ed9512f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.135170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a21baa51def4325acc1fd235a923c4b', 'request_id': 'req-b025ec73-8abb-4af9-8d31-b0727ed9512f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.136059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac215d2-0620-4c47-9890-72c13c26a907 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:51.148473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a21baa51def4325acc1fd235a923c4b', 'request_id': 'req-b025ec73-8abb-4af9-8d31-b0727ed9512f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.181202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] The token cache is being invalidate because project 6a21baa51def4325acc1fd235a923c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:51.181472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.189352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.191038 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3922/7813] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:50 2022] DELETE /identity/v3/projects/6a21baa51def4325acc1fd235a923c4b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:51.194857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:51.196731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:51.320888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:51.321548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:51.321827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:51.322100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:51.330725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:51.359693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025ec73-8abb-4af9-8d31-b0727ed9512f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:51.369521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:51.371064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:51.372784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:51.373580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:51.373858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:51.374163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] PATH_INFO: `/v3/users/7727f3c9f47b4b0e9c25edf36a0056c2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:51.377775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7727f3c9f47b4b0e9c25edf36a0056c2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:51.379723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:51.411359 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3892/7814] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:51.476496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7727f3c9f47b4b0e9c25edf36a0056c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.490471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7727f3c9f47b4b0e9c25edf36a0056c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.491205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7727f3c9f47b4b0e9c25edf36a0056c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.508193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7727f3c9f47b4b0e9c25edf36a0056c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.509649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7727f3c9f47b4b0e9c25edf36a0056c2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:51.551608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3923/7815] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:51 2022] DELETE /identity/v3/users/7727f3c9f47b4b0e9c25edf36a0056c2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:51.896867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:51.903714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:51.932659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7d9f-8ee5-47ba-815f-990c90e93f3e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:52.110049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:52.110709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:52.110980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:52.111252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] PATH_INFO: `/v3/projects/ed858596ebc747ba93a5da183ae379ef` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:52.115020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed858596ebc747ba93a5da183ae379ef)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:52.117570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:52.133248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:52.232233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed858596ebc747ba93a5da183ae379ef', 'request_id': 'req-421c2bf3-3669-4963-b87c-7403926eb024'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.249452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed858596ebc747ba93a5da183ae379ef', 'request_id': 'req-421c2bf3-3669-4963-b87c-7403926eb024'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.259070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed858596ebc747ba93a5da183ae379ef', 'request_id': 'req-421c2bf3-3669-4963-b87c-7403926eb024'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.291360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] The token cache is being invalidate because project ed858596ebc747ba93a5da183ae379ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:52.291887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.292825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.295545 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3893/7816] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:51 2022] DELETE /identity/v3/projects/ed858596ebc747ba93a5da183ae379ef => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:52.300072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:52.303608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:52.318952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:52.343906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbd026-68bd-4ff4-9a52-8b84445254c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:52.488067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:52.488788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:52.489109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:52.489386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] PATH_INFO: `/v3/users/00cdb47ccfad4b81a3ad5dce3f268d13` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:52.491071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cdb47ccfad4b81a3ad5dce3f268d13)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:52.494585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:52.664882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cdb47ccfad4b81a3ad5dce3f268d13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.680405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cdb47ccfad4b81a3ad5dce3f268d13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.681886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:52.684588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:52.693715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cdb47ccfad4b81a3ad5dce3f268d13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.735023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2bf3-3669-4963-b87c-7403926eb024 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:52.744095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cdb47ccfad4b81a3ad5dce3f268d13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.751557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cdb47ccfad4b81a3ad5dce3f268d13'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:52.765846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:52.766512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:52.766790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:52.767060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] PATH_INFO: `/v3/projects/374f6e63bd8f4f598801defb36a967f9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:52.768815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f6e63bd8f4f598801defb36a967f9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:52.771002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:52.817213 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3924/7817] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:52 2022] DELETE /identity/v3/users/00cdb47ccfad4b81a3ad5dce3f268d13 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:52.932450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:52.934129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:52.974598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f6e63bd8f4f598801defb36a967f9', 'request_id': 'req-8884548c-473c-4141-897b-2130f3d9cad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.029220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f6e63bd8f4f598801defb36a967f9', 'request_id': 'req-8884548c-473c-4141-897b-2130f3d9cad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.078698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f6e63bd8f4f598801defb36a967f9', 'request_id': 'req-8884548c-473c-4141-897b-2130f3d9cad5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.115379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] The token cache is being invalidate because project 374f6e63bd8f4f598801defb36a967f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:53.115744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.116466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.119738 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3894/7818] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:52 2022] DELETE /identity/v3/projects/374f6e63bd8f4f598801defb36a967f9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:53.139945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:53.146602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:53.184024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80362920-4740-4b98-a0b4-f68c28806221 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:53.249560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:53.342553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:53.344428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.345336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.347786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] PATH_INFO: `/v3/projects/25528096438d4e7ba9732386fdeed37a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.349469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25528096438d4e7ba9732386fdeed37a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:53.356533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:53.363167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884548c-473c-4141-897b-2130f3d9cad5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:53.374360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:53.375944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.377825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.378304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] PATH_INFO: `/v3/users/cc3b67bcb57d4b0380436d45783a3520` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.380477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3b67bcb57d4b0380436d45783a3520)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:53.385963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:53.451416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:53.495312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25528096438d4e7ba9732386fdeed37a', 'request_id': 'req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.505480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25528096438d4e7ba9732386fdeed37a', 'request_id': 'req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.521491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25528096438d4e7ba9732386fdeed37a', 'request_id': 'req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.523680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3b67bcb57d4b0380436d45783a3520'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.525486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3b67bcb57d4b0380436d45783a3520'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.541219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3b67bcb57d4b0380436d45783a3520'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.544949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3b67bcb57d4b0380436d45783a3520'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.557287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] The token cache is being invalidate because project 25528096438d4e7ba9732386fdeed37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:53.558017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.559324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b6a94e6f-e264-4c99-90b4-aae3a71d6bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.561741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0c5fda70-9787-4f34-8575-589ea6a7746a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3b67bcb57d4b0380436d45783a3520'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:53.562261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3925/7819] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:52 2022] DELETE /identity/v3/projects/25528096438d4e7ba9732386fdeed37a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:53.570529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.570812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.573196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.610094 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3895/7820] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:41:53 2022] DELETE /identity/v3/users/cc3b67bcb57d4b0380436d45783a3520 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:53.615606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:53.618660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:53.777158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3926/7821] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:53.778673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.779202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.779977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.798165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:53.800018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:53.819701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c09553-1ee8-4929-af20-1e12cdb8c819 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:53.831008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:53.832483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.833399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.834474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] PATH_INFO: `/v3/projects/0f5bc300b4fe4efb989424c54d219177` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.835698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5bc300b4fe4efb989424c54d219177)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:53.839155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:53.844962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:53.848390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:53.864181 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3896/7822] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:53.869622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:53.908592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1e3f-c016-4f86-b61b-0ec4fcd4c718 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:53.954765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:53.959034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:53.960138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:53.961573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:53.963579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:53.963961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:53.968691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:53.995328 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3897/7823] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:53.999122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.023521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5bc300b4fe4efb989424c54d219177', 'request_id': 'req-72492c0a-9d06-4be0-a90e-f30c23f1f728'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.033427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d219a-4c81-471f-b831-35b280920176 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.035348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5bc300b4fe4efb989424c54d219177', 'request_id': 'req-72492c0a-9d06-4be0-a90e-f30c23f1f728'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.038386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:54.054900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5bc300b4fe4efb989424c54d219177', 'request_id': 'req-72492c0a-9d06-4be0-a90e-f30c23f1f728'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.096969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] The token cache is being invalidate because project 0f5bc300b4fe4efb989424c54d219177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:54.098090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.098802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-72492c0a-9d06-4be0-a90e-f30c23f1f728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.101319 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3927/7824] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:53 2022] DELETE /identity/v3/projects/0f5bc300b4fe4efb989424c54d219177 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:54.109117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.109492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.109772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.138139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:54.139604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.167022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.170181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.170456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.171462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.172263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.175705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a84d4-b789-42db-a8fa-78f40d03f2bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.232686 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3928/7825] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:54.235626 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3898/7826] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:53 2022] POST /identity/v3/projects => generated 397 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:54.239875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.242008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.243808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.253500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.254037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.264877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb9ee3-c1a7-4be5-b858-1f87e5cea324 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.329335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:54.332653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.360369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.361317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.361766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.362223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.363283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.365653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.405215 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3929/7827] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/users => generated 305 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:54.407344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.410257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.432770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a99a4-0ebb-4042-9887-5a08bc7d78a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.443250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.444734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.445406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.446969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] PATH_INFO: `/v3/projects/4af0fa3cc22c48458df92d10f2319198` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.455407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af0fa3cc22c48458df92d10f2319198)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.459327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.469406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3899/7828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:54.470175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.474839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:54.483518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481256-068a-4997-a003-f0dde5daf620 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.493946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.494881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.495427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.495625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.497791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.502120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.520538 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3900/7829] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:54.520538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.535242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceed3d-5412-4402-86df-980d51143403 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.544386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af0fa3cc22c48458df92d10f2319198', 'request_id': 'req-46dbc232-a458-478f-a4f1-baf144f99a53'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.555924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af0fa3cc22c48458df92d10f2319198', 'request_id': 'req-46dbc232-a458-478f-a4f1-baf144f99a53'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.567335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af0fa3cc22c48458df92d10f2319198', 'request_id': 'req-46dbc232-a458-478f-a4f1-baf144f99a53'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.578543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:54.602638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] The token cache is being invalidate because project 4af0fa3cc22c48458df92d10f2319198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:41:54.603088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.606139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:41:54.608343 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3930/7830] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:41:54 2022] DELETE /identity/v3/projects/4af0fa3cc22c48458df92d10f2319198 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:54.609357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.610865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.639193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.640462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.641086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.642151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.642951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:54.643396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.645321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4cf60-4431-4acf-a7d5-e48cceba6544 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.668717 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3901/7831] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:54.671028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.671466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.671841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.697205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:54.698685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.709539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3902/7832] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:54.712865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.714451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.732630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbc232-a458-478f-a4f1-baf144f99a53 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.735535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4b4e1-3b2d-4856-859a-b990720bee41 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.740194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.741158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.741682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.742358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] PATH_INFO: `/v3/projects/6229ebb43b1c411dae3427ef7fce12af/users/8b6a92ef025f4c20aac660036b941d90/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.746621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.753675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.753961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.754224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.754933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.756837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.769869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6229ebb43b1c411dae3427ef7fce12af, user_id=8b6a92ef025f4c20aac660036b941d90, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.772708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c3932-cda7-4c7d-97ff-9b824d05ec1e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.802357 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3931/7833] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:54 2022] PUT /identity/v3/projects/6229ebb43b1c411dae3427ef7fce12af/users/8b6a92ef025f4c20aac660036b941d90/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:54.805265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.805553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.805827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.814723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3903/7834] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:54.815818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.854351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:54.858803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:54.942712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0beb8-3175-4201-93b7-3e174f4570ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.948590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.950546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.950703 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:54.951012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:54.951770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:54.953555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:54.972680 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3904/7835] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:54.972680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.987753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba221-447c-44a1-a8ea-6b2155a28cd4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:54.994497 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3932/7836] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:54.998532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:54.998710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:54.999525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:54.999787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.000049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.000695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.002668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.013571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd3f0a-b42b-41ba-af70-0dee4f02beca None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.023559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.024780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.025427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.025848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] PATH_INFO: `/v3/projects/6229ebb43b1c411dae3427ef7fce12af/users/8b6a92ef025f4c20aac660036b941d90/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.029364 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6229ebb43b1c411dae3427ef7fce12af, user_id=8b6a92ef025f4c20aac660036b941d90, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.035092 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3905/7837] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:54 2022] POST /identity/v3/users => generated 286 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:55.035092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.036978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.048252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146feb-9246-4bc3-af30-cecfde2fe207 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.058432 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3933/7838] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:54 2022] PUT /identity/v3/projects/6229ebb43b1c411dae3427ef7fce12af/users/8b6a92ef025f4c20aac660036b941d90/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:55.068393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.144780 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:55.187157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4008e-d19f-4d22-a4cd-34a7ad07633a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.193045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.193903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.194187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.194456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.195236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.197980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab85774-0ebc-4f88-8a4d-8a1b078ec089 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.199691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.201607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.202246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.202626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.203873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:41:55.204289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.206456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.215842 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3934/7839] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:55.215842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201610-1199-42d1-8933-22643d18dd7e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.215842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201610-1199-42d1-8933-22643d18dd7e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.215842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201610-1199-42d1-8933-22643d18dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.227378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:55.235951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3906/7840] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:41:55.237065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.251353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309ca4-f973-485f-9ad0-b2ab43f8661f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.283388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.285600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.285877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-93201610-1199-42d1-8933-22643d18dd7e None None] MFA Rules not processed for user `8b6a92ef025f4c20aac660036b941d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:55.287764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.287901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93201610-1199-42d1-8933-22643d18dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:55.290331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.291224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.299162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.333459 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3907/7841] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:55.333459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.348064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6e221-72bb-47a6-b298-af9c01dc1fce admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.353204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.354079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.354384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.354749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.356117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.359540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.402677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3908/7842] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:55.403925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.421041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3935/7843] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:55.421041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93201610-1199-42d1-8933-22643d18dd7e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.440356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93201610-1199-42d1-8933-22643d18dd7e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.536956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2d2a8-e88f-4062-8d9b-899dc9d8153b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.544421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.545718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.546130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.546609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] PATH_INFO: `/v3/projects/aec13f6a69f6473ba45dcd9790e2520d/users/563a2112837048d693979d948c066894/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.548014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.548640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.548929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.549352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.549987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.551906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.567994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec13f6a69f6473ba45dcd9790e2520d, user_id=563a2112837048d693979d948c066894, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.579959 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3936/7844] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:55.581372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.582193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.604745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083bc01-efbe-4432-a00f-cb18ae79cac2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.610645 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3909/7845] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:55 2022] PUT /identity/v3/projects/aec13f6a69f6473ba45dcd9790e2520d/users/563a2112837048d693979d948c066894/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:55.612708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.719585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cac0d-365f-4715-82b4-6fb946ce01e2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.727778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.728423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.728929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.729253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.730578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.730772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.731523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.731809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.732083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.732267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597236b-f2ac-4e05-8f46-fbb49646a52e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.732736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.735453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.752122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3910/7846] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:55.753303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.754520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.754520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.783279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3937/7847] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:55.785558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.787812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:55.789609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:55.792533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:55.805889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:55.906084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85462070-ab02-4365-9c55-d365fa782e90 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.906870 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3911/7848] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:55.908543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.920919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.921559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.921831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.922249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.922913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.927812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa625596-6bf8-4c25-9fee-267de9e66095 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:55.935978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:55.936961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:55.937614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:55.938099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:55.939648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:55.942884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.948375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:55.962884 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3938/7849] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:55.963886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:55.969508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:55.978628 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3912/7850] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:55 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:55.984203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.000025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd74a-a200-41dd-8487-f706204f5f9f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.005522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.006265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.006620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.006953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] PATH_INFO: `/v3/projects/0a0f0a9db4e942c4bd54cfb9cdd6bc86/users/f7f6720f9a874b0e873dd5134e6a8c15/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.033011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f0a9db4e942c4bd54cfb9cdd6bc86, user_id=f7f6720f9a874b0e873dd5134e6a8c15, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.038617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.062378 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3913/7851] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:55 2022] PUT /identity/v3/projects/0a0f0a9db4e942c4bd54cfb9cdd6bc86/users/f7f6720f9a874b0e873dd5134e6a8c15/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:56.063490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.102996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388e91-4b20-4976-a729-7147282b4352 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.166051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8f56a-8839-458d-8968-e8e03840e09f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.171932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.172506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.172791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.173075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.174220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.177769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aea2a6-23e5-47c7-bb0e-a294cff2d865 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.194704 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3914/7852] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:56.194704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.194704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.194704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.214962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.219545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.220721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.222528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.237308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.239737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.249547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] MFA Rules not processed for user `f7f6720f9a874b0e873dd5134e6a8c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:56.250107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:56.263292 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3939/7853] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:56.264820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.279394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b788bf-9992-4a6e-a81a-468fc842baa7 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.291407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.292082 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.292448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.293172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.295505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.302959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.329481 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3940/7854] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:56.332194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.355907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042167-f85f-4c94-b83c-687a9aa880d5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.366908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.368235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.368952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.370366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] PATH_INFO: `/v3/projects/9e21c4a6b4614ade9cde5cdd19e2b0c3/users/960a625aff8b4e5bb44937e5928cc236/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.392562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:56.403776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e21c4a6b4614ade9cde5cdd19e2b0c3, user_id=960a625aff8b4e5bb44937e5928cc236, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.406960 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3915/7855] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:56.410466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.414495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d9f60-ad1e-408c-ae8e-691b3363cce7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.427812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12ac42-681a-4fb3-b03e-c6aa6383feae None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.435605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.436249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.436726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.437817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.438847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.441984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.465147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3941/7856] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:56 2022] PUT /identity/v3/projects/9e21c4a6b4614ade9cde5cdd19e2b0c3/users/960a625aff8b4e5bb44937e5928cc236/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:56.467901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.468344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.468976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.513580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3916/7857] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:56 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:56.518383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.542506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] MFA Rules not processed for user `960a625aff8b4e5bb44937e5928cc236`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:56.545481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:56.569266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:56.659397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34317e-ca71-4106-a365-608d8e6ff4bd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.681104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.693047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.693385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.693601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.694963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.697754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.699543 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3942/7858] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:41:56.735090 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3917/7859] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:56 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:56.739403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.769867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740c388-df34-429a-9cc6-a2543f317696 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.783026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.783814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.783938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.784202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.785028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.786502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.807059 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3943/7860] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:56.808161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.822266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1cb-eec3-44fe-ae08-e0d9ed7eb65a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.828622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.829282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.829630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.829888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.830543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.832219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa2613-e849-4c34-b046-fe83583573f0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.847265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3918/7861] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:56.849501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:56.865851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d46f-0226-44ca-b7db-3b24b20f9232 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:56.874582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:56.875796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.876198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.876666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] PATH_INFO: `/v3/projects/47eee6f88a30492e85ac349f92911b96/users/2a5e8ea863244c169f66cb314cdec919/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:56.908134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eee6f88a30492e85ac349f92911b96, user_id=2a5e8ea863244c169f66cb314cdec919, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:56.912344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:56.957137 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3944/7862] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:56 2022] PUT /identity/v3/projects/47eee6f88a30492e85ac349f92911b96/users/2a5e8ea863244c169f66cb314cdec919/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:56.962061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:56.962230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:56.962635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.008093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] MFA Rules not processed for user `2a5e8ea863244c169f66cb314cdec919`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:57.009563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:57.133677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3919/7863] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:57.135190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.227709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195491c-cef0-46e9-b1b4-326f27aee17e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.234758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.235402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.235658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.235940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.236567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.238652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7a75e-1f8c-45f9-9b03-17a0bda8ba0d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.288394 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3945/7864] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:57.291745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.307266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd298e1-c673-463f-bc50-97daca38559e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.386017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:57.413013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.414281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.415053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.415337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.416066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.419583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.471907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.472440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.475433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.487582 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3920/7865] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:57.491158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.513530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51034b3-5be7-440c-ae9c-038b00d9acf2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.527330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.528009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.528930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.528930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.529411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.531076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.542337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] MFA Rules not processed for user `563a2112837048d693979d948c066894`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:57.543717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:57.554776 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3921/7866] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:41:57.557902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.576475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985335f2-8057-46fe-a6c2-cec124d4cca7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.586126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.586865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.587324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.587697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] PATH_INFO: `/v3/projects/b017e263e99f41879443499b2d27e8b6/users/4143b4763d6c4220983ec02bb1f450cb/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.628599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b017e263e99f41879443499b2d27e8b6, user_id=4143b4763d6c4220983ec02bb1f450cb, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.631900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.663743 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3922/7867] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:57 2022] PUT /identity/v3/projects/b017e263e99f41879443499b2d27e8b6/users/4143b4763d6c4220983ec02bb1f450cb/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:57.669690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.677959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:57.713093 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3946/7868] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:57.718393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.734330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f06249-abbd-44cb-82fd-8258ac3e9c84 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.809777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac110c-ef04-41f7-8d4b-dff94d7f4ba4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.821487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.822513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.823478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.824916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.828222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.834228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.855960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.857168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.857776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.859111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.860137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.863821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.877411 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3923/7869] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:57.880680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.907683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f43f2-72bc-46eb-a6ba-ec64920d7a4d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:57.916773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:57.918004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.918495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.918974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] PATH_INFO: `/v3/projects/b017e263e99f41879443499b2d27e8b6/users/4143b4763d6c4220983ec02bb1f450cb/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:57.920896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3947/7870] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:57.923822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b017e263e99f41879443499b2d27e8b6, user_id=4143b4763d6c4220983ec02bb1f450cb, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:57.924786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:57.933055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68563217-55fa-46c4-b2f8-630dd131ce16 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:57.960596 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3924/7871] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:57 2022] PUT /identity/v3/projects/b017e263e99f41879443499b2d27e8b6/users/4143b4763d6c4220983ec02bb1f450cb/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:57.962529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:57.962879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:57.963309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.013229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] MFA Rules not processed for user `4143b4763d6c4220983ec02bb1f450cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:58.014462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:58.036118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb88d75-8b74-4b2a-9cd2-e062cfd8437a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.131903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.132788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.133102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.133380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.134312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.140675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.153093 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3925/7872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:41:58.174257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:58.183247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3948/7873] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:41:57 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:41:58.183970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:41:58.186860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:58.203406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b3c9-4596-4945-b8f9-aa2960be3ae5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.207727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:58.216036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.216772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.217185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.217548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.218296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.221489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.242298 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3949/7874] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:58.247006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:58.263183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:41:58.272257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d6a-555f-42aa-9780-88b02b77a806 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.283195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.284965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.285285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.286590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] PATH_INFO: `/v3/projects/c26ab58329414990be4b8539395d7dea/users/b582c117f393405ba194fd4a4f6226c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.306614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26ab58329414990be4b8539395d7dea, user_id=b582c117f393405ba194fd4a4f6226c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.311118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.323654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b1402-bfc4-4895-8cce-c7d6509264d8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.334258 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3950/7875] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:58 2022] PUT /identity/v3/projects/c26ab58329414990be4b8539395d7dea/users/b582c117f393405ba194fd4a4f6226c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:41:58.340125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:58.407311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.408208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.409069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.409984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.460553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da05-cd9d-4ee7-87b7-35792ec0ce74 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.470473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.471095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.471369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.471643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.472689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.474510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.490806 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3951/7876] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:41:58.491715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:41:58.505578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7766-c572-48f2-ae38-ae43599d08e0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:41:58.512560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:41:58.513223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:58.514552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:58.515220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] PATH_INFO: `/v3/projects/c26ab58329414990be4b8539395d7dea/users/b582c117f393405ba194fd4a4f6226c0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:58.517275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26ab58329414990be4b8539395d7dea, user_id=b582c117f393405ba194fd4a4f6226c0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.520183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637d172-4200-442e-adef-e2203698f5c4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.529494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:41:58.532242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf416b-92ac-4ffc-a408-732278267ee5 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:41:58.533944 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3952/7877] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:41:58 2022] PUT /identity/v3/projects/c26ab58329414990be4b8539395d7dea/users/b582c117f393405ba194fd4a4f6226c0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:41:58.558814 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3926/7878] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:41:59.816026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:41:59.816573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:41:59.816573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:41:59.893616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] MFA Rules not processed for user `b582c117f393405ba194fd4a4f6226c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:41:59.895847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:00.086226 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3953/7879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:41:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:00.099655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:00.100692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:00.101245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:00.183292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] MFA Rules not processed for user `563a2112837048d693979d948c066894`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:00.185898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:00.284337 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3927/7880] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:00.306944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:00.315689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:00.415677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:00.466321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9e80e-b124-4875-b579-e268a1eac6bf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:00.475096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:00.475974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:00.476398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:00.477533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:00.489924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:00.494916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:00.507632 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3954/7881] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:01.499142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:01.537393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:01.591669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df5b5e-fb0a-4dce-8cf3-21fcce6f7f18 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:01.598255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:01.598962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:01.599224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:01.599629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:01.685757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:01.687490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:01.709685 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3928/7882] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:02.486474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:02.502327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcda16-2d0d-43e0-8ee3-027ac031b12b service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:02.508401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:02.509124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:02.509471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:02.509809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:02.595942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:02.597721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:02.628092 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3955/7883] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:11.693303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=37 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:12.201517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:12.203331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:12.296668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c725-c016-4963-b03e-b4f0899303eb service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:12.300881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:12.301577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:12.301859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:12.302131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:12.418364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:12.419991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d2cd-2a16-4cf2-8fd4-c6c1124f5cbf service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:12.433959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:12.451167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3929/7884] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:12.569933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb02a37-b88c-47df-bc32-7d75cea95a67 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:12.579869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:12.581849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:12.581849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:12.581849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] PATH_INFO: `/v3/users/f7f6720f9a874b0e873dd5134e6a8c15` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:12.582437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f6720f9a874b0e873dd5134e6a8c15)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:12.584371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:12.690931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f6720f9a874b0e873dd5134e6a8c15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:12.710534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f6720f9a874b0e873dd5134e6a8c15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:12.711443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f6720f9a874b0e873dd5134e6a8c15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:12.722642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f6720f9a874b0e873dd5134e6a8c15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:12.732289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f6720f9a874b0e873dd5134e6a8c15'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:12.758953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:12.811452 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3956/7885] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:12 2022] DELETE /identity/v3/users/f7f6720f9a874b0e873dd5134e6a8c15 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:12.813677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:12.814186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:12.814278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:12.849436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:12.852186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:13.140060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3930/7886] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:13.158542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:13.160036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:13.309618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbdac0-61f3-462e-9651-5df6eacbee75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:13.322602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:13.324523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:13.325070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:13.325544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:13.351677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:13.355000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef3b7-f160-41c7-9848-a3388cd22962 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:13.389079 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3957/7887] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:13.511720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:13.513256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:13.541039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b2a4-4ac6-470d-a6ab-000ea4526f5c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:13.556787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:13.558507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:13.558507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:13.558694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] PATH_INFO: `/v3/users/8b6a92ef025f4c20aac660036b941d90` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:13.563523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6a92ef025f4c20aac660036b941d90)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:13.565742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:13.692388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:13.702875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6a92ef025f4c20aac660036b941d90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:13.705442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6a92ef025f4c20aac660036b941d90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:13.733903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6a92ef025f4c20aac660036b941d90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:13.736234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6a92ef025f4c20aac660036b941d90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:13.755201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6a92ef025f4c20aac660036b941d90'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:13.781051 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3931/7888] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:13 2022] DELETE /identity/v3/users/8b6a92ef025f4c20aac660036b941d90 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:13.786115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:13.786613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:13.787669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:13.839728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:13.848870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:14.096706 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3958/7889] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:42:14.102380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:14.105515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:14.226372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:14.228350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:14.291748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65823ec-9922-44fb-aa5e-75506fb4961a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:14.325311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:14.326297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:14.326461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:14.326745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] PATH_INFO: `/v3/projects/0a0f0a9db4e942c4bd54cfb9cdd6bc86` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:14.330501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f0a9db4e942c4bd54cfb9cdd6bc86)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:14.333334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:14.357927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1169f-b5d7-49b6-a36b-18e110255e9b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:14.368165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:14.371240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:14.372198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:14.372963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:14.397176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:14.416101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:14.448918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f0a9db4e942c4bd54cfb9cdd6bc86', 'request_id': 'req-47b5a163-2c32-471b-b7e5-9be16744843a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.452349 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3932/7890] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:14.468173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f0a9db4e942c4bd54cfb9cdd6bc86', 'request_id': 'req-47b5a163-2c32-471b-b7e5-9be16744843a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.482263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f0a9db4e942c4bd54cfb9cdd6bc86', 'request_id': 'req-47b5a163-2c32-471b-b7e5-9be16744843a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.509336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] The token cache is being invalidate because project 0a0f0a9db4e942c4bd54cfb9cdd6bc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:14.509730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.510821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.517934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3959/7891] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:14 2022] DELETE /identity/v3/projects/0a0f0a9db4e942c4bd54cfb9cdd6bc86 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:14.519179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:14.537130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f42842-85e9-42f6-992e-6904e39a1d4b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:14.709790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:14.710999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:14.711430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:14.711805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] PATH_INFO: `/v3/users/2a5e8ea863244c169f66cb314cdec919` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:14.713602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5e8ea863244c169f66cb314cdec919)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:14.716908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:14.792037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5e8ea863244c169f66cb314cdec919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.793086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5e8ea863244c169f66cb314cdec919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.817499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5e8ea863244c169f66cb314cdec919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.819200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5e8ea863244c169f66cb314cdec919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.840165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5e8ea863244c169f66cb314cdec919'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:14.851276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:14.895441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3933/7892] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:14 2022] DELETE /identity/v3/users/2a5e8ea863244c169f66cb314cdec919 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:15.117637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:15.119657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:15.163147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5a163-2c32-471b-b7e5-9be16744843a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:15.228499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:15.434438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:15.435272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:15.435552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:15.435825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] PATH_INFO: `/v3/projects/6229ebb43b1c411dae3427ef7fce12af` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:15.438382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6229ebb43b1c411dae3427ef7fce12af)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:15.442524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:15.554801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6229ebb43b1c411dae3427ef7fce12af', 'request_id': 'req-cf28c624-0887-4779-aae1-14a091f6c58f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.565709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6229ebb43b1c411dae3427ef7fce12af', 'request_id': 'req-cf28c624-0887-4779-aae1-14a091f6c58f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.574271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6229ebb43b1c411dae3427ef7fce12af', 'request_id': 'req-cf28c624-0887-4779-aae1-14a091f6c58f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.588079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:15.590643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:15.597301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] The token cache is being invalidate because project 6229ebb43b1c411dae3427ef7fce12af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:15.597785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.602273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.605265 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3960/7893] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:15 2022] DELETE /identity/v3/projects/6229ebb43b1c411dae3427ef7fce12af => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:15.609489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:15.611134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:15.619927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7754bdb-026f-4ccc-a2c7-d5d23fa357c0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:15.732738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:15.734068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:15.734930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:15.735400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] PATH_INFO: `/v3/projects/47eee6f88a30492e85ac349f92911b96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:15.736932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eee6f88a30492e85ac349f92911b96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:15.740026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:15.842131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eee6f88a30492e85ac349f92911b96', 'request_id': 'req-d4738b16-a632-46f5-9019-509439c8d391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.850825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eee6f88a30492e85ac349f92911b96', 'request_id': 'req-d4738b16-a632-46f5-9019-509439c8d391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.855865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28c624-0887-4779-aae1-14a091f6c58f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:15.860352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eee6f88a30492e85ac349f92911b96', 'request_id': 'req-d4738b16-a632-46f5-9019-509439c8d391'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.881855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] The token cache is being invalidate because project 47eee6f88a30492e85ac349f92911b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:15.882139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.883505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:15.894178 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3934/7894] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:15 2022] DELETE /identity/v3/projects/47eee6f88a30492e85ac349f92911b96 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:15.897900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:15.902519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:15.972461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:16.018094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:16.019339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:16.019918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:16.020359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] PATH_INFO: `/v3/users/960a625aff8b4e5bb44937e5928cc236` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:16.022289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=960a625aff8b4e5bb44937e5928cc236)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:16.027925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:16.078167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738b16-a632-46f5-9019-509439c8d391 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:16.085292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:16.086301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:16.086597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:16.087539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] PATH_INFO: `/v3/users/4143b4763d6c4220983ec02bb1f450cb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:16.089616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4143b4763d6c4220983ec02bb1f450cb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:16.096174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:16.141119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:16.187348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960a625aff8b4e5bb44937e5928cc236'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.207368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960a625aff8b4e5bb44937e5928cc236'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.208328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960a625aff8b4e5bb44937e5928cc236'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.234987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960a625aff8b4e5bb44937e5928cc236'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.237749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960a625aff8b4e5bb44937e5928cc236'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.243837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4143b4763d6c4220983ec02bb1f450cb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.245270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4143b4763d6c4220983ec02bb1f450cb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.280946 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3961/7895] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:15 2022] DELETE /identity/v3/users/960a625aff8b4e5bb44937e5928cc236 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:16.289948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4143b4763d6c4220983ec02bb1f450cb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.295476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4143b4763d6c4220983ec02bb1f450cb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.315930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4143b4763d6c4220983ec02bb1f450cb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:16.399838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3935/7896] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:15 2022] DELETE /identity/v3/users/4143b4763d6c4220983ec02bb1f450cb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:17.379671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:17.381099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:17.475897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:17.477788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:17.593229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10969743-c6b9-4075-b850-80bd4942b6fa admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:17.635042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7ff3-0730-4fb3-b136-06861774d113 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:17.640769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:17.641855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:17.642238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:17.642732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] PATH_INFO: `/v3/projects/9e21c4a6b4614ade9cde5cdd19e2b0c3` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:17.645015 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e21c4a6b4614ade9cde5cdd19e2b0c3)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:17.647434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:17.708312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:17.708975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:17.709281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:17.709549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] PATH_INFO: `/v3/projects/b017e263e99f41879443499b2d27e8b6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:17.712855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b017e263e99f41879443499b2d27e8b6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:17.719897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:17.760190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:17.768736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e21c4a6b4614ade9cde5cdd19e2b0c3', 'request_id': 'req-7dacadbd-7d25-4a54-86e4-30beca85f0a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.784067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e21c4a6b4614ade9cde5cdd19e2b0c3', 'request_id': 'req-7dacadbd-7d25-4a54-86e4-30beca85f0a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.796778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e21c4a6b4614ade9cde5cdd19e2b0c3', 'request_id': 'req-7dacadbd-7d25-4a54-86e4-30beca85f0a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.818276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] The token cache is being invalidate because project 9e21c4a6b4614ade9cde5cdd19e2b0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:17.818493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.821395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7dacadbd-7d25-4a54-86e4-30beca85f0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.824725 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3936/7897] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:17 2022] DELETE /identity/v3/projects/9e21c4a6b4614ade9cde5cdd19e2b0c3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:17.836036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5fa5-5f81-40ca-8b26-362d98b591b6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:17.836325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5fa5-5f81-40ca-8b26-362d98b591b6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:17.837580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b017e263e99f41879443499b2d27e8b6', 'request_id': 'req-6661e9b2-7025-4f07-9fee-1f353834dedf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.838909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb5fa5-5f81-40ca-8b26-362d98b591b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:17.856284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b017e263e99f41879443499b2d27e8b6', 'request_id': 'req-6661e9b2-7025-4f07-9fee-1f353834dedf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.871731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b017e263e99f41879443499b2d27e8b6', 'request_id': 'req-6661e9b2-7025-4f07-9fee-1f353834dedf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.881963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-25bb5fa5-5f81-40ca-8b26-362d98b591b6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:17.883542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25bb5fa5-5f81-40ca-8b26-362d98b591b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:17.896389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] The token cache is being invalidate because project b017e263e99f41879443499b2d27e8b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:17.896755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.897469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6661e9b2-7025-4f07-9fee-1f353834dedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:17.900502 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3962/7898] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:17 2022] DELETE /identity/v3/projects/b017e263e99f41879443499b2d27e8b6 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:17.905711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f081c-80e9-45cd-9ff3-2cc801d03909 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:17.905994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f081c-80e9-45cd-9ff3-2cc801d03909 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:17.906316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f081c-80e9-45cd-9ff3-2cc801d03909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:17.941433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:17.954808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f66f081c-80e9-45cd-9ff3-2cc801d03909 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:17.961736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f66f081c-80e9-45cd-9ff3-2cc801d03909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:18.075160 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3937/7899] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:18.082979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.083176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.083439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.144293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:18.151929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:18.163149 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3963/7900] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:18.171306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.171655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.171846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.181292 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3938/7901] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:18.186104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.212289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c0331-87a6-48ce-bf71-3cf07f373a47 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.234869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.235562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.235837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.236104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.236815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:18.237149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.238757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.240035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:18.243965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:18.264439 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3964/7902] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:18.282338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.283619 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3939/7903] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:18.285244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.304355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f54716-1d16-49da-8e11-78d8c4c1acf6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.310209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484553e-0ae4-49c0-a636-6a75b47fed93 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.317886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.319764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.320056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.320774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.322046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.322953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:18.323790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.325094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.325417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.325843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.327708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.329048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.331058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.359243 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3965/7904] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:18.362330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.383783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33925-bbf8-4bee-bb71-4f3df7923186 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.398550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3940/7905] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:18.400148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.406323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.407005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.407288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.407793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.408448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.410414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.474750 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3966/7906] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:18.477958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.557895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ebbc-6a70-4b8c-9f9a-ac9c9e2e4a58 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.656722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44c15-9e6a-4476-b374-6a8bfa3e29b7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.671602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.673136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.673673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.674453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.675317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.677600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.685973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.686622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.686904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.687181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.687829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.689821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.692455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:18.712537 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3967/7907] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:18.716961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.728114 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3941/7908] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/users => generated 295 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:18.729493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.740328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c162dec-f1db-43eb-a10d-70de32da09e5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.748411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0dd6d-cf5b-4e8c-9f08-e10efc10ee36 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.756012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.756787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.757199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.757627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.758171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.758814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.759150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.759576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.759996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.762236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.763548 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.768848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.787091 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3942/7909] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:18.793828 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3968/7910] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:18.794108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.814076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.829148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eff6a5-ae08-4a5e-aa74-106d847b0af9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.830113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759a4e-36c0-4ca3-b60d-1e288bd1f261 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.839186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.840061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.840857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.841660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.842100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.842524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.842952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.843362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.844157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.844956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.846728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.848766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.853561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:18.874251 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3969/7911] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:18.876009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.878565 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3943/7912] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:18.881658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:18.896833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ea282-5bde-4ebe-9e5e-f1682284f23d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.897759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56320-7975-4b23-8cf4-3a4546e968ee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:18.905280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.906885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.907729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.908215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] PATH_INFO: `/v3/projects/10df77774a2a4be6b36f37d238637345/users/7c018cfffbe54e02b1f304fe0b26a59a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.912528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:18.914082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.918139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.918465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] PATH_INFO: `/v3/projects/a0be30e6c24346cdb352f6079c799c81/users/ef3b10b9f89948d7b4896aa81ebaf439/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:18.933189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10df77774a2a4be6b36f37d238637345, user_id=7c018cfffbe54e02b1f304fe0b26a59a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.936256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8b88a-baec-42fe-b529-3825f293fec3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.953318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0be30e6c24346cdb352f6079c799c81, user_id=ef3b10b9f89948d7b4896aa81ebaf439, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:18.956874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79738398-bff5-4515-8b89-c7f32602aee1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:18.970813 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3970/7913] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:18 2022] PUT /identity/v3/projects/10df77774a2a4be6b36f37d238637345/users/7c018cfffbe54e02b1f304fe0b26a59a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:18.975247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:18.975821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:18.976484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.012020 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3944/7914] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:18 2022] PUT /identity/v3/projects/a0be30e6c24346cdb352f6079c799c81/users/ef3b10b9f89948d7b4896aa81ebaf439/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:19.013953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.014235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.014648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.022807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] MFA Rules not processed for user `7c018cfffbe54e02b1f304fe0b26a59a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:19.025262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:19.053138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] MFA Rules not processed for user `ef3b10b9f89948d7b4896aa81ebaf439`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:19.054595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:19.150668 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3945/7915] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:19.158140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.161671 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3971/7916] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:19.181466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.183373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:19.279280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38128b21-32af-4b0b-b7f7-fcc62edf0e24 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.284610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.285611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.286019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.286569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.310946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.314321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.334088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd398d-9f52-4551-8c3e-5f81f97df1ea None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.336439 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3972/7917] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:19.349935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.350620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.350900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.351165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.351842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.355993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.400692 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3946/7918] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:19 2022] POST /identity/v3/projects => generated 389 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:19.405929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.422689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1297d-9a1e-46ba-9226-30b330118f4d service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.502091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:19.546195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.549035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.549319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.549744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.550246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.555733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.574231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.576198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:19.611911 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3973/7919] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:19 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:19.616375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.648277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019d4ba-050e-46f4-8e9f-8ecddf887e0c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.664819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.666415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.666727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.667004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.667908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.669265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.706724 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3974/7920] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:42:19.708206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.716083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:19.736210 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d9ec2-151a-4c87-aebd-b7bd6d3b25fe admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.756007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.757074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.757564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.758052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] PATH_INFO: `/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9/users/e0726a9892914da08daaf891feeb177a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.793417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de842e-18b6-42fc-984d-718f6123317a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:19.806074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485bf56a7ac4338b1b4f36fe5ebb6b9, user_id=e0726a9892914da08daaf891feeb177a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.809977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:19.810863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:19.811143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:19.811414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:19.811706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.817786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:19.851174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:19.851462 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3975/7921] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:19 2022] PUT /identity/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9/users/e0726a9892914da08daaf891feeb177a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:19.856663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:19.859021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:19.889679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3947/7922] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:20.058291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a69adb-940d-40db-95d2-f0b58b638e72 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:20.076149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:20.076786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:20.077094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:20.077547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:20.078213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:20.079926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cc56f-90de-4922-8703-7da300393c82 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:20.100074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3976/7923] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:20.101646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:20.116450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b13287-a575-4b01-b8a3-ba972a025acf service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:20.122699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:20.123370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:20.123645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:20.123920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] PATH_INFO: `/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9/users/e0726a9892914da08daaf891feeb177a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:20.126294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485bf56a7ac4338b1b4f36fe5ebb6b9, user_id=e0726a9892914da08daaf891feeb177a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:20.129719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:20.143528 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3948/7924] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:20 2022] PUT /identity/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9/users/e0726a9892914da08daaf891feeb177a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:20.155383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8897-45b7-4b9b-bc70-80972f0f8148 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:20.155580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8897-45b7-4b9b-bc70-80972f0f8148 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:20.155835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8897-45b7-4b9b-bc70-80972f0f8148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:20.220402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-976b8897-45b7-4b9b-bc70-80972f0f8148 None None] MFA Rules not processed for user `e0726a9892914da08daaf891feeb177a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:20.222426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-976b8897-45b7-4b9b-bc70-80972f0f8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:20.315877 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3977/7925] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:20.326158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:20.328167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:20.446680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0c8a-dbea-4743-9e47-d9bec41215e8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:20.453786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:20.454415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:20.454688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:20.454953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:20.559143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:20.561873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:20.581339 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3949/7926] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:20.961198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:20.962072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:20.963175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:20.992541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:20.993977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:21.012129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:21.097210 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3978/7927] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:42:21.119426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:21.123167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:21.230150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8809e-2d6d-4b4f-b824-d5c469642efe service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:21.236602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:21.237509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:21.237776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:21.238049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:21.250701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:21.255342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:21.301374 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3950/7928] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:42:24.069121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:24.085979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a4888-b322-4057-acdc-5a4bc0d3efe0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:24.107323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:24.109416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:24.109956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:24.110238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:24.137520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:24.139171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:24.167640 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3979/7929] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:26.756473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:26.765541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:26.936594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a14b-f0c8-47f2-b0e5-3e12d9bc74b7 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:26.952903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:26.953245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:26.953485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:26.953914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] PATH_INFO: `/v3/users/7c018cfffbe54e02b1f304fe0b26a59a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:26.955063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c018cfffbe54e02b1f304fe0b26a59a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:26.958313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:26.980061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:26.985959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.022191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915cfa7-ff97-4228-91b0-31b70caf131e service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:27.037940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:27.038921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:27.040118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:27.043120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] PATH_INFO: `/v3/users/e4dd2c3b9b684160aa8511d85b5ec446` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:27.046107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4dd2c3b9b684160aa8511d85b5ec446)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:27.051521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:27.091940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c018cfffbe54e02b1f304fe0b26a59a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.093389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c018cfffbe54e02b1f304fe0b26a59a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.111974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c018cfffbe54e02b1f304fe0b26a59a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.112986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c018cfffbe54e02b1f304fe0b26a59a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.128168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c018cfffbe54e02b1f304fe0b26a59a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.164984 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3951/7930] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:26 2022] DELETE /identity/v3/users/7c018cfffbe54e02b1f304fe0b26a59a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:27.166396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:27.174450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.205492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4dd2c3b9b684160aa8511d85b5ec446'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.224484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4dd2c3b9b684160aa8511d85b5ec446'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.227034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4dd2c3b9b684160aa8511d85b5ec446'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.254225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4dd2c3b9b684160aa8511d85b5ec446'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.257968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-168259eb-e22a-4e57-aba6-2ddf7117dfca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4dd2c3b9b684160aa8511d85b5ec446'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:27.325836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3980/7931] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:26 2022] DELETE /identity/v3/users/e4dd2c3b9b684160aa8511d85b5ec446 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:27.331279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:27.331611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:27.333123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:27.351689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231d107-f2aa-4a23-a747-432cb7b06511 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:27.405959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:27.429018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:27.429018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.502175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:27.502820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:27.503099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:27.503376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:27.507770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.530357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:27.532452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:27.555313 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3981/7932] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:27.560327 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3952/7933] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:27.795238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:27.796729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.835564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:27.877328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:27.879530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.915657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f675f-8ff1-4cd9-9e40-7319cd6397d2 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:27.923850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:27.925310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:27.925970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:27.926419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] PATH_INFO: `/v3/projects/dd133cec4ca14729a6dd03a36ba5a7af` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:27.937145 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd133cec4ca14729a6dd03a36ba5a7af)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:27.943366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d4a42-10c9-4cdc-9ef9-dd7b5680d428 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:27.951395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:27.953101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:27.953743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:27.954019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:27.954288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:27.962794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:27.978018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:27.979891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.015291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3982/7934] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:28.017327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:28.018790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:28.058669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fdbf5-cd00-41bb-b670-6bcfc560d882 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:28.078862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd133cec4ca14729a6dd03a36ba5a7af', 'request_id': 'req-65e37963-31ce-4ea1-af83-3c7d587e785b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:28.096248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd133cec4ca14729a6dd03a36ba5a7af', 'request_id': 'req-65e37963-31ce-4ea1-af83-3c7d587e785b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:28.109706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd133cec4ca14729a6dd03a36ba5a7af', 'request_id': 'req-65e37963-31ce-4ea1-af83-3c7d587e785b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:28.128687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] The token cache is being invalidate because project dd133cec4ca14729a6dd03a36ba5a7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:28.129109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:28.132402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-65e37963-31ce-4ea1-af83-3c7d587e785b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:28.136786 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3953/7935] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:27 2022] DELETE /identity/v3/projects/dd133cec4ca14729a6dd03a36ba5a7af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:28.139493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.139775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.140050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.182870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:28.184111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:28.189418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:28.190039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.190323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.190596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.194521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:28.306502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:28.310563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd37a59-d678-43f9-be84-c2c63b31cd58 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.336761 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3983/7936] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:28.361388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3954/7937] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:28.372396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.372685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.372969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.402595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:28.404036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:28.413667 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3984/7938] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:28.418861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:28.434972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3013d02-7fb6-45f9-bc1d-4d5d0bc6a773 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:28.445866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:28.446521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.446866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.447212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.448146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:28.448702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:28.453267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.488840 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3955/7939] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:28.492031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:28.509396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0a37-f0fb-440f-b509-a4af40704ad0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:28.529325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:28.530195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.534080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.534609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.537612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:28.548181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.652508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3985/7940] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:28 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:28.661917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:28.679525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de6bfe-e218-432e-89bf-857f062dbf70 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:28.743271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:28.852080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:28.852665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.853021 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.853301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.855458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:28.857801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.919046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3956/7941] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:28 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:28.921176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:28.941234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4397e-4f6b-4d80-834c-112f2ef190f2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:28.954001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:28.954617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:28.954897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:28.955171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:28.955833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:28.957511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:28.984002 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3986/7942] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:28.986917 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.007626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d495b-f456-4ba2-ba9d-7e15cb974d15 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.031143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.032011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.032408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.032902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.033742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.035667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.061999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.064713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:29.077047 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3957/7943] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:29.081924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.095784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91278a-2919-490a-b2b3-e7e25a2621ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.101678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc7aa-d223-46a7-996c-af0b812fb417 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.112305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.117172 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.117593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.117976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] PATH_INFO: `/v3/projects/4c67dbe632f640a0a25e38ea18a59e4d/users/968d91dedcfb4f4ea5151fe7f165b6bd/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.122606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.123280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.123576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.124550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] PATH_INFO: `/v3/projects/10df77774a2a4be6b36f37d238637345` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.125886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10df77774a2a4be6b36f37d238637345)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.128872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.150567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c67dbe632f640a0a25e38ea18a59e4d, user_id=968d91dedcfb4f4ea5151fe7f165b6bd, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.155129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f40b07-baa6-413f-b1bb-fa4599ce5e37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.182546 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3958/7944] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:29 2022] PUT /identity/v3/projects/4c67dbe632f640a0a25e38ea18a59e4d/users/968d91dedcfb4f4ea5151fe7f165b6bd/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:29.193433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.193820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.194335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.219965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:29.258763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10df77774a2a4be6b36f37d238637345', 'request_id': 'req-dd3739f4-b6a4-4cc9-8426-4de23e92a154'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:29.268862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] MFA Rules not processed for user `968d91dedcfb4f4ea5151fe7f165b6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:29.270434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:29.273728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10df77774a2a4be6b36f37d238637345', 'request_id': 'req-dd3739f4-b6a4-4cc9-8426-4de23e92a154'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:29.285054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10df77774a2a4be6b36f37d238637345', 'request_id': 'req-dd3739f4-b6a4-4cc9-8426-4de23e92a154'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:29.309342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] The token cache is being invalidate because project 10df77774a2a4be6b36f37d238637345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:29.309750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:29.310608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-dd3739f4-b6a4-4cc9-8426-4de23e92a154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:29.316643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3987/7945] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:29 2022] DELETE /identity/v3/projects/10df77774a2a4be6b36f37d238637345 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:29.318785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a7d9-3c25-4c45-a2b2-4806e4258163 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.319193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a7d9-3c25-4c45-a2b2-4806e4258163 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.319569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8a7d9-3c25-4c45-a2b2-4806e4258163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.346100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ed8a7d9-3c25-4c45-a2b2-4806e4258163 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:29.347481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ed8a7d9-3c25-4c45-a2b2-4806e4258163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:29.366889 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3959/7946] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:29.381991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.384128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:29.478077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81015d-8a9c-4408-9467-fe3988985612 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.485319 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.486333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.486933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.487058 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3988/7947] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:29.495263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.495787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.496084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.496359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.519931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.521771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.535836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:29.537473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:29.541017 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3960/7948] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:42:29.564918 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3989/7949] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:42:29.569076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.585286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4a52-45b4-4716-bbb8-bc51b68adf48 service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.591624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.592463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.592975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.593550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.595561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:29.596024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.602256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.618099 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:29.639924 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3961/7950] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:29.643849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.654456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f4183-dd20-446f-a5c3-e175ef4c5ba1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.659441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.660060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.660342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.660614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.661304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.663197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.717039 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3990/7951] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:29 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:29.720213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.733458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123dba1-881f-49ca-825a-3d7fdfbd7f3a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.821531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.822101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.822386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.822728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.823383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.827898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.862280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3962/7952] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:29 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:29.866667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.880685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eec67-dada-47f8-8c8e-ddfde0de9211 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.887723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.888455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.888849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.889217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.889983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.891724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.904274 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3991/7953] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:29.908420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.919426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e40c-820b-4b2a-b331-343ec4a9b9d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:29.952069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:29.952699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:29.952977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:29.953280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:29.953992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:29.955802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:29.978220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3963/7954] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:42:29.981795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.992037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:29.994102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.001453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3826-befd-4847-8ac4-249c1d46876e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:30.011096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:30.012001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.012575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.013252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] PATH_INFO: `/v3/projects/dbc3035329624f6a8575432250ded132/users/12da82564a6f4e08901a3c518e43d425/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.018710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84de6-cb3b-4e70-9cf5-6339b573bf1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:30.025533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:30.027611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.028235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.028770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] PATH_INFO: `/v3/users/ef3b10b9f89948d7b4896aa81ebaf439` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.030254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3b10b9f89948d7b4896aa81ebaf439)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:30.032701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:30.033518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc3035329624f6a8575432250ded132, user_id=12da82564a6f4e08901a3c518e43d425, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:30.037110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7a8ce-30a1-4258-9ec0-cbcd227bdf40 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:30.071963 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3992/7955] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:29 2022] PUT /identity/v3/projects/dbc3035329624f6a8575432250ded132/users/12da82564a6f4e08901a3c518e43d425/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:30.096509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.097031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.097950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.101077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3b10b9f89948d7b4896aa81ebaf439'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.102048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3b10b9f89948d7b4896aa81ebaf439'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.112467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3b10b9f89948d7b4896aa81ebaf439'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.113403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3b10b9f89948d7b4896aa81ebaf439'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.124362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-fceefff9-62c2-4434-8119-a21bd46b45b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3b10b9f89948d7b4896aa81ebaf439'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.152987 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3964/7956] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:29 2022] DELETE /identity/v3/users/ef3b10b9f89948d7b4896aa81ebaf439 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:30.157525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.158033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.158479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.158742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] MFA Rules not processed for user `12da82564a6f4e08901a3c518e43d425`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:30.162640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.187987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:30.189920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.240582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:30.264858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:30.276843 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3993/7957] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:30.287360 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3965/7958] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:30.289023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:30.297837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:30.298159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.299521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.373197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6fe5b-cd92-4c51-add3-806bb6b3197b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:30.377100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:30.377734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.378012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.378285 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.383140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a007ca-f1c3-42b1-b1e2-d46e61e0dd83 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:30.388349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:30.389299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.389755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.390190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.390773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:30.392320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:30.401692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:30.403326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:30.406877 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3966/7959] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:30.423635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3994/7960] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:30.704856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:30.708275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:30.738185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dfdf1-077e-46f4-96dc-aa88b367eeb7 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:30.759899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:30.764936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:30.765896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:30.767435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] PATH_INFO: `/v3/projects/a0be30e6c24346cdb352f6079c799c81` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:30.769052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0be30e6c24346cdb352f6079c799c81)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:30.772273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:30.866856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0be30e6c24346cdb352f6079c799c81', 'request_id': 'req-04d8052c-0a9a-4182-af6c-efc216a7f1c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.877923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0be30e6c24346cdb352f6079c799c81', 'request_id': 'req-04d8052c-0a9a-4182-af6c-efc216a7f1c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.891220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0be30e6c24346cdb352f6079c799c81', 'request_id': 'req-04d8052c-0a9a-4182-af6c-efc216a7f1c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.907858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] The token cache is being invalidate because project a0be30e6c24346cdb352f6079c799c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:30.908522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.909645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:30.913160 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3967/7961] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:30 2022] DELETE /identity/v3/projects/a0be30e6c24346cdb352f6079c799c81 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:30.918226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:30.969022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ab23-ddb8-4fd2-9c94-73bb62cf9678 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:31.085181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:31.086158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:31.086158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:31.086502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] PATH_INFO: `/v3/users/e0726a9892914da08daaf891feeb177a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:31.090475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0726a9892914da08daaf891feeb177a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:31.093609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:31.168338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0726a9892914da08daaf891feeb177a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.178354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0726a9892914da08daaf891feeb177a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.179223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0726a9892914da08daaf891feeb177a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.189954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0726a9892914da08daaf891feeb177a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.190620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e1863179-8e76-4044-8446-3df0d431cc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0726a9892914da08daaf891feeb177a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.211986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3995/7962] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:30 2022] DELETE /identity/v3/users/e0726a9892914da08daaf891feeb177a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:31.598085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:31.602090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:31.618301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8052c-0a9a-4182-af6c-efc216a7f1c6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:31.722520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:31.724509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:31.725022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:31.725581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] PATH_INFO: `/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:31.727177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3485bf56a7ac4338b1b4f36fe5ebb6b9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:31.730067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:31.768836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:31.805108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3485bf56a7ac4338b1b4f36fe5ebb6b9', 'request_id': 'req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.815970 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3485bf56a7ac4338b1b4f36fe5ebb6b9', 'request_id': 'req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.827805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3485bf56a7ac4338b1b4f36fe5ebb6b9', 'request_id': 'req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.847143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] The token cache is being invalidate because project 3485bf56a7ac4338b1b4f36fe5ebb6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:31.848012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.848906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ecdb62a1-a18f-49a8-b3a1-ca4bf5e278fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:31.854625 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3968/7963] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:31 2022] DELETE /identity/v3/projects/3485bf56a7ac4338b1b4f36fe5ebb6b9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:31.859583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:31.859870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:31.860144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:31.871480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:31.887950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:31.889732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:32.000713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3996/7964] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:42:32.008385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.008665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.008936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.051967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:32.052632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:32.075976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3969/7965] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:42:32.078894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.090024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa143-acc9-4faf-adf9-f4dfef6ea35e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.096334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.097158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.097435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.097707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.098750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:32.099053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.103633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.144298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.146830 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3997/7966] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:32.156141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f83854-4e78-4d52-b28e-992d80cdc3f1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.164074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.164795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.165227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.165586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.166362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.168779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.213255 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3970/7967] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:42:32.214876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.226549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc316c-6555-4b2e-b891-05e3dc28321f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.376174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.378119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.378808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.379739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.382196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.387991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.425500 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3998/7968] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:32.429397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.444648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550244d2-260e-4af8-911b-aea04ffb7530 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.453902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.454524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.454803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.455070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.455721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.457443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.469665 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3971/7969] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:32.473774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.489979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d57bb8-1b49-447d-8486-575bc94b28c9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.496052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.496673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.496957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.497270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.497958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.499569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99630424-6479-4ef2-951d-16df05ea12c5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.518779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.525463 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 3999/7970] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:32.530598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e26b06-6b70-4ee8-a7c3-c58a8efc17a7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.535793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.536420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.536700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.536974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] PATH_INFO: `/v3/projects/fcc49ad55c7548a1b01b149da2d7676f/users/662cf7b1668d4dd9b442043dceaab856/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.563782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc49ad55c7548a1b01b149da2d7676f, user_id=662cf7b1668d4dd9b442043dceaab856, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.567939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.584663 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3972/7971] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:32 2022] PUT /identity/v3/projects/fcc49ad55c7548a1b01b149da2d7676f/users/662cf7b1668d4dd9b442043dceaab856/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:32.596736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.597062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.597366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.654513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] MFA Rules not processed for user `662cf7b1668d4dd9b442043dceaab856`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:32.659092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:32.786526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:32.796019 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4000/7972] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:32.797056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.888661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0984d2-04bf-460e-89d6-f7c48f836666 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:32.893365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:32.894058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:32.894481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:32.894799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:32.895435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:32.897471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:32.925228 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3973/7973] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:32.934166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:32.946629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b217c-d50f-4aa1-b950-e70458338c9b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.015450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.016069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.016503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.016786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.017460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.019393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.053377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4001/7974] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:32 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:33.053973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:33.067591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2be0-8908-4ca9-aad4-c744aefbf489 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.073260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.074110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.074459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.074739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.075414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.077037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.089167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3974/7975] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:42:33.093493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:33.106115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dde77-83d3-4c7c-8084-aac7ba087301 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.115803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.117338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.117958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.118317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] PATH_INFO: `/v3/projects/9239bc180d004cf995ccbda62ffac22b/users/d992079dd4384aefb6f702b430cde783/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.142894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9239bc180d004cf995ccbda62ffac22b, user_id=d992079dd4384aefb6f702b430cde783, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.146125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.164206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4002/7976] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:33 2022] PUT /identity/v3/projects/9239bc180d004cf995ccbda62ffac22b/users/d992079dd4384aefb6f702b430cde783/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:33.165506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:33.177614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721417-1fed-4c67-98bd-8360ce967df6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.194536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:33.253063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.253612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.254138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.254420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.256064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.261280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dd646-889f-4268-a76d-52401eef41b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.280152 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3975/7977] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:33.284107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:33.297795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5be44d-262b-40bb-97c5-1c992be18d00 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.305786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.306492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.306870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.307838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] PATH_INFO: `/v3/projects/9239bc180d004cf995ccbda62ffac22b/users/d992079dd4384aefb6f702b430cde783/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.309819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9239bc180d004cf995ccbda62ffac22b, user_id=d992079dd4384aefb6f702b430cde783, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.312449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.336219 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4003/7978] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:33 2022] PUT /identity/v3/projects/9239bc180d004cf995ccbda62ffac22b/users/d992079dd4384aefb6f702b430cde783/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:33.338645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.340520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.340814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.391843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] MFA Rules not processed for user `d992079dd4384aefb6f702b430cde783`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:33.393954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:33.484472 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3976/7979] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:33.502104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:33.509322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:33.612063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2228a6a-04f8-4bdf-979d-abe0ed0cea4c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:33.617536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:33.618594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:33.619047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:33.620023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:33.706367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:33.707724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:33.718179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4004/7980] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:34.132146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:34.135850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:34.169266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0130-19bd-4308-a376-3a783a9dfbbd None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:34.184024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:34.184960 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:34.187837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:34.188222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:34.211938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:34.214027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:34.226717 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3977/7981] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:42:34.396716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:34.398241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:34.416864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:34.520689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d712add-1102-4fea-94b8-b1dac754de1a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:34.524687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:34.542777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:34.543139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:34.543420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:34.547721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:34.656861 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:34.658659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ba833-a256-4905-b73b-6e3fa17d66c4 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:34.680647 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4005/7982] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:44.220345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=61 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:44.668687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:45.054232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:45.202876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b420-ef7d-4ac4-bfbb-c46261955396 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:45.208581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:45.209269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:45.209678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:45.209860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] PATH_INFO: `/v3/users/662cf7b1668d4dd9b442043dceaab856` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:45.211414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] RBAC: Authorizing `identity:delete_user(user_id=662cf7b1668d4dd9b442043dceaab856)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:45.214310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:45.326380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662cf7b1668d4dd9b442043dceaab856'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:45.327178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662cf7b1668d4dd9b442043dceaab856'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:45.341922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662cf7b1668d4dd9b442043dceaab856'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:45.343008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662cf7b1668d4dd9b442043dceaab856'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:45.355507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662cf7b1668d4dd9b442043dceaab856'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:45.399271 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3978/7983] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:45 2022] DELETE /identity/v3/users/662cf7b1668d4dd9b442043dceaab856 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:45.403934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:45.405098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:45.405743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:45.468318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:45.471141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:45.631051 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4006/7984] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:45.644503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:45.647074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:45.861574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fbca-db00-4b31-b5f8-ea083e2f176e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:45.871089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:45.872846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:45.874069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:45.874353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:45.901755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:45.903516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:45.928167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3979/7985] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:46.381513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:46.385854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:46.459698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcbfb-90bc-48eb-ab5e-636489e66c15 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:46.501207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:46.502571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:46.504373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:46.505259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] PATH_INFO: `/v3/projects/fcc49ad55c7548a1b01b149da2d7676f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:46.519453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc49ad55c7548a1b01b149da2d7676f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:46.522591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:46.606554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc49ad55c7548a1b01b149da2d7676f', 'request_id': 'req-db0270a0-c546-47f6-9c0b-72221e0fe24b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:46.631519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc49ad55c7548a1b01b149da2d7676f', 'request_id': 'req-db0270a0-c546-47f6-9c0b-72221e0fe24b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:46.653942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc49ad55c7548a1b01b149da2d7676f', 'request_id': 'req-db0270a0-c546-47f6-9c0b-72221e0fe24b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:46.686234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] The token cache is being invalidate because project fcc49ad55c7548a1b01b149da2d7676f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:46.687034 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:46.688252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:46.694109 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4007/7986] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:46 2022] DELETE /identity/v3/projects/fcc49ad55c7548a1b01b149da2d7676f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:46.694749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:46.723888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1da4-fa7d-429e-9d1c-73999ee03e26 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:46.780638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:46.915604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:46.917403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:46.919206 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:46.920180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] PATH_INFO: `/v3/users/d992079dd4384aefb6f702b430cde783` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:46.924700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d992079dd4384aefb6f702b430cde783)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:46.931951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:47.024758 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd992079dd4384aefb6f702b430cde783'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.025810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd992079dd4384aefb6f702b430cde783'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.035043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd992079dd4384aefb6f702b430cde783'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.036062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd992079dd4384aefb6f702b430cde783'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.045991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-505c84b0-d9be-4cd4-8140-a269781c7409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd992079dd4384aefb6f702b430cde783'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.078270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3980/7987] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:46 2022] DELETE /identity/v3/users/d992079dd4384aefb6f702b430cde783 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:47.466800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:47.468873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:47.503919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0270a0-c546-47f6-9c0b-72221e0fe24b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:47.655163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:47.656387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:47.656819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:47.657293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] PATH_INFO: `/v3/projects/9239bc180d004cf995ccbda62ffac22b` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:47.659487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9239bc180d004cf995ccbda62ffac22b)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:47.662826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:47.746962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:47.793214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9239bc180d004cf995ccbda62ffac22b', 'request_id': 'req-60b11a11-4348-4aed-b5d6-76a5202c34bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.810267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9239bc180d004cf995ccbda62ffac22b', 'request_id': 'req-60b11a11-4348-4aed-b5d6-76a5202c34bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.823900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9239bc180d004cf995ccbda62ffac22b', 'request_id': 'req-60b11a11-4348-4aed-b5d6-76a5202c34bc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.855896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] The token cache is being invalidate because project 9239bc180d004cf995ccbda62ffac22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:47.856803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.858564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-60b11a11-4348-4aed-b5d6-76a5202c34bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:47.865069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4008/7988] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:47 2022] DELETE /identity/v3/projects/9239bc180d004cf995ccbda62ffac22b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:47.871165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:47.871881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:47.872458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:47.911355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:47.914372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:48.077871 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3981/7989] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:48.088842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.089591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.090066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.144322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:48.145858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:48.158588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4009/7990] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:48.159888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.172433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2cd51-041b-4fdf-96c8-5eaa6e29d864 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.177802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.178434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.178713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.178984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.179642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:48.179946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.182586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:48.258485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3982/7991] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:48.263592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.287158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633473-a67e-47a9-8834-f21a4e6b011c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.308715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.310517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.311945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.312432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.313776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.320331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:48.372569 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4010/7992] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:48 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:48.374373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.411136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214b053-b54e-426a-a344-0c481ea0b518 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.513419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:48.578278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.578988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.579342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.579689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.580552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.583253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:48.637681 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3983/7993] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:48 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:48.642522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.669324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcef0b-5207-41f4-9d0f-0d2e90e60f67 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.717229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.718470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.719202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.719934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.721902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.727222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:48.754601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4011/7994] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:48.758833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.785720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b0f2-eac7-49a2-98d6-f6f4514505a9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.859647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.861315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.862775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.863768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.865321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.873062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d68b8-f0ef-4045-815e-93b5a20f02f0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:48.899448 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3984/7995] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:42:48.907516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:48.921127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c02dc-c3b4-4196-be05-321789269313 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:48.926515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:48.927504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:48.928014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:48.928652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] PATH_INFO: `/v3/projects/0c0e0a95f32b4cec8a4f710d6cd1b5fe/users/ebf52c3fa88b4903be90b8d2dba48b66/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:48.983231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0e0a95f32b4cec8a4f710d6cd1b5fe, user_id=ebf52c3fa88b4903be90b8d2dba48b66, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:48.992214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:49.029033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4012/7996] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:48 2022] PUT /identity/v3/projects/0c0e0a95f32b4cec8a4f710d6cd1b5fe/users/ebf52c3fa88b4903be90b8d2dba48b66/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:49.031774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:49.032069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:49.032346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:49.109509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] MFA Rules not processed for user `ebf52c3fa88b4903be90b8d2dba48b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:49.111028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:49.394977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3985/7997] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:49.396111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:49.535368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67d928-e5b3-48c9-9d50-732694c8fea3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:49.555574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:49.557120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:49.557544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:49.557961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:49.559147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:49.562369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:49.627605 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4013/7998] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:49 2022] POST /identity/v3/projects => generated 369 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:42:49.635442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:49.667144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4b0b7-36c0-438f-999f-999711c15a0d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:49.780389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:49.781162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:49.781513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:49.782036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:49.783374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:49.785554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:49.831247 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3986/7999] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:42:49 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:49.832298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:49.851135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49178e8b-54de-47ce-b331-a41a6f1e8815 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:49.860203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:49.861820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:49.862086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:49.862551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:49.864277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:49.867012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:49.883175 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4014/8000] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:42:49.889964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:49.903735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c946c-bcc4-4f72-9209-fdacc3531098 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:49.908769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:49.909492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:49.909771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:49.910048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] PATH_INFO: `/v3/projects/a5c0a6a4d66d4e088826328f682f47c1/users/bf6a07c8d9384042879e7dc8b902a9e4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:49.952431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c0a6a4d66d4e088826328f682f47c1, user_id=bf6a07c8d9384042879e7dc8b902a9e4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:49.955248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:49.981679 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3987/8001] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:49 2022] PUT /identity/v3/projects/a5c0a6a4d66d4e088826328f682f47c1/users/bf6a07c8d9384042879e7dc8b902a9e4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:49.988489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:50.005474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513add-ec49-46e4-ade6-3dddd5c3c8e9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:50.047271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:50.103788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:50.104441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:50.104712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:50.105150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:50.105907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:50.107501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606e145-23a6-4049-8cfb-d85108896aae admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:50.132475 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4015/8002] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:42:50.133574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:50.143066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:50.153357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199ccb-2152-4714-98f5-c2cff80f0180 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:50.172525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:50.174103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:50.174474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:50.174842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] PATH_INFO: `/v3/projects/a5c0a6a4d66d4e088826328f682f47c1/users/bf6a07c8d9384042879e7dc8b902a9e4/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:50.177213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c0a6a4d66d4e088826328f682f47c1, user_id=bf6a07c8d9384042879e7dc8b902a9e4, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:50.182775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:50.206713 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3988/8003] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:42:50 2022] PUT /identity/v3/projects/a5c0a6a4d66d4e088826328f682f47c1/users/bf6a07c8d9384042879e7dc8b902a9e4/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:42:50.208781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:50.209115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:50.209397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:50.285487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] MFA Rules not processed for user `bf6a07c8d9384042879e7dc8b902a9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:50.289026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:50.456815 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4016/8004] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:50.469198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:50.471496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:50.632295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3262eb-3fdf-40a9-9721-1d1f4c4271e3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:50.636764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:50.637524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:50.637899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:50.638362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:50.653281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:50.655069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597b85-083f-4a59-981e-6efc6dcfbf64 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:50.670996 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3989/8005] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:54.451690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:54.453258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:54.572668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae2b2-b013-4c76-b5a8-156f22f4714f None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:54.578483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:54.579313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:54.579693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:54.580073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] PATH_INFO: `/v3/users/12da82564a6f4e08901a3c518e43d425` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:54.581561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12da82564a6f4e08901a3c518e43d425)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:54.584148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:54.669413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12da82564a6f4e08901a3c518e43d425'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:54.672251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:54.686484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12da82564a6f4e08901a3c518e43d425'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:54.689426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12da82564a6f4e08901a3c518e43d425'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:54.713772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12da82564a6f4e08901a3c518e43d425'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:54.714535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12da82564a6f4e08901a3c518e43d425'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:54.763894 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4017/8006] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:42:54 2022] DELETE /identity/v3/users/12da82564a6f4e08901a3c518e43d425 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:54.772420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:54.772936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:54.772936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:54.823914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:42:54.825892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:54.998887 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3990/8007] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:42:55.005885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:55.007432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:55.136873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0ad0b-9752-4452-bc52-b7172b28db47 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:55.148162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:55.148805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:55.149103 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:55.149429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:55.173356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:55.174807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:55.195801 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4018/8008] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:42:55.922218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:55.960933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:56.084249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33eebd-3a83-466b-bde8-8525f9b6a4b5 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:56.117950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:56.120320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:56.131440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:56.132474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] PATH_INFO: `/v3/projects/dbc3035329624f6a8575432250ded132` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:56.136405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc3035329624f6a8575432250ded132)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:56.142700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:56.267588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc3035329624f6a8575432250ded132', 'request_id': 'req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:56.279998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc3035329624f6a8575432250ded132', 'request_id': 'req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:56.289944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc3035329624f6a8575432250ded132', 'request_id': 'req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:56.316439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] The token cache is being invalidate because project dbc3035329624f6a8575432250ded132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:42:56.316737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:56.317420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:42:56.324831 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3991/8009] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:42:55 2022] DELETE /identity/v3/projects/dbc3035329624f6a8575432250ded132 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:42:59.387346 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:59.389433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:59.538344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296187-d81f-43fc-bccc-4d9eea34589b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:59.677828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf6a07c8d9384042879e7dc8b902a9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c0a6a4d66d4e088826328f682f47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:59.678891 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:59.679390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:59.679903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:59.681913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:59.685804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:59.689303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:59.735432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:59.736781 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4019/8010] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:42:59.745711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:42:59.795608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc1e71-549c-43e9-b3d7-a9dfe9b93cd1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:59.801669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf6a07c8d9384042879e7dc8b902a9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c0a6a4d66d4e088826328f682f47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:59.802298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:59.802577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:59.802846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:59.803483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:59.805501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:59.823883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:59.849853 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3992/8011] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:42:59 2022] POST /identity/v3/projects => generated 349 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:42:59.850840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:42:59.865877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823467-15cc-4ce6-84be-04712592f908 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:42:59.872655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:42:59.959629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf6a07c8d9384042879e7dc8b902a9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c0a6a4d66d4e088826328f682f47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:42:59.959985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:42:59.961316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:42:59.961316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:42:59.961316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:42:59.961626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:42:59.964118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:42:59.983147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4020/8012] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:43:00.719895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:00.746281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44638d-ca78-477a-8f78-c7ada3503a95 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:00.763216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf6a07c8d9384042879e7dc8b902a9e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5c0a6a4d66d4e088826328f682f47c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:00.764472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:00.764912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:00.765388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] PATH_INFO: `/v3/projects/d2bc8158dc8641509c2b7d69442ca1ed` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:00.766812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2bc8158dc8641509c2b7d69442ca1ed)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:00.771576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:00.951928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bc8158dc8641509c2b7d69442ca1ed', 'request_id': 'req-e22dc02e-c309-4487-a79e-b00ea8c466fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:00.984965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bc8158dc8641509c2b7d69442ca1ed', 'request_id': 'req-e22dc02e-c309-4487-a79e-b00ea8c466fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:01.018463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bc8158dc8641509c2b7d69442ca1ed', 'request_id': 'req-e22dc02e-c309-4487-a79e-b00ea8c466fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:01.081533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] The token cache is being invalidate because project d2bc8158dc8641509c2b7d69442ca1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:01.081533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:01.082094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:01.084534 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3993/8013] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:00 2022] DELETE /identity/v3/projects/d2bc8158dc8641509c2b7d69442ca1ed => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:01.099294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:01.102846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:01.277939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d107fd-0e36-449e-ad90-9ff566f236c4 tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:01.376978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:01.377668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:01.377942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:01.378207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:01.380678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:01.479635 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:01.481912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:01.510657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4021/8014] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:01.983067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:01.985441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:02.149859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc02e-c309-4487-a79e-b00ea8c466fb tempest-RoutersAdminTest-1958046263 tempest-RoutersAdminTest-1958046263-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:02.158464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:02.159337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:02.159888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:02.160383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:02.162920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:02.179983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:02.182691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:02.208502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3994/8015] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:02.686049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:02.708237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe39411-53f5-49f3-85bf-ce1c45d1b582 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:02.720535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:02.721202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:02.722175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:02.722454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:02.727131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:02.766574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:02.768569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:02.775920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:02.794009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4022/8016] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:03.001996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:03.003805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:03.034144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b451e-3755-4e0f-afb4-f878dcf7574c service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:03.048971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:03.050876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:03.052809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:03.053170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:03.057352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:03.125675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:03.127480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:03.160604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3995/8017] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:03.480866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:03.483650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:03.505824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeaf67-21e5-493d-808e-c2186bb1583b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:03.529672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:03.530300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:03.530578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:03.530843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:03.532690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:03.660858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:03.664964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:03.688673 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4023/8018] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:13.136572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=2,keystone:SELECT=67,keystone:DELETE=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:13.673557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=34 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:23.014906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:23.016433 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:23.108380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ba612-ff84-44e3-bbdc-ed286ddb0b64 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:23.113081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:23.113831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:23.115228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:23.115714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] PATH_INFO: `/v3/users/563a2112837048d693979d948c066894` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:23.117591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563a2112837048d693979d948c066894)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:23.119579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:23.171919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563a2112837048d693979d948c066894'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:23.172735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563a2112837048d693979d948c066894'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:23.181224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563a2112837048d693979d948c066894'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:23.181834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563a2112837048d693979d948c066894'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:23.189570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cc734619-9139-4f95-abd9-fc9372074c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563a2112837048d693979d948c066894'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:23.207601 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3996/8019] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:23 2022] DELETE /identity/v3/users/563a2112837048d693979d948c066894 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:23.977297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:23.992241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813018-238c-4c39-8fee-2d40e2c33c07 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:24.028173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:24.029148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:24.029382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:24.056283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] MFA Rules not processed for user `93b7f4b9ee5e4b85a95f3989557222ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:24.057966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:24.160888 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3997/8020] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:43:24.214470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:24.215448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:24.215904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:24.216179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] PATH_INFO: `/v3/projects/aec13f6a69f6473ba45dcd9790e2520d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:24.217509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec13f6a69f6473ba45dcd9790e2520d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:24.229424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:24.323677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec13f6a69f6473ba45dcd9790e2520d', 'request_id': 'req-c01a2da7-963f-470b-a702-0864c4eda11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.332086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec13f6a69f6473ba45dcd9790e2520d', 'request_id': 'req-c01a2da7-963f-470b-a702-0864c4eda11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.342498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec13f6a69f6473ba45dcd9790e2520d', 'request_id': 'req-c01a2da7-963f-470b-a702-0864c4eda11a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.376781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] The token cache is being invalidate because project aec13f6a69f6473ba45dcd9790e2520d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:24.377089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.377905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.379920 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4024/8021] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:23 2022] DELETE /identity/v3/projects/aec13f6a69f6473ba45dcd9790e2520d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:24.384838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:24.386505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:24.400760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8eebeb-ddb6-4169-84e0-bae35a91905f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:24.413392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:24.501660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:24.502533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:24.502663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:24.502849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] PATH_INFO: `/v3/users/b582c117f393405ba194fd4a4f6226c0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:24.504106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b582c117f393405ba194fd4a4f6226c0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:24.506220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:24.563991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b582c117f393405ba194fd4a4f6226c0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.565378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b582c117f393405ba194fd4a4f6226c0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.573985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b582c117f393405ba194fd4a4f6226c0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.574797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b582c117f393405ba194fd4a4f6226c0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.583619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-628da923-56af-44dd-bd3e-ff55090d7583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b582c117f393405ba194fd4a4f6226c0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:24.607006 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3998/8022] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:24 2022] DELETE /identity/v3/users/b582c117f393405ba194fd4a4f6226c0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:25.159343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.162037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:25.198687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a2da7-963f-470b-a702-0864c4eda11a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.303385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.304184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.304883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.306059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] PATH_INFO: `/v3/projects/c26ab58329414990be4b8539395d7dea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.307779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26ab58329414990be4b8539395d7dea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.310202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.364112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:25.382091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26ab58329414990be4b8539395d7dea', 'request_id': 'req-de8f4477-9bea-4af5-8991-193ac674441a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:25.389903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26ab58329414990be4b8539395d7dea', 'request_id': 'req-de8f4477-9bea-4af5-8991-193ac674441a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:25.400310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26ab58329414990be4b8539395d7dea', 'request_id': 'req-de8f4477-9bea-4af5-8991-193ac674441a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:25.421163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] The token cache is being invalidate because project c26ab58329414990be4b8539395d7dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:25.421582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:25.423067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-de8f4477-9bea-4af5-8991-193ac674441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:25.425857 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4025/8023] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:25 2022] DELETE /identity/v3/projects/c26ab58329414990be4b8539395d7dea => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:25.432079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.432603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.432882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.468508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:25.470265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:25.566010 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 3999/8024] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:25.576930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.577183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.577453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.619138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:25.620830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:25.636163 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4026/8025] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:25.640457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.654128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943c469-a5f9-4499-99be-d7b5a4b2fb89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.659551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.660435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.660781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.661164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.662054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:43:25.662469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.665178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.684770 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4000/8026] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:43:25.685680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.696680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fc06-6d9b-4a90-8857-6d8465de6f3c None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.701853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.702470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.702745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.703013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.703650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.705594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.747790 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4027/8027] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:25 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:43:25.751274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.763954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45baff48-0ff2-483c-8571-4bad38f81c67 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.786196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:25.837080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.837645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.837929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.838198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.838833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.840790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.865682 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4001/8028] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:25 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:25.870255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.881535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e231e1-2d72-47a0-9db8-b768dc4df872 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.887806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.888754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.888754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.888962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.889638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.891244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.905546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4028/8029] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:25.907401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.919478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2e577-8a35-47f2-8535-3be5c745429b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.924914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.925657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.926044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.926969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.927132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.935279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44d813-9a3e-4477-af9e-7e515f3596ba admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:25.948729 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4002/8030] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:25.953041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:25.965773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b327d-824a-4a32-af2f-8cdc64317a3a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:25.970652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:25.971382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:25.971738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:25.972371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] PATH_INFO: `/v3/projects/4c2d577c0da144d0938db21036a0d808/users/fc41978cca8547c8883fefa7e4ecc932/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:25.996268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2d577c0da144d0938db21036a0d808, user_id=fc41978cca8547c8883fefa7e4ecc932, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:25.999098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:26.014519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4029/8031] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:25 2022] PUT /identity/v3/projects/4c2d577c0da144d0938db21036a0d808/users/fc41978cca8547c8883fefa7e4ecc932/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:26.114983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:26.115216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:26.115473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:26.145391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] MFA Rules not processed for user `fc41978cca8547c8883fefa7e4ecc932`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:26.146622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:26.216602 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4003/8032] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:26.229319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:26.232229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:26.334497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb53b7-ca4b-4a5b-848c-e97a19bb79c8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:26.341040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:26.342565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:26.343641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:26.344184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:26.357593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:26.359978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72b533-72ba-44ed-b867-feb02ce34fe4 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:26.373118 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4030/8033] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:26.655719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:26.660539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:26.825352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caa999-8446-466f-aa34-dc52d01d91b9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:26.830321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:26.831257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:26.831729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:26.832155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] PATH_INFO: `/v3/users/968d91dedcfb4f4ea5151fe7f165b6bd` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:26.833611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968d91dedcfb4f4ea5151fe7f165b6bd)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:26.835748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:26.904010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:26.937032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968d91dedcfb4f4ea5151fe7f165b6bd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:26.940296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968d91dedcfb4f4ea5151fe7f165b6bd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:26.959353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968d91dedcfb4f4ea5151fe7f165b6bd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:26.960296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968d91dedcfb4f4ea5151fe7f165b6bd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:26.974305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968d91dedcfb4f4ea5151fe7f165b6bd'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:27.012117 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4004/8034] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:26 2022] DELETE /identity/v3/users/968d91dedcfb4f4ea5151fe7f165b6bd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:27.014243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:27.014532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:27.014805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:27.080096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:27.083752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:27.190816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:27.218802 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4031/8035] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:27.229782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:27.232251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:27.368550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79ac29-16c8-40c6-be26-7ce6604d3310 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:27.373489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:27.374587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:27.375196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:27.375536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:27.389900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:27.392572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf049df7-9b30-4557-8fa2-5551e499fa59 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:27.442723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4005/8036] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:28.397047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:28.399812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:28.414895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dec7c3-7a15-4314-9a36-1463c171fa51 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:28.420179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:28.421393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.421833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.422278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] PATH_INFO: `/v3/projects/4c67dbe632f640a0a25e38ea18a59e4d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.424465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c67dbe632f640a0a25e38ea18a59e4d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:28.427186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:28.530712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c67dbe632f640a0a25e38ea18a59e4d', 'request_id': 'req-3742a023-8b59-4281-935a-5e4385ee3e8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:28.543486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c67dbe632f640a0a25e38ea18a59e4d', 'request_id': 'req-3742a023-8b59-4281-935a-5e4385ee3e8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:28.554381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c67dbe632f640a0a25e38ea18a59e4d', 'request_id': 'req-3742a023-8b59-4281-935a-5e4385ee3e8c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:28.579532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] The token cache is being invalidate because project 4c67dbe632f640a0a25e38ea18a59e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:28.579820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:28.581024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3742a023-8b59-4281-935a-5e4385ee3e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:28.584068 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4032/8037] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:28 2022] DELETE /identity/v3/projects/4c67dbe632f640a0a25e38ea18a59e4d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:28.590276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.590819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.591042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.628597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:28.630808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:28.722389 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4006/8038] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:28.731017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.731317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.731613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.759285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:28.760470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:28.768588 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4033/8039] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:28.773260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:28.790270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e078c-182f-4b73-8b44-98ee9966121f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:28.796066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:28.796816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.797116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.797386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.798216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:43:28.798351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:28.799908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:28.815244 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4007/8040] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:43:28.818518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:28.831476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71b9a1-a008-497b-ae93-99091e8b4113 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:28.842922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:28.843831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.844272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.844395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.845062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:28.847275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:28.884746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:28.889810 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4034/8041] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:28 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:28.896164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e32f8e-8e55-4f15-af8e-1efc8932d1d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:28.937281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:28.986379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:28.987023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:28.987644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:28.987995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:28.988738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:28.991416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.021618 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4008/8042] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:28 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:43:29.026007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.044481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67876-c67e-4305-9bff-5dfd7ea360a8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.051871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.052496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.052777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.053083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.054057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.056578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.071095 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4035/8043] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:29.075383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.087614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5289-1902-43d0-8e58-23cc6a87af18 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.097467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.098249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.098629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.099012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.099751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.101537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490cf75-8f3a-4023-895d-09f3aa45f129 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.115535 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4009/8044] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:43:29.120564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.131171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00629-971f-4127-b06e-74eebe3622fc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.136869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.137794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.138073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.138363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] PATH_INFO: `/v3/projects/65f1daaa3adc40258f909dc2ff87eba8/users/928b7b2e278d406eac6ecf01af7b91bf/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.160106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f1daaa3adc40258f909dc2ff87eba8, user_id=928b7b2e278d406eac6ecf01af7b91bf, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.163042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.180786 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4036/8045] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:29 2022] PUT /identity/v3/projects/65f1daaa3adc40258f909dc2ff87eba8/users/928b7b2e278d406eac6ecf01af7b91bf/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:29.191497 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.191990 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.192364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.226261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] MFA Rules not processed for user `928b7b2e278d406eac6ecf01af7b91bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:29.228173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:29.322771 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4010/8046] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:29.327474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.427559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4707-9fa7-43af-99f1-830047f9c9bf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.434369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.434980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.435545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.435819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.436485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.438426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.476863 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4037/8047] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:29 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:43:29.480977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.493305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72828ff2-c28a-4ae0-addf-a6953009a880 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.589809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.590437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.591332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.591612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.592257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.595161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.636008 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4011/8048] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:29 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:29.637220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.645095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:29.650518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb8880-39eb-421b-9af2-6159ccd4a7a1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.658921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.660504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.661101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.661673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.662620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.665264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.706706 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4038/8049] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:29.707878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.716028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e2821-8e8a-47b8-ac71-8e07e2d771da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.724447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.725175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.726051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.726051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] PATH_INFO: `/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839/users/281dabe586b2400db0c00623fb27f1fc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.754275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969a56c12a5c4bbb90d9cb48cefa5839, user_id=281dabe586b2400db0c00623fb27f1fc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.757255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.782285 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4012/8050] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:29 2022] PUT /identity/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839/users/281dabe586b2400db0c00623fb27f1fc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:29.786333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.800928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755001e-41bd-47a1-bf16-692902685933 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.879567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.880218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.880491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.880756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.881456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.883904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27940493-dc10-4ba9-951b-0fac5b64c9b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.895887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4039/8051] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:29.900035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:29.908348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:29.912954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012400b-64f8-4265-95ac-584dea5da034 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:29.919586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:29.920411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.920837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.921242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] PATH_INFO: `/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839/users/281dabe586b2400db0c00623fb27f1fc/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.923343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] RBAC: Authorizing `identity:create_grant(project_id=969a56c12a5c4bbb90d9cb48cefa5839, user_id=281dabe586b2400db0c00623fb27f1fc, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:29.926160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:29.940966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4013/8052] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:29 2022] PUT /identity/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839/users/281dabe586b2400db0c00623fb27f1fc/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:29.953589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:29.953903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:29.954143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:29.987217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] MFA Rules not processed for user `281dabe586b2400db0c00623fb27f1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:29.988476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:30.079412 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4040/8053] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:30.093896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:30.096268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:30.171789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40ed63-6d99-44ee-a192-47c73fa5807f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:30.175992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:30.176872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:30.177185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:30.177457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:30.251424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:30.253217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e3b96-11ec-4dd6-8137-975da363b3f7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:30.265089 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4014/8054] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:36.347377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:36.371885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d25c9-51fe-42d5-a893-529c04dcfc7b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:36.377059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:36.378145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:36.378674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:36.379125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:36.394544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:36.398461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:36.417568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4041/8055] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:40.259457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:43.732353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ee83-6be1-4651-b3fa-35fbd1e16fd6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:43.733810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ee83-6be1-4651-b3fa-35fbd1e16fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:43.734291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57ee83-6be1-4651-b3fa-35fbd1e16fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:43.799336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0f57ee83-6be1-4651-b3fa-35fbd1e16fd6 None None] MFA Rules not processed for user `928b7b2e278d406eac6ecf01af7b91bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:43.801490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f57ee83-6be1-4651-b3fa-35fbd1e16fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:43.818277 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4015/8056] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:46.411428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=72 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:48.111631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:48.113104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:48.253384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d61a8-a376-4562-bfd2-0c78fbabb393 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:48.261999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:48.263051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:48.263464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:48.263895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] PATH_INFO: `/v3/users/ebf52c3fa88b4903be90b8d2dba48b66` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:48.265655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf52c3fa88b4903be90b8d2dba48b66)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:48.269231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:48.377905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf52c3fa88b4903be90b8d2dba48b66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:48.394780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf52c3fa88b4903be90b8d2dba48b66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:48.398347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf52c3fa88b4903be90b8d2dba48b66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:48.412869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf52c3fa88b4903be90b8d2dba48b66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:48.414999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf52c3fa88b4903be90b8d2dba48b66'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:48.471517 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4042/8057] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:48 2022] DELETE /identity/v3/users/ebf52c3fa88b4903be90b8d2dba48b66 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:48.476925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:48.477498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:48.477988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:48.515473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:48.523032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:48.646648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4016/8058] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:48.657170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:48.658808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:48.811633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed382e-951a-443f-9547-778bbf408938 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:48.816387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:48.817085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:48.817372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:48.817651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:48.830681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:48.832288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:48.850467 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4043/8059] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:49.237201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:49.238781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:49.275247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f1d9-9019-4f61-8191-5f2b227ada89 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:49.287500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:49.288814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:49.289295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:49.290218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] PATH_INFO: `/v3/projects/0c0e0a95f32b4cec8a4f710d6cd1b5fe` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:49.292379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0e0a95f32b4cec8a4f710d6cd1b5fe)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:49.295419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:49.361226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0e0a95f32b4cec8a4f710d6cd1b5fe', 'request_id': 'req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.373776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0e0a95f32b4cec8a4f710d6cd1b5fe', 'request_id': 'req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.384680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0e0a95f32b4cec8a4f710d6cd1b5fe', 'request_id': 'req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.409203 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] The token cache is being invalidate because project 0c0e0a95f32b4cec8a4f710d6cd1b5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:49.409752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.411073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.417150 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4017/8060] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:49 2022] DELETE /identity/v3/projects/0c0e0a95f32b4cec8a4f710d6cd1b5fe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:49.421479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:49.449264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75866f-ba1d-4d4a-b3ed-0fed15175479 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:49.485581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:49.555709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:49.556394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:49.556653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:49.556921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] PATH_INFO: `/v3/users/bf6a07c8d9384042879e7dc8b902a9e4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:49.558239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6a07c8d9384042879e7dc8b902a9e4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:49.560123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:49.622370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6a07c8d9384042879e7dc8b902a9e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.635044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6a07c8d9384042879e7dc8b902a9e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.635887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6a07c8d9384042879e7dc8b902a9e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.645712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6a07c8d9384042879e7dc8b902a9e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.646507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7206b791-9ae7-4150-b36b-87e616c4e7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6a07c8d9384042879e7dc8b902a9e4'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:49.691376 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4044/8061] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:49 2022] DELETE /identity/v3/users/bf6a07c8d9384042879e7dc8b902a9e4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:49.909209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:49.911416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:49.939406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e33db-bc00-41cf-8d35-5e30e72f4ca0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.037477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.038354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.038719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.039283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] PATH_INFO: `/v3/projects/a5c0a6a4d66d4e088826328f682f47c1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.041086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c0a6a4d66d4e088826328f682f47c1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.042831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.067680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:50.102752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c0a6a4d66d4e088826328f682f47c1', 'request_id': 'req-6344daa1-9229-4a87-b549-294cff5d45c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:50.114576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c0a6a4d66d4e088826328f682f47c1', 'request_id': 'req-6344daa1-9229-4a87-b549-294cff5d45c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:50.123347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c0a6a4d66d4e088826328f682f47c1', 'request_id': 'req-6344daa1-9229-4a87-b549-294cff5d45c7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:50.148904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] The token cache is being invalidate because project a5c0a6a4d66d4e088826328f682f47c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:50.149227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:50.150011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-6344daa1-9229-4a87-b549-294cff5d45c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:50.153912 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4018/8062] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:49 2022] DELETE /identity/v3/projects/a5c0a6a4d66d4e088826328f682f47c1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:50.158668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.158958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.159237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.186859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:50.188643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:50.272584 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4045/8063] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:50.280907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.281753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.281932 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.307363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:50.308599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:50.322927 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4019/8064] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:50.324284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.342429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216e74-a491-4e45-8af3-588d6f406d9a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.351547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.352178 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.352453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.352728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.353793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:43:50.354112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.355736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.384975 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4046/8065] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:43:50.386410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.397111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa938-7cc4-4356-ba15-8cad2fcbd973 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.402408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.403314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.403749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.404196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.405153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.407722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.444854 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4020/8066] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:50 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:50.449183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.468254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d2755-0b78-40d3-9b85-9f31c0743f3c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.507547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:50.587626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.588708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.589107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.589474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.590299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.594073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.628050 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4047/8067] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:50 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:43:50.642526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.655525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e9073-f16d-4aff-a8f7-2ecfe583fd23 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.660434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.661529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.661529 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.661815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.662378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.664330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.678825 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4021/8068] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:50.682115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.697470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199f180-6461-4e1a-b059-a669958692c7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.703654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.704831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.705470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.705924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.708439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.711309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc7055-282e-4330-b1a0-e8a165719ecd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.727325 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4048/8069] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:50.728751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.742609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d07fd5-85e5-4b33-9e9e-a5f1b6593fc7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.755214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.755911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.756326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.756602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] PATH_INFO: `/v3/projects/9d8d3fb3adee4500985e19bcb1f4247b/users/1aa5a06305f4430aad38441cc86936d9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.777791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8d3fb3adee4500985e19bcb1f4247b, user_id=1aa5a06305f4430aad38441cc86936d9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:50.793118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:50.803833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4022/8070] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:50 2022] PUT /identity/v3/projects/9d8d3fb3adee4500985e19bcb1f4247b/users/1aa5a06305f4430aad38441cc86936d9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:50.815936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.816145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.816414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:50.846722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] MFA Rules not processed for user `1aa5a06305f4430aad38441cc86936d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:50.847929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:50.918422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4049/8071] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:50.929167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:50.931554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:50.994130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75ba3-69b3-4386-acbc-0680db9bcbfb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:50.998135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:50.998752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:50.999030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:50.999301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:51.009347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:51.010967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb498fa-25af-4c80-8bd0-64a171b23b0b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:51.020278 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4023/8072] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:53.845557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:53.847671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:53.958713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4eed0-567d-46d0-ab77-6ab0ea113dd5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:53.964958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:53.965767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:53.966058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:53.966334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] PATH_INFO: `/v3/users/fc41978cca8547c8883fefa7e4ecc932` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:53.967530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc41978cca8547c8883fefa7e4ecc932)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:53.976455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:54.057382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:54.077066 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc41978cca8547c8883fefa7e4ecc932'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:54.104773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc41978cca8547c8883fefa7e4ecc932'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:54.106856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc41978cca8547c8883fefa7e4ecc932'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:54.124224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc41978cca8547c8883fefa7e4ecc932'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:54.125517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc41978cca8547c8883fefa7e4ecc932'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:54.169489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4050/8073] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:53 2022] DELETE /identity/v3/users/fc41978cca8547c8883fefa7e4ecc932 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:54.171327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43656d-6203-4063-9451-464a172856b9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:54.172178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43656d-6203-4063-9451-464a172856b9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:54.172660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43656d-6203-4063-9451-464a172856b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:54.199814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e43656d-6203-4063-9451-464a172856b9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:54.201546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e43656d-6203-4063-9451-464a172856b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:54.282745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:54.311727 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4024/8074] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:54.323138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:54.328163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:54.468775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb369-b24f-4136-ae3c-137352b28b90 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:54.481516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:54.482174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:54.482456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:54.482728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:54.506885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:54.509175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f08fef-d55d-4a1a-8a6b-77cafd1f3c52 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:54.529125 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4051/8075] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:55.155201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43656d-6203-4063-9451-464a172856b9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.157416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e43656d-6203-4063-9451-464a172856b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:55.200523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43656d-6203-4063-9451-464a172856b9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.216911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.217774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.218071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.218474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] PATH_INFO: `/v3/projects/4c2d577c0da144d0938db21036a0d808` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.221815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2d577c0da144d0938db21036a0d808)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.223894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.312466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2d577c0da144d0938db21036a0d808', 'request_id': 'req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:55.324927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2d577c0da144d0938db21036a0d808', 'request_id': 'req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:55.337386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2d577c0da144d0938db21036a0d808', 'request_id': 'req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:55.353902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] The token cache is being invalidate because project 4c2d577c0da144d0938db21036a0d808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:55.354496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:55.355535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-145c1d1c-0bdf-453b-a59d-26fcb4f35d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:55.359671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4025/8076] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:55 2022] DELETE /identity/v3/projects/4c2d577c0da144d0938db21036a0d808 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:55.364478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.365424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.365992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.410663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:55.415380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:55.511262 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4052/8077] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:55.512935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.513313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.513767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.544177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:55.545695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:55.557717 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4026/8078] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:43:55.560595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.574722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263a99a-b614-40f7-8983-54fae6198cda None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.580914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.581709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.582064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.582515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.583349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:43:55.584036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.588785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.608858 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4053/8079] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:43:55.610485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.622012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee7b1-cf77-4005-a64b-9c4c9dcd5209 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.634759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.635733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.635733 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.635952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.636549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.638947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.681116 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4027/8080] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:55 2022] POST /identity/v3/projects => generated 359 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:55.682262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.694020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48fac7-c631-4e8d-944d-28554171351c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.774864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:55.797897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.799977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.800574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.800663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.801515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.804778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.845611 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4054/8081] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:55 2022] POST /identity/v3/users => generated 280 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:55.846105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.859343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae808205-3920-4080-bbcd-a204e38db182 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.865798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.867724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.868106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.868499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.869261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.871100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.886406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4028/8082] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:55.890880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.909334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6a393-f3ac-4a94-bb80-4a9ad1b561d0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:55.931990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:55.933157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:55.933593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:55.934025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:55.935045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:55.939471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80edd0-0268-4766-903d-934030a210c0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:55.972657 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4055/8083] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:55.977754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:55.998236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3965-5857-4c5c-8a35-87443a37291e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:56.017316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:56.017999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:56.018294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:56.018554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] PATH_INFO: `/v3/projects/3bab5e8dd95e4b9cb0a335c95014f3ae/users/80a0a6eef526410892a5587d82d0f237/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:56.067121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bab5e8dd95e4b9cb0a335c95014f3ae, user_id=80a0a6eef526410892a5587d82d0f237, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:56.075256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:56.119279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4029/8084] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:55 2022] PUT /identity/v3/projects/3bab5e8dd95e4b9cb0a335c95014f3ae/users/80a0a6eef526410892a5587d82d0f237/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:56.131572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:56.131969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:56.133276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:56.208310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] MFA Rules not processed for user `80a0a6eef526410892a5587d82d0f237`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:56.209591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:56.363899 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4056/8085] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:56.414167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:56.419193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:56.558611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f3e30-0a0c-4a1c-b905-2b15538f7bab admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:56.565275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:56.567053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:56.567334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:56.571228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:56.595793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:56.598195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d1dfc-8df1-4c13-8ce1-e01612738e13 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:56.615473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:56.635295 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4030/8086] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:43:56.643994 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:56.737381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d3b54-f504-4e65-af74-ec19024e190e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:56.745570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:56.746815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:56.746815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:56.747133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] PATH_INFO: `/v3/users/80a0a6eef526410892a5587d82d0f237` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:56.749184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a0a6eef526410892a5587d82d0f237)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:56.752036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:56.819916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a0a6eef526410892a5587d82d0f237'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:56.837688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a0a6eef526410892a5587d82d0f237'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:56.838383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a0a6eef526410892a5587d82d0f237'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:56.841316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:56.854482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a0a6eef526410892a5587d82d0f237'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:56.859139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a0a6eef526410892a5587d82d0f237'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:56.924722 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4057/8087] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:56 2022] DELETE /identity/v3/users/80a0a6eef526410892a5587d82d0f237 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:56.933046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:56.933046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:56.933046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:56.978381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:56.979496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:57.105150 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4031/8088] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:57.115563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:57.118815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:57.218257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1c372-c15d-45c9-9dba-63c6651c423e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:57.230872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:57.231515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:57.231976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:57.232261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:57.254220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:57.257813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d118f-f7ec-40ad-b56c-c06c27e15d41 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:57.271999 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4058/8089] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:57.712069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:57.713634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:57.747201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cebce-7839-4c06-970f-291ab4ee3a4c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:57.755381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:57.756238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:57.756551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:57.756952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] PATH_INFO: `/v3/projects/3bab5e8dd95e4b9cb0a335c95014f3ae` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:57.758412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bab5e8dd95e4b9cb0a335c95014f3ae)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:57.760636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:57.867202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bab5e8dd95e4b9cb0a335c95014f3ae', 'request_id': 'req-8d1f6941-249a-44c9-92a3-9d9ac5f51088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:57.889402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bab5e8dd95e4b9cb0a335c95014f3ae', 'request_id': 'req-8d1f6941-249a-44c9-92a3-9d9ac5f51088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:57.898885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bab5e8dd95e4b9cb0a335c95014f3ae', 'request_id': 'req-8d1f6941-249a-44c9-92a3-9d9ac5f51088'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:57.909214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] The token cache is being invalidate because project 3bab5e8dd95e4b9cb0a335c95014f3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:57.909499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:57.910156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8d1f6941-249a-44c9-92a3-9d9ac5f51088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:57.912600 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4032/8090] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:57 2022] DELETE /identity/v3/projects/3bab5e8dd95e4b9cb0a335c95014f3ae => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:57.917991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:57.918658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:57.918658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:57.966715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:57.968157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:58.053107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4059/8091] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:58.056154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.056301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.056550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.080410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:58.081680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:58.091970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4033/8092] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:58.095684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.106517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7ccd5-67bb-40b5-be4f-68229c4a73b4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.112672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.113377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.113651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.114052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.114568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:43:58.114865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.116889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.129851 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4060/8093] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:43:58.135617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.145634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c540a8-7318-4334-b082-fa0b7bda753b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.151841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.152456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.152726 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.153017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.153701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.155672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.189409 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4034/8094] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:43:58 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:58.193598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.206383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda0e52-554f-438d-a892-1e43b23f2a64 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.296752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.297669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.298128 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.298690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.299477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.301728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.315000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:58.336430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4061/8095] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:43:58 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:43:58.338570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.352138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847515-813f-4745-9c5e-22aeb13c4729 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.359191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.359807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.364560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.365313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.365637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.369238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.380113 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4035/8096] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:58.385713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.396903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a9dbc-22e5-4810-9087-06f830de1449 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.403361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.404133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.404491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.404813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.405644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.407560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218531-39b0-456f-97b6-8848dec56c4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.423431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4062/8097] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:43:58.427582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.438922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b1419-e5b9-42e3-9e4a-ebf3b326abcb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.444044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.445517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.445831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.446232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] PATH_INFO: `/v3/projects/2e7009512eb6497d8fef1e7ded27987d/users/e2ed963c09c848b1828553a79a664c5f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.464083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7009512eb6497d8fef1e7ded27987d, user_id=e2ed963c09c848b1828553a79a664c5f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.467040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.495098 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4036/8098] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:43:58 2022] PUT /identity/v3/projects/2e7009512eb6497d8fef1e7ded27987d/users/e2ed963c09c848b1828553a79a664c5f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:58.497204 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.497527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.497798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.564424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] MFA Rules not processed for user `e2ed963c09c848b1828553a79a664c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:58.565739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:58.664105 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4063/8099] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:43:58.672450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.675047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:58.709778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:58.763749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145edfc4-2541-4913-9246-2a1c86696d1c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.767975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.768531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.768814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.769114 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.786750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.788029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4cd4e-c35c-4b4d-a6ff-ac8e2118dce5 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:58.805252 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4037/8100] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:58.839935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:58.917873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9737a-0677-41ca-bfe7-f463b6a7a9ec None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:58.922871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:58.923561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:58.923863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:58.924253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] PATH_INFO: `/v3/users/e2ed963c09c848b1828553a79a664c5f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:58.925758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ed963c09c848b1828553a79a664c5f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:58.927799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:59.010700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ed963c09c848b1828553a79a664c5f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.020378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ed963c09c848b1828553a79a664c5f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.021318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ed963c09c848b1828553a79a664c5f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.031308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ed963c09c848b1828553a79a664c5f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.032086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ed963c09c848b1828553a79a664c5f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.041224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:43:59.056257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4064/8101] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:43:58 2022] DELETE /identity/v3/users/e2ed963c09c848b1828553a79a664c5f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:59.060735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:59.061052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:59.061333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:59.083796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:59.083796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:59.150078 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4038/8102] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:43:59.160087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:59.161705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:59.234435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f9ed-1184-4501-b140-f2daddf41d46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:59.238818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:59.239452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:59.239727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:59.240008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:59.255431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:59.257535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750e11-22d1-4add-83b8-0cfcba975845 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:59.271977 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4065/8103] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:43:59.767514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:43:59.769182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:43:59.788716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d1d5-fa20-4cad-96eb-9a595ad7562d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:43:59.795258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:43:59.795904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:59.796183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:59.796455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] PATH_INFO: `/v3/projects/2e7009512eb6497d8fef1e7ded27987d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:59.798175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7009512eb6497d8fef1e7ded27987d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:43:59.800848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:43:59.877795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7009512eb6497d8fef1e7ded27987d', 'request_id': 'req-1a046111-742a-453c-ba84-90aeb569d005'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.889594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7009512eb6497d8fef1e7ded27987d', 'request_id': 'req-1a046111-742a-453c-ba84-90aeb569d005'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.902017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7009512eb6497d8fef1e7ded27987d', 'request_id': 'req-1a046111-742a-453c-ba84-90aeb569d005'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.916534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] The token cache is being invalidate because project 2e7009512eb6497d8fef1e7ded27987d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:43:59.916962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.917752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1a046111-742a-453c-ba84-90aeb569d005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:43:59.919604 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4039/8104] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:43:59 2022] DELETE /identity/v3/projects/2e7009512eb6497d8fef1e7ded27987d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:43:59.926242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:43:59.926789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:43:59.926789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:43:59.967170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:43:59.969314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:00.057914 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4066/8105] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:44:00.067107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.067405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.067668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.098982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:44:00.100217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:00.116986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.117661 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4040/8106] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:44:00.128451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c245-941d-45c2-a817-fd943c0e0ab8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.134327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.136117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.136660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.137202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.138125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:44:00.138705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.140606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.161793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.169040 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4067/8107] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:44:00.174556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c6034-6d9a-4790-8585-dc0ba683a478 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.181715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.182723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.182879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.183256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.184037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.186406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.235275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4041/8108] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:44:00 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:44:00.239018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.251455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83014ee-b869-4c39-a685-dfaa70a889a0 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.340335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.341316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.341823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.342347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.344275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.347968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.380555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4068/8109] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:44:00 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:44:00.385337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.400282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4ef2f-98f3-4b56-9bbf-bdd0c4dd24a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.414688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.415388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.415619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.415870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.418828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.420483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.446605 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4042/8110] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:44:00.449574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.463978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec80c6-4fd0-4380-97a0-fa941def472b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.480799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.481941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.482335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.482712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.485520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.487821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90ec11-0d28-44ef-8668-51ed4eef7ad9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.507080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:00.520659 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4069/8111] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:44:00.524827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.539077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19287-c000-4bd5-801a-9276538214b9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.551341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.551979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.552258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.552721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] PATH_INFO: `/v3/projects/459cb0c3ccf142c38c087cacd96af50c/users/cbe0d4e70cb34006bd9f781aaf90d9c6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.555568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:00.580340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459cb0c3ccf142c38c087cacd96af50c, user_id=cbe0d4e70cb34006bd9f781aaf90d9c6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:00.583092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:00.604406 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4043/8112] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:44:00 2022] PUT /identity/v3/projects/459cb0c3ccf142c38c087cacd96af50c/users/cbe0d4e70cb34006bd9f781aaf90d9c6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:00.608777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad078-9d21-47b8-a36c-342a16a3c14b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.609319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad078-9d21-47b8-a36c-342a16a3c14b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.609693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad078-9d21-47b8-a36c-342a16a3c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:00.647960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-46fad078-9d21-47b8-a36c-342a16a3c14b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:44:00.650689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-46fad078-9d21-47b8-a36c-342a16a3c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:00.787680 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4070/8113] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:44:00.806450 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:00.808295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:00.963645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a4ad-911e-4cd9-bb74-f3d8a07becd4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:00.973316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:00.973684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:00.974486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:00.975420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:01.009743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:01.011435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:01.032903 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4044/8114] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:44:09.222851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.223388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.223388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.270490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] MFA Rules not processed for user `cbe0d4e70cb34006bd9f781aaf90d9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:44:09.271983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:09.403082 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4071/8115] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:44:09.407146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:09.428531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040367-31ee-4a1b-9787-fa172513aad5 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:09.445996 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:09.446659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.447243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.447493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.448093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:09.452079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:09.519373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4045/8116] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:44:09 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:44:09.524263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:09.540927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732450ff-e3c0-41a2-b64d-41e212dce031 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:09.671716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:09.672674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.673162 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.673628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.675194 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:09.677946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:09.717363 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4072/8117] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:44:09 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:44:09.721072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:09.732698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ac3c9-dac8-4253-bf9a-3e87721327fd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:09.746520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:09.747475 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.747751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.748016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.748659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:09.750573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:09.770709 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4046/8118] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:44:09.775673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:09.790892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4f162-8092-4bb4-9c1d-5fcd5d4c69e2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:09.797915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:09.798697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.799059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.799397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] PATH_INFO: `/v3/projects/40b3c3166ef74154839e2949c3a1b3f4/users/de51201ea7fd4527853c70aa98889f88/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.829299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b3c3166ef74154839e2949c3a1b3f4, user_id=de51201ea7fd4527853c70aa98889f88, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:09.831999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:09.836776 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:09.865086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4073/8119] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:44:09 2022] PUT /identity/v3/projects/40b3c3166ef74154839e2949c3a1b3f4/users/de51201ea7fd4527853c70aa98889f88/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:09.865802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:09.888809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a3df-4b63-4396-ba90-a52e77189266 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:09.987802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:09.989422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:09.989863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:09.990391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:09.991920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:09.995154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:10.010926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4047/8120] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:44:10.015468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:10.029888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4602db-cd5c-4924-8699-6851287089b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:10.039487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:10.039487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:10.039900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:10.040025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] PATH_INFO: `/v3/projects/40b3c3166ef74154839e2949c3a1b3f4/users/de51201ea7fd4527853c70aa98889f88/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:10.042129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b3c3166ef74154839e2949c3a1b3f4, user_id=de51201ea7fd4527853c70aa98889f88, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:10.044799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7eefe-67c2-4902-914f-d3aa788b9864 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:10.058916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4074/8121] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:44:10 2022] PUT /identity/v3/projects/40b3c3166ef74154839e2949c3a1b3f4/users/de51201ea7fd4527853c70aa98889f88/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:17.111193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:17.112754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:17.235697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:17.347817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d468ba-b114-4750-b7a8-32ce3304136b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:17.447004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:17.447595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:17.447595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:17.465030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:17.466153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:17.466637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:17.467233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:17.469854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:17.491747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:17.493434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:17.507835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] MFA Rules not processed for user `de51201ea7fd4527853c70aa98889f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:44:17.513163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:17.524852 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4048/8122] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:44:17.627823 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4075/8123] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:44:17.645551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:17.647508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:17.859568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa509-c899-4853-807c-8173df3fa5be service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:17.873699 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:17.878596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:17.879526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:17.881111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:17.918761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:17.924053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:17.970270 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4049/8124] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:44:18.845266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:18.884275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126a82d-3c9b-456a-a530-475c377f0eaf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:18.907073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:18.908051 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:18.908426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:18.908794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:18.917307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:18.956158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:18.957881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:18.978345 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4076/8125] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:44:27.941667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:28.965860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:30.307717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:30.452222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c88ceb-5cd3-4d94-a338-45fe41b0d55f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:30.458223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:30.459768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:30.460137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:30.460474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] PATH_INFO: `/v3/users/cbe0d4e70cb34006bd9f781aaf90d9c6` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:30.461961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe0d4e70cb34006bd9f781aaf90d9c6)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:30.464477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:30.549035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe0d4e70cb34006bd9f781aaf90d9c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:30.551336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe0d4e70cb34006bd9f781aaf90d9c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:30.575276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe0d4e70cb34006bd9f781aaf90d9c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:30.576140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe0d4e70cb34006bd9f781aaf90d9c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:30.599143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe0d4e70cb34006bd9f781aaf90d9c6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:30.691117 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4050/8126] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:44:30 2022] DELETE /identity/v3/users/cbe0d4e70cb34006bd9f781aaf90d9c6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:31.432979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:31.458448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b46ad-9850-458e-bc9e-d37e621d7b7a service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:31.623825 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:31.625703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:31.626257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:31.626740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] PATH_INFO: `/v3/projects/459cb0c3ccf142c38c087cacd96af50c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:31.629068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459cb0c3ccf142c38c087cacd96af50c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:31.631406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:31.736443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459cb0c3ccf142c38c087cacd96af50c', 'request_id': 'req-567ec592-efa9-4417-bf55-af85a1aa9940'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:31.748772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459cb0c3ccf142c38c087cacd96af50c', 'request_id': 'req-567ec592-efa9-4417-bf55-af85a1aa9940'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:31.775879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459cb0c3ccf142c38c087cacd96af50c', 'request_id': 'req-567ec592-efa9-4417-bf55-af85a1aa9940'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:31.822382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] The token cache is being invalidate because project 459cb0c3ccf142c38c087cacd96af50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:44:31.822766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:31.823675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:31.825909 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4077/8127] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:44:31 2022] DELETE /identity/v3/projects/459cb0c3ccf142c38c087cacd96af50c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:31.829756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:31.832698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:31.849495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578fa84-ec07-4b4d-8a48-5578e38c12da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:32.016027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:32.016027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:32.016027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:32.016027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] PATH_INFO: `/v3/users/de51201ea7fd4527853c70aa98889f88` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:32.016866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de51201ea7fd4527853c70aa98889f88)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:32.028618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:32.096659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:32.149448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de51201ea7fd4527853c70aa98889f88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:32.150331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de51201ea7fd4527853c70aa98889f88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:32.164626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de51201ea7fd4527853c70aa98889f88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:32.165536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de51201ea7fd4527853c70aa98889f88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:32.200226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de51201ea7fd4527853c70aa98889f88'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:32.245746 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4051/8128] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:44:31 2022] DELETE /identity/v3/users/de51201ea7fd4527853c70aa98889f88 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:44:32.814326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:32.817737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:32.849819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec592-efa9-4417-bf55-af85a1aa9940 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:32.991780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:32.997220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:32.999216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:32.999714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] PATH_INFO: `/v3/projects/40b3c3166ef74154839e2949c3a1b3f4` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:33.002430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b3c3166ef74154839e2949c3a1b3f4)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:33.010049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:33.097909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:33.123950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b3c3166ef74154839e2949c3a1b3f4', 'request_id': 'req-6ce58ca2-9bbd-497e-b010-6e668dd5d585'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:33.133946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b3c3166ef74154839e2949c3a1b3f4', 'request_id': 'req-6ce58ca2-9bbd-497e-b010-6e668dd5d585'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:33.140750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b3c3166ef74154839e2949c3a1b3f4', 'request_id': 'req-6ce58ca2-9bbd-497e-b010-6e668dd5d585'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:33.160735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] The token cache is being invalidate because project 40b3c3166ef74154839e2949c3a1b3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:44:33.161156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:33.161831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6ce58ca2-9bbd-497e-b010-6e668dd5d585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:44:33.164179 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4078/8129] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:44:32 2022] DELETE /identity/v3/projects/40b3c3166ef74154839e2949c3a1b3f4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:44:42.237643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:43.155166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:44:44.145636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:44:44.148419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:44.318551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56948124-81f3-4295-9b84-5be1f8656914 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:44:44.432053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:44:44.432687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:44.432964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:44.433286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:44.437786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:44.576108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:44:44.580567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:44:44.606855 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4052/8130] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:44:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:44:51.651688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd90bf-0399-4098-be4d-dde1579c4804 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:44:51.652370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd90bf-0399-4098-be4d-dde1579c4804 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:44:51.652370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd90bf-0399-4098-be4d-dde1579c4804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:44:51.705120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6bd90bf-0399-4098-be4d-dde1579c4804 None None] MFA Rules not processed for user `c0d13a891f6445a2b12c8b30182df7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:44:51.706566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6bd90bf-0399-4098-be4d-dde1579c4804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:44:51.839189 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4079/8131] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:44:54.601709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=68 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:01.820532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:15.510860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:15.513026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:15.731773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fdeb3-5ca8-4ff9-bdd8-e8c8dd706713 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:15.747335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:15.748265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:15.748757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:15.749226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:15.752732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:15.780552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:15.782124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:15.817050 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4053/8132] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:16.292756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:16.293816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:16.294236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:16.322638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] MFA Rules not processed for user `928b7b2e278d406eac6ecf01af7b91bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:16.324633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:16.409748 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4080/8133] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:23.652675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:23.654743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:23.769210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c28d3-98e4-45d2-8bd7-de5ad284420c service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:23.775357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:23.776012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:23.776292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:23.776565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:23.778549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:23.796526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:23.798650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f77a94-e23a-4977-9521-ea452a0f7895 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:23.829492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4054/8134] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:26.396845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:30.578284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:30.580613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:30.667313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16ac0-97fe-40e0-bb3e-67203671e892 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:30.672276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:30.673030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:30.673386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:30.673728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] PATH_INFO: `/v3/users/1aa5a06305f4430aad38441cc86936d9` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:30.675138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa5a06305f4430aad38441cc86936d9)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:30.677243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:30.736583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa5a06305f4430aad38441cc86936d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:30.744744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa5a06305f4430aad38441cc86936d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:30.745706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa5a06305f4430aad38441cc86936d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:30.753544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa5a06305f4430aad38441cc86936d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:30.754129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa5a06305f4430aad38441cc86936d9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:30.773151 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4081/8135] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:30 2022] DELETE /identity/v3/users/1aa5a06305f4430aad38441cc86936d9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:30.777566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:30.778051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:30.778151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:30.798157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:30.799416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:30.815146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:30.816764 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:30.872102 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4055/8136] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:30.882931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:30.896207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85092167-15df-4d78-a4fb-e62de5986932 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:30.896835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059976-128b-4967-aa1a-06e7c6caa333 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:30.900280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:30.900912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:30.901223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:30.901492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:30.902801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:30.903621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:30.903849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:30.904317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:30.904772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:30.918045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:30.919644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:30.920819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:30.921234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a50-57f5-4511-96b1-b3bbccc261c2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:30.935777 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4056/8137] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:30.947927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4082/8138] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:45:31.375842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:31.377354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:31.388068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:31.398247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213227c-c1c6-4603-8fe4-a33677c9a5d0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:31.406737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:31.407570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.407910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.408261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] PATH_INFO: `/v3/projects/9d8d3fb3adee4500985e19bcb1f4247b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.410490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8d3fb3adee4500985e19bcb1f4247b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:31.423882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:31.540504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8d3fb3adee4500985e19bcb1f4247b', 'request_id': 'req-2431c8da-c47c-4b93-bd92-338932ad9591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.552367 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8d3fb3adee4500985e19bcb1f4247b', 'request_id': 'req-2431c8da-c47c-4b93-bd92-338932ad9591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.565188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8d3fb3adee4500985e19bcb1f4247b', 'request_id': 'req-2431c8da-c47c-4b93-bd92-338932ad9591'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.583672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] The token cache is being invalidate because project 9d8d3fb3adee4500985e19bcb1f4247b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:31.584060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.586791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2431c8da-c47c-4b93-bd92-338932ad9591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.594122 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4057/8139] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:31 2022] DELETE /identity/v3/projects/9d8d3fb3adee4500985e19bcb1f4247b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:31.594500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.594950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.594950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.623469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:31.624803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:31.645961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:31.722365 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4083/8140] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:31.731219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.731775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.732130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.762320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:31.764110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:31.777893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4058/8141] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:31.778749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:31.794974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e897a8-1e61-4815-83a8-4362afdc128a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:31.803768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:31.804501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.804779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.805097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.805768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:45:31.806074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:31.807759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:31.820446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:31.822485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:31.825056 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4084/8142] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:45:31.829349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:31.839811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761687e-3ffb-4b17-b719-41c31a0d7a4f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:31.846541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:31.846845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d73573-d260-47a4-8514-a5ca956255e7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:31.847195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.847478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.847753 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] PATH_INFO: `/v3/users/93b7f4b9ee5e4b85a95f3989557222ee` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.848968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b7f4b9ee5e4b85a95f3989557222ee)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:31.851611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:31.858191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:31.859405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:31.859405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:31.859833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:31.860641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:31.863363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:31.899626 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4085/8143] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:31 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:31.903672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:31.908065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b7f4b9ee5e4b85a95f3989557222ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.908822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b7f4b9ee5e4b85a95f3989557222ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.917035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b7f4b9ee5e4b85a95f3989557222ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.917808 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b7f4b9ee5e4b85a95f3989557222ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.927265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b7f4b9ee5e4b85a95f3989557222ee'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:31.957326 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4059/8144] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:31 2022] DELETE /identity/v3/users/93b7f4b9ee5e4b85a95f3989557222ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:31.984713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d815-b84c-4485-a444-b90323a6b2fb admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.058683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.059477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.059752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.060026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.060660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.062639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.086415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4086/8145] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:31 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:32.090717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.092731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:32.106442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69462a94-9ec0-4eff-b6b0-b080049d5cef admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.111188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.112061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.112685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.112685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.113283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.114885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.126357 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4060/8146] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:32.130449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.141440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e4906-e122-4cbc-b4c9-b4d71d1b6d2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.146493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.147205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.147538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.147902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.148470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.150159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.155421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.157184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:32.170107 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4087/8147] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:32.171405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65cb7-21e0-4b8e-8409-24cc7fec0086 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.174093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.176404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.177603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.177886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.178252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] PATH_INFO: `/v3/projects/ebe6b545c1f44199a313289eb21fe0b2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.180192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe6b545c1f44199a313289eb21fe0b2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.182133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.186241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ab508-6644-4aff-a1bd-69b926c37996 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.191521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.192164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.192467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.192769 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] PATH_INFO: `/v3/projects/fd2148179ba3409babf57e5598263676/users/5493425895d141c399d0d8fcc5710e9c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.205063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:32.212553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2148179ba3409babf57e5598263676, user_id=5493425895d141c399d0d8fcc5710e9c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.215538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713064df-f54e-416c-a704-70c8bc2810b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.224441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:32.231195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4088/8148] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:32 2022] PUT /identity/v3/projects/fd2148179ba3409babf57e5598263676/users/5493425895d141c399d0d8fcc5710e9c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:32.238276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe6b545c1f44199a313289eb21fe0b2', 'request_id': 'req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:32.246735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe6b545c1f44199a313289eb21fe0b2', 'request_id': 'req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:32.254922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe6b545c1f44199a313289eb21fe0b2', 'request_id': 'req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:32.268333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] The token cache is being invalidate because project ebe6b545c1f44199a313289eb21fe0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:32.268626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:32.269342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:32.271075 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4061/8149] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:32 2022] DELETE /identity/v3/projects/ebe6b545c1f44199a313289eb21fe0b2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:32.333884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.334086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.334296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.367638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] MFA Rules not processed for user `5493425895d141c399d0d8fcc5710e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:32.369013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:32.443589 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4089/8150] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:32.449510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.451280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:32.530987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed8eda-3321-4bc0-8d74-d96c46ca06a2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.601371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.602284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.602659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.603028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.603800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.606008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.650275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4062/8151] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:32 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:32.652173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.663958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95297e5b-c99d-4c36-9714-6a5120246284 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.739417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.740365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.741851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.742357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.743192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.745652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.769369 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4090/8152] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:32 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:32.773737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.784298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074af5d-63a3-404f-98f3-edd132b3cc51 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.790093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.790708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.791054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.791322 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.792073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.793938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.806364 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4063/8153] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:32.810344 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.824449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357b5ce-fa50-4783-962a-8283b24c1b04 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.829257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.830092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.830371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.830632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] PATH_INFO: `/v3/projects/9925461551874ab39a72c0a3eaee47db/users/1252e8244f70434681633275cdbb2aa0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.847499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9925461551874ab39a72c0a3eaee47db, user_id=1252e8244f70434681633275cdbb2aa0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.851434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.869319 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4091/8154] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:32 2022] PUT /identity/v3/projects/9925461551874ab39a72c0a3eaee47db/users/1252e8244f70434681633275cdbb2aa0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:32.873341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.885815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d05c4-c28b-4fb9-ab18-dc0d30c8f615 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.938903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:32.955799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.956406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.956679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.956972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.957645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.959314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a555421-1766-44c5-b226-f38fde4e25c6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:32.970167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4064/8155] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:32.974354 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:32.985677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da186d19-06ce-488e-beb2-d7b8fe9b217a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:32.990604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:32.992033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:32.992340 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:32.992634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] PATH_INFO: `/v3/projects/9925461551874ab39a72c0a3eaee47db/users/1252e8244f70434681633275cdbb2aa0/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:32.994671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9925461551874ab39a72c0a3eaee47db, user_id=1252e8244f70434681633275cdbb2aa0, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:32.997337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:33.009508 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4092/8156] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:32 2022] PUT /identity/v3/projects/9925461551874ab39a72c0a3eaee47db/users/1252e8244f70434681633275cdbb2aa0/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:33.019675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:33.019964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:33.020243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:33.048174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] MFA Rules not processed for user `1252e8244f70434681633275cdbb2aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:33.049403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:33.118320 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4065/8157] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:33.129642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:33.132050 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:33.167088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:33.195908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e82b76-b1c3-454a-928a-6a88671c817d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:33.199593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:33.200201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:33.200491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:33.200741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:33.209828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:33.211238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84b43-fb79-4b11-b8e9-a2efa932958c service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:33.220515 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4093/8158] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:33.644729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:33.707821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0edfa-1cac-47fd-82a0-db67e37ecf09 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:33.712622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:33.713390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:33.713672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:33.713942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] PATH_INFO: `/v3/users/5493425895d141c399d0d8fcc5710e9c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:33.715065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5493425895d141c399d0d8fcc5710e9c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:33.716977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:33.764186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5493425895d141c399d0d8fcc5710e9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:33.764819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5493425895d141c399d0d8fcc5710e9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:33.771660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5493425895d141c399d0d8fcc5710e9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:33.772607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5493425895d141c399d0d8fcc5710e9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:33.779992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5493425895d141c399d0d8fcc5710e9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:33.784469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:33.799490 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4066/8159] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:33 2022] DELETE /identity/v3/users/5493425895d141c399d0d8fcc5710e9c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:33.805290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:33.805749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:33.805870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:33.824875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:33.826114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:33.887114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4094/8160] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:33.896777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:33.898754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:33.960765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192125b9-2573-456e-ac91-d45a77f2a3fc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:33.964459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:33.965116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:33.965403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:33.965676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:33.974648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:33.977419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:33.987249 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4067/8161] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:34.257372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:34.258830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:34.270899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912e881-35b3-44c4-bf5b-f2e707ae21a6 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:34.276295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:34.276937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:34.277252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:34.277665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] PATH_INFO: `/v3/projects/fd2148179ba3409babf57e5598263676` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:34.278802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2148179ba3409babf57e5598263676)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:34.280795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:34.329580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2148179ba3409babf57e5598263676', 'request_id': 'req-ed38236d-0215-405d-92af-777ae67cf639'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.336426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2148179ba3409babf57e5598263676', 'request_id': 'req-ed38236d-0215-405d-92af-777ae67cf639'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.342265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2148179ba3409babf57e5598263676', 'request_id': 'req-ed38236d-0215-405d-92af-777ae67cf639'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.354826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] The token cache is being invalidate because project fd2148179ba3409babf57e5598263676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:34.355113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.355738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.357264 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4095/8162] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:34 2022] DELETE /identity/v3/projects/fd2148179ba3409babf57e5598263676 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:34.361697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:34.371884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fdcfe-0053-4bea-9385-5698ddf40499 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:34.432924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:34.433569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:34.433871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:34.434133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] PATH_INFO: `/v3/users/1252e8244f70434681633275cdbb2aa0` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:34.435268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1252e8244f70434681633275cdbb2aa0)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:34.437216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:34.487514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1252e8244f70434681633275cdbb2aa0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.488168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1252e8244f70434681633275cdbb2aa0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.495870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1252e8244f70434681633275cdbb2aa0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.496814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1252e8244f70434681633275cdbb2aa0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.505500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dcb833ae-ee85-4922-b9ae-26a1b2c5f8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1252e8244f70434681633275cdbb2aa0'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.529208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4068/8163] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:34 2022] DELETE /identity/v3/users/1252e8244f70434681633275cdbb2aa0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:34.827094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:34.828562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:34.849932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38236d-0215-405d-92af-777ae67cf639 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:34.905798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:34.912521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:34.913920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:34.914434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:34.914874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] PATH_INFO: `/v3/projects/9925461551874ab39a72c0a3eaee47db` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:34.916721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9925461551874ab39a72c0a3eaee47db)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:34.918780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:34.974486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9925461551874ab39a72c0a3eaee47db', 'request_id': 'req-6fdba05c-45c5-4b77-8555-61ef33e13ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.983244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9925461551874ab39a72c0a3eaee47db', 'request_id': 'req-6fdba05c-45c5-4b77-8555-61ef33e13ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:34.989512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9925461551874ab39a72c0a3eaee47db', 'request_id': 'req-6fdba05c-45c5-4b77-8555-61ef33e13ed6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:35.003826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] The token cache is being invalidate because project 9925461551874ab39a72c0a3eaee47db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:35.004119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:35.004786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6fdba05c-45c5-4b77-8555-61ef33e13ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:35.006318 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4096/8164] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:34 2022] DELETE /identity/v3/projects/9925461551874ab39a72c0a3eaee47db => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:35.011315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.011802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.012029 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.026194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:35.032724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:35.034852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:35.096640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4069/8165] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:45:35.105339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.105658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.105933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.127530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:35.128979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:35.137190 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4097/8166] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:35.141429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.152539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5de21-8a39-4133-856b-237d89171574 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.157582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.158194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.158471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.158740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.159391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:45:35.159685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.161419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.178167 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4070/8167] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:45:35.179940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.189743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e991d8-fd3c-4d9b-a2b5-51421c0d14bb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.194839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.195457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.195736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.196010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.196656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.198612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.230293 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4098/8168] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:35.231392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.242516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a5b7-2abf-4fd2-b4b5-c3a3388aa527 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.301849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.302775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.303051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.303400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.304539 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.306494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.333024 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4071/8169] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:35.334223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.345234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e24b4-53e8-43f2-962e-a5419b4acd2c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.349991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.350639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.351092 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.351283 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.351934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.353581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.364269 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4099/8170] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:35.368835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.381187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc24b-833a-44c6-bc13-b5f5d53010de admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.393716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.394420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.394696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.394962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.395600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.397389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582df30-8e67-442c-8504-2bb19010159d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.409351 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4072/8171] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:35.413747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.423973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aedfe-d186-4922-a76b-c3417f33aa3f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.430016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.430722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.430995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.431282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] PATH_INFO: `/v3/projects/dd457f77c5e8494bbd77461811a81c66/users/9567c4fe49ee49d99e974faf302e22a1/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.449593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd457f77c5e8494bbd77461811a81c66, user_id=9567c4fe49ee49d99e974faf302e22a1, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.452419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.467133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4100/8172] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:35 2022] PUT /identity/v3/projects/dd457f77c5e8494bbd77461811a81c66/users/9567c4fe49ee49d99e974faf302e22a1/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:35.479048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.479333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.479604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.511556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] MFA Rules not processed for user `9567c4fe49ee49d99e974faf302e22a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:35.512804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:35.597067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4073/8173] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:35.598154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.668571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200236-6994-4953-92f1-c4c51516c85e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.673803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.674804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.675275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.675643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.676282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.678375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.709158 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4101/8174] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:35.711625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.717243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:35.724354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb940481-28ae-41e3-8c5f-6982849730d3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.784301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.785041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.785318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.785581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.786244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.788330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.810095 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4074/8175] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:35 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:35.813706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.824757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0821-fde6-4f5b-bf3d-cf7c9eea3a3a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.829515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.830124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.830399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.830668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.831306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.832923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.835847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:35.849676 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4102/8176] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:35.850908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.861978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0991a-6431-4729-9570-00b0ade234ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.867008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.867661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.868074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.868346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] PATH_INFO: `/v3/projects/fe85c36981be43e3bac1a3dd82f603f5/users/7f1154e83d0240fa9a44448dfd474d49/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.886282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe85c36981be43e3bac1a3dd82f603f5, user_id=7f1154e83d0240fa9a44448dfd474d49, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.889132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.903286 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4075/8177] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:35 2022] PUT /identity/v3/projects/fe85c36981be43e3bac1a3dd82f603f5/users/7f1154e83d0240fa9a44448dfd474d49/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:35.907317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:35.917979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871cc8c-b94e-468b-9473-de2044976967 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:35.980381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:35.981163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:35.981437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:35.981811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:35.982615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:35.984251 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e674-ab56-4bde-af2d-111c52b4a7a4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:35.995551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4103/8178] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:35.999560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:36.010582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd97cd-6437-43a0-b781-11ca0aab1f22 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:36.015194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:36.015843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:36.016128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:36.016429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] PATH_INFO: `/v3/projects/fe85c36981be43e3bac1a3dd82f603f5/users/7f1154e83d0240fa9a44448dfd474d49/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:36.018383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe85c36981be43e3bac1a3dd82f603f5, user_id=7f1154e83d0240fa9a44448dfd474d49, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:36.021090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:36.032744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4076/8179] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:35 2022] PUT /identity/v3/projects/fe85c36981be43e3bac1a3dd82f603f5/users/7f1154e83d0240fa9a44448dfd474d49/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:36.043549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:36.043938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:36.044275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:36.080875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] MFA Rules not processed for user `7f1154e83d0240fa9a44448dfd474d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:36.082186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:36.169127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4104/8180] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:36.179829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:36.181761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:36.253908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376bdd-015d-4900-8a4d-26b85178c39b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:36.259217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:36.259854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:36.260112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:36.260424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:36.272815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:36.274338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:36.285634 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4077/8181] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:36.380127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:36.393857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb749-0f46-47f0-b0fb-9122432d2790 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:36.398574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:36.399585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:36.399945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:36.400218 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:36.465775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:36.467313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916a0c5-f967-4f57-b367-41ee3a49cf92 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:36.479593 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4105/8182] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:39.282750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:39.342676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:39.346875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b6bcd-7dc9-4b5a-ba82-346e42c3d599 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:39.352846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:39.353496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:39.353771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:39.354036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] PATH_INFO: `/v3/users/9567c4fe49ee49d99e974faf302e22a1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:39.355139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9567c4fe49ee49d99e974faf302e22a1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:39.357061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:39.406691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9567c4fe49ee49d99e974faf302e22a1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.407377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9567c4fe49ee49d99e974faf302e22a1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.416385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9567c4fe49ee49d99e974faf302e22a1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.417228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9567c4fe49ee49d99e974faf302e22a1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.425896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9567c4fe49ee49d99e974faf302e22a1'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.445394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4078/8183] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:39 2022] DELETE /identity/v3/users/9567c4fe49ee49d99e974faf302e22a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:39.450311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:39.450834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:39.450935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:39.471904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:39.473157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:39.485905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:39.534129 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4106/8184] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:39.544079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:39.545501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:39.605309 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309f508-7c46-44bb-a90e-442076dade00 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:39.608979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:39.609607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:39.609883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:39.610173 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:39.619552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:39.621051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:39.630590 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4079/8185] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:39.910089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:39.911597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:39.923988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393a48c-e14e-4255-94d2-99fd39825822 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:39.932855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:39.932855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:39.932855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:39.932855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] PATH_INFO: `/v3/projects/dd457f77c5e8494bbd77461811a81c66` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:39.933369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd457f77c5e8494bbd77461811a81c66)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:39.933519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:39.982441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd457f77c5e8494bbd77461811a81c66', 'request_id': 'req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.988773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd457f77c5e8494bbd77461811a81c66', 'request_id': 'req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:39.994919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd457f77c5e8494bbd77461811a81c66', 'request_id': 'req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.008020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] The token cache is being invalidate because project dd457f77c5e8494bbd77461811a81c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:40.008303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.008920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.010674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4107/8186] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:39 2022] DELETE /identity/v3/projects/dd457f77c5e8494bbd77461811a81c66 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:40.014822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.024954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57feb7-a6a7-463e-887f-da59c15ad8ca service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.081482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.082106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.082377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.082642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] PATH_INFO: `/v3/users/7f1154e83d0240fa9a44448dfd474d49` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.083740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1154e83d0240fa9a44448dfd474d49)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.085772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.107116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:40.133461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1154e83d0240fa9a44448dfd474d49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.134140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1154e83d0240fa9a44448dfd474d49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.141121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1154e83d0240fa9a44448dfd474d49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.141750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1154e83d0240fa9a44448dfd474d49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.149296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-50296a8f-a5b4-4391-b394-c0ac0195e40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1154e83d0240fa9a44448dfd474d49'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.166554 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4080/8187] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:40 2022] DELETE /identity/v3/users/7f1154e83d0240fa9a44448dfd474d49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:40.443630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.445848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:40.459473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b741a8-fbf6-4768-a31f-5694abc2b0ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.522464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.523127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.523434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.523874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] PATH_INFO: `/v3/projects/fe85c36981be43e3bac1a3dd82f603f5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.525067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe85c36981be43e3bac1a3dd82f603f5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.527019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.575012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:40.579578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe85c36981be43e3bac1a3dd82f603f5', 'request_id': 'req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.587727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe85c36981be43e3bac1a3dd82f603f5', 'request_id': 'req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.594708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe85c36981be43e3bac1a3dd82f603f5', 'request_id': 'req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.609806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] The token cache is being invalidate because project fe85c36981be43e3bac1a3dd82f603f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:40.610093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.610714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7d0d079b-4092-4cbd-ad57-8ecea0d3a335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:40.612471 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4108/8188] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:40 2022] DELETE /identity/v3/projects/fe85c36981be43e3bac1a3dd82f603f5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:40.617513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.618006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.618113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.638364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:40.639606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:40.708096 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4081/8189] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:40.717995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.718277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.718551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.739663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:40.740890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:40.749163 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4109/8190] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:40.753571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.763975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013ec3-e8e6-47b6-bb0c-4c0009f7c8b4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.768562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.769192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.769470 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.769737 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.770376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:45:40.770676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.773069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.785109 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4082/8191] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:45:40.790630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.800072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be390-b5b4-4d84-a7a5-654e67bc2138 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.804763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.805382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.805652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.805915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.806540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.808448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.836235 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4110/8192] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:40 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:40.840380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.850976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf1cb-1fbb-436f-9671-85923f6835f2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.906919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.907515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.907794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.908062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.908674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.910644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.933649 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4083/8193] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:40 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:40.939495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.950136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80379-eb97-4a11-a9d1-a6d486c0d0b6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.954735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.955336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.955616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.955889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.956531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.958195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:40.969074 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4111/8194] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:40.973060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:40.983827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f9d77-d971-4e58-9093-87117c745747 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:40.988616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:40.989241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:40.989520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:40.989789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:40.990418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:40.992142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2447bf-3838-417a-bcb2-3ec0d367ccc9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.002956 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4084/8195] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:41.008396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.018510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a83b5-a6b7-41e2-8210-c8c68e17f1f1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.023868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.024460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.024763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.025070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] PATH_INFO: `/v3/projects/c4fbb02d9e2346c487b2b2274b8642e4/users/4771e83114b948b8b87b3dda92f5430a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.039799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fbb02d9e2346c487b2b2274b8642e4, user_id=4771e83114b948b8b87b3dda92f5430a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.042462 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.055483 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4112/8196] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:41 2022] PUT /identity/v3/projects/c4fbb02d9e2346c487b2b2274b8642e4/users/4771e83114b948b8b87b3dda92f5430a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:41.065606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df029-e2da-4999-b68a-fef93a88743d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.065893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df029-e2da-4999-b68a-fef93a88743d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.066167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785df029-e2da-4999-b68a-fef93a88743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.075837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:41.098732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-785df029-e2da-4999-b68a-fef93a88743d None None] MFA Rules not processed for user `4771e83114b948b8b87b3dda92f5430a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:41.099948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-785df029-e2da-4999-b68a-fef93a88743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:41.166248 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4085/8197] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:41.170740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.234470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910e417-1cdc-40d9-9f91-b9ae249ebb9a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.239358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.239955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.240226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.240492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.241846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.243753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.269993 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4113/8198] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:41 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:41.274177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df029-e2da-4999-b68a-fef93a88743d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.284838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785df029-e2da-4999-b68a-fef93a88743d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.344236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.344838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.345144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.345411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.346043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.347933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.369701 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4086/8199] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:41 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:41.373735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.384602 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a8644-e20b-4dee-b619-546f1fa21a47 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.389279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.389877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.390155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.390424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.391061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.392643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.404104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4114/8200] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:41.408626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.420202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dbe0-818d-41fb-88aa-b04371b501fb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.424860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.425531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.425806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.426075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] PATH_INFO: `/v3/projects/a6c05f3c88be4045b0a204a346b37f2d/users/60d56e7ae6354d208e7106754223dfb5/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.441235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c05f3c88be4045b0a204a346b37f2d, user_id=60d56e7ae6354d208e7106754223dfb5, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.443861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.456515 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4087/8201] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:41 2022] PUT /identity/v3/projects/a6c05f3c88be4045b0a204a346b37f2d/users/60d56e7ae6354d208e7106754223dfb5/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:41.461300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.472003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644fef6-fca7-4efb-9847-0a7bb38d7ca8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.515044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:41.533457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.534000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.534278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.534551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.535189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.536773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac31e1-eafb-4a8d-83f7-0b3228c75339 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.546783 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4115/8202] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:41.550908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.561985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9a628-ed4a-49fa-8ea0-b0812fcb3ad1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.566542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.567184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.567465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.567741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] PATH_INFO: `/v3/projects/a6c05f3c88be4045b0a204a346b37f2d/users/60d56e7ae6354d208e7106754223dfb5/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.570329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c05f3c88be4045b0a204a346b37f2d, user_id=60d56e7ae6354d208e7106754223dfb5, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.572949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.583306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4088/8203] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:41 2022] PUT /identity/v3/projects/a6c05f3c88be4045b0a204a346b37f2d/users/60d56e7ae6354d208e7106754223dfb5/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:41.594323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.594645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.594920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.625495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] MFA Rules not processed for user `60d56e7ae6354d208e7106754223dfb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:41.626711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:41.695277 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4116/8204] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:41.706355 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:41.708073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:41.764296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:41.774202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31258228-bc92-4110-837c-010fa660dd00 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:41.778181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:41.778784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:41.779062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:41.779331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:41.788902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:41.790329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e2400-49e5-4fd0-b154-8f1dd1070947 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:41.799915 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4089/8205] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:43.380748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:43.444326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f3889-0d44-4e5c-b12c-782b23a06918 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:43.448932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:43.449601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:43.449879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:43.450149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] PATH_INFO: `/v3/users/4771e83114b948b8b87b3dda92f5430a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:43.451266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4771e83114b948b8b87b3dda92f5430a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:43.453208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:43.500160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4771e83114b948b8b87b3dda92f5430a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:43.508233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4771e83114b948b8b87b3dda92f5430a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:43.509281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4771e83114b948b8b87b3dda92f5430a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:43.517840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4771e83114b948b8b87b3dda92f5430a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:43.518484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4771e83114b948b8b87b3dda92f5430a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:43.520437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:43.538862 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4117/8206] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:43 2022] DELETE /identity/v3/users/4771e83114b948b8b87b3dda92f5430a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:43.543401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:43.543936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:43.544046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:43.563875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:43.565112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:43.626394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4090/8207] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:43.637177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:43.638574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:43.699084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cb52c-8c45-49dd-9bcb-de142edb5279 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:43.702743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:43.703383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:43.703658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:43.703928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:43.713287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:43.714693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:43.724041 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4118/8208] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:43.997492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:43.998980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:44.013235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f5be6-2c68-4337-abeb-004c8f4ec862 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:44.017905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:44.018630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.018976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.019304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] PATH_INFO: `/v3/projects/c4fbb02d9e2346c487b2b2274b8642e4` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.020436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fbb02d9e2346c487b2b2274b8642e4)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:44.022543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:44.069968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fbb02d9e2346c487b2b2274b8642e4', 'request_id': 'req-7be3887d-2220-4d7f-9fe7-3d9e467e554c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.077147 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fbb02d9e2346c487b2b2274b8642e4', 'request_id': 'req-7be3887d-2220-4d7f-9fe7-3d9e467e554c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.083315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fbb02d9e2346c487b2b2274b8642e4', 'request_id': 'req-7be3887d-2220-4d7f-9fe7-3d9e467e554c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.093473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] The token cache is being invalidate because project c4fbb02d9e2346c487b2b2274b8642e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:44.093756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.094384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.095853 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4091/8209] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:43 2022] DELETE /identity/v3/projects/c4fbb02d9e2346c487b2b2274b8642e4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:44.099982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:44.111353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78d5b-cc8e-4e25-9122-0fb26ca9f662 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:44.170784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:44.171332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.171610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.171883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] PATH_INFO: `/v3/users/60d56e7ae6354d208e7106754223dfb5` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.173060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d56e7ae6354d208e7106754223dfb5)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:44.174978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:44.222615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d56e7ae6354d208e7106754223dfb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.230315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d56e7ae6354d208e7106754223dfb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.230955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d56e7ae6354d208e7106754223dfb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.238170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d56e7ae6354d208e7106754223dfb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.238873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5c731fb3-98fd-4e7e-9e18-5e807b30bd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d56e7ae6354d208e7106754223dfb5'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.258583 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4119/8210] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:44 2022] DELETE /identity/v3/users/60d56e7ae6354d208e7106754223dfb5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:44.556847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:44.558291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:44.572256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3887d-2220-4d7f-9fe7-3d9e467e554c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:44.629896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:44.630525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.630804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.631076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] PATH_INFO: `/v3/projects/a6c05f3c88be4045b0a204a346b37f2d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.633008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c05f3c88be4045b0a204a346b37f2d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:44.634923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:44.651131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:44.685783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c05f3c88be4045b0a204a346b37f2d', 'request_id': 'req-0238a170-620a-4f51-964a-31c57398399d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.693543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c05f3c88be4045b0a204a346b37f2d', 'request_id': 'req-0238a170-620a-4f51-964a-31c57398399d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.701451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c05f3c88be4045b0a204a346b37f2d', 'request_id': 'req-0238a170-620a-4f51-964a-31c57398399d'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.720228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] The token cache is being invalidate because project a6c05f3c88be4045b0a204a346b37f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:44.720724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.721686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-0238a170-620a-4f51-964a-31c57398399d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:44.727166 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4092/8211] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:44 2022] DELETE /identity/v3/projects/a6c05f3c88be4045b0a204a346b37f2d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:44.729896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.730465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.730798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.742118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:44.754907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:44.756909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:44.827579 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4120/8212] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:44.835860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.836146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.836418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.857115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:44.858318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:44.867446 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4093/8213] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:44.871671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:44.881380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57313e2-361e-47d1-a50b-a3be87342ade None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:44.886028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:44.886622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.886897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.887169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.887842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:45:44.888141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:44.889759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:44.901485 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4121/8214] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:45:44.905667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:44.915481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39de98-2a7a-4750-af3c-04d4327ac18d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:44.920054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:44.920646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:44.921045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:44.921259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:44.921813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:44.923680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:44.957784 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4094/8215] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:44 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:44.962609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:44.972597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a592d-6db5-4d98-8dba-fc16175db18d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.033006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.033640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.033919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.034190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.034831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.036771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.058962 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4122/8216] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:44 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:45.063389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.074242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9f1b-70c3-4187-9e33-4e126e743181 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.078806 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.079393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.079666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.079930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.080554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.082171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.092630 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4095/8217] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:45.096477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.108708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568904ba-fb41-4a43-bb87-ccc60a3b6c2c admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.113802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.114509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.114789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.115067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.115735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.117525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb926-1042-4eb6-a9d5-ce1d94f2f01f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.127923 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4123/8218] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:45.132292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.142961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b709-68d0-4d3f-83fb-9db4b85c6262 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.148239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.148901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.149224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.149501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] PATH_INFO: `/v3/projects/4686ed7e3fd14283959a898fa92ccbf5/users/ca050061054e452f8945e19b454294bb/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.164537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4686ed7e3fd14283959a898fa92ccbf5, user_id=ca050061054e452f8945e19b454294bb, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.167210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.180271 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4096/8219] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:45 2022] PUT /identity/v3/projects/4686ed7e3fd14283959a898fa92ccbf5/users/ca050061054e452f8945e19b454294bb/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:45.190683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.190905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.191179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.219674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] MFA Rules not processed for user `ca050061054e452f8945e19b454294bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:45.220883 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:45.283667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:45.287617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4124/8220] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:45.293033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.356879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f2695-ad33-4eab-9c51-fee98a2cd215 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.361585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.362443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.362721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.362992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.363610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.365543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.394623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4097/8221] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:45.395688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.407333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9c7f2-2e08-4cf0-bf3b-d0790046e8bd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.463908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.464432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.464709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.464976 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.465642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.467532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.489633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4125/8222] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:45 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:45.493819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.504135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89858d3f-edad-42b6-a853-5c516e2cc219 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.509492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.510089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.510368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.510645 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.511323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.512984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.524237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4098/8223] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:45.528421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.539595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a6ac-daae-4a9e-9eb9-5036a21e3d18 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.544243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.544895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.545202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.545475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] PATH_INFO: `/v3/projects/a8f588945fc9491db77f5f41c20e46a7/users/53a2032402fd43ef87b4c35df1f68a0d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.560513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f588945fc9491db77f5f41c20e46a7, user_id=53a2032402fd43ef87b4c35df1f68a0d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.563181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.576926 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4126/8224] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:45 2022] PUT /identity/v3/projects/a8f588945fc9491db77f5f41c20e46a7/users/53a2032402fd43ef87b4c35df1f68a0d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:45.580869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.592190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823a6e4-e9c5-4ef8-b2da-b356e2489efe admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.601100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:45.653446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.654052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.654328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.654598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.655231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.656826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f68b49-8ea4-4325-95f5-1656ff7837ec admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.666907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4099/8225] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:45.671046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.681535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac866b-2f41-43a4-9c04-f62e149eda34 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.686189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.686850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.687130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.687405 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] PATH_INFO: `/v3/projects/a8f588945fc9491db77f5f41c20e46a7/users/53a2032402fd43ef87b4c35df1f68a0d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.689410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f588945fc9491db77f5f41c20e46a7, user_id=53a2032402fd43ef87b4c35df1f68a0d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.692035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.703478 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4127/8226] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:45 2022] PUT /identity/v3/projects/a8f588945fc9491db77f5f41c20e46a7/users/53a2032402fd43ef87b4c35df1f68a0d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:45:45.715517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.715740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.716013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.744267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] MFA Rules not processed for user `53a2032402fd43ef87b4c35df1f68a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:45.745523 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:45.813087 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4100/8227] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:45.824284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:45.826095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:45.887487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf0bcb-45f6-4ef5-ab92-aa79b4e3409e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:45.891096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:45.891691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:45.891962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:45.892229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:45.901389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:45.902794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:45.912890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4128/8228] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:46.020867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:46.033090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582db12-7a1e-4e89-a118-1687bdf5f35a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:46.036533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:46.037166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:46.037443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:46.038110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:46.095017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:46.096443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c482d9f-130c-4e46-b496-f8e44e5c5c4a service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:46.105970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4101/8229] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:49.763688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:49.824263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:49.830528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032dcce-9857-45d4-9a27-4130823b62d9 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:49.835483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:49.836125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:49.836399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:49.836671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] PATH_INFO: `/v3/users/ca050061054e452f8945e19b454294bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:49.837865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca050061054e452f8945e19b454294bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:49.839782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:49.890311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca050061054e452f8945e19b454294bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:49.898508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca050061054e452f8945e19b454294bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:49.899181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca050061054e452f8945e19b454294bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:49.906394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca050061054e452f8945e19b454294bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:49.907056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca050061054e452f8945e19b454294bb'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:49.924869 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4129/8230] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:49 2022] DELETE /identity/v3/users/ca050061054e452f8945e19b454294bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:49.934721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:49.934721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:49.934721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:49.953867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:49.955092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:49.986272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:50.018567 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4102/8231] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:50.031293 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:50.032898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:50.096693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe7eb-9d87-4248-b275-34bba8f82c50 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:50.100928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:50.101629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:50.101955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:50.102213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:50.112656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:50.114321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:50.125573 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4130/8232] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:50.419885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:50.421432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:50.434252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93b4ca-962d-428d-afc6-091304910da9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:50.438884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:50.439520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:50.439791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:50.440058 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] PATH_INFO: `/v3/projects/4686ed7e3fd14283959a898fa92ccbf5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:50.441226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4686ed7e3fd14283959a898fa92ccbf5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:50.443171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:50.496088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4686ed7e3fd14283959a898fa92ccbf5', 'request_id': 'req-5f949756-a067-44b7-ab87-23b4239a28fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.503379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4686ed7e3fd14283959a898fa92ccbf5', 'request_id': 'req-5f949756-a067-44b7-ab87-23b4239a28fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.510799 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4686ed7e3fd14283959a898fa92ccbf5', 'request_id': 'req-5f949756-a067-44b7-ab87-23b4239a28fb'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.522777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] The token cache is being invalidate because project 4686ed7e3fd14283959a898fa92ccbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:50.523056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.523744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.525290 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4103/8233] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:50 2022] DELETE /identity/v3/projects/4686ed7e3fd14283959a898fa92ccbf5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:50.529274 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:50.539609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c9ed3-0bd3-4748-a9e6-e4e924599099 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:50.596725 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:50.597381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:50.597661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:50.597933 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] PATH_INFO: `/v3/users/53a2032402fd43ef87b4c35df1f68a0d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:50.599096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a2032402fd43ef87b4c35df1f68a0d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:50.601622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:50.624498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:50.652593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a2032402fd43ef87b4c35df1f68a0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.660104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a2032402fd43ef87b4c35df1f68a0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.660727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a2032402fd43ef87b4c35df1f68a0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.669350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a2032402fd43ef87b4c35df1f68a0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.670014 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-662d7fda-1b81-4cb4-a75a-eafd6a33663b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a2032402fd43ef87b4c35df1f68a0d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:50.689078 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4131/8234] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:45:50 2022] DELETE /identity/v3/users/53a2032402fd43ef87b4c35df1f68a0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:50.981025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:50.982443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:50.997918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f949756-a067-44b7-ab87-23b4239a28fb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.055365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.055993 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.056308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.056540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] PATH_INFO: `/v3/projects/a8f588945fc9491db77f5f41c20e46a7` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.057654 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f588945fc9491db77f5f41c20e46a7)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.059550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.110955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f588945fc9491db77f5f41c20e46a7', 'request_id': 'req-c015e898-124c-4381-ac0a-7d5e2a1a867a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:51.119604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f588945fc9491db77f5f41c20e46a7', 'request_id': 'req-c015e898-124c-4381-ac0a-7d5e2a1a867a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:51.121532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:51.127400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f588945fc9491db77f5f41c20e46a7', 'request_id': 'req-c015e898-124c-4381-ac0a-7d5e2a1a867a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:51.138916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] The token cache is being invalidate because project a8f588945fc9491db77f5f41c20e46a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:45:51.139201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:51.139852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c015e898-124c-4381-ac0a-7d5e2a1a867a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:45:51.141384 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4104/8235] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:45:50 2022] DELETE /identity/v3/projects/a8f588945fc9491db77f5f41c20e46a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:51.146567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.147133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.147220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.167875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:51.169054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:51.228395 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4132/8236] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:45:51.236363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.236675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.237234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.259278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:51.260487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:51.268812 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4105/8237] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:51.273242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.283286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb896-97f0-407d-8f82-e51183b5eeb5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.287978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.288594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.288852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.289151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.289820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:45:51.290115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.291694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.306693 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4133/8238] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 16:45:51.310040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.320496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3a677-f4bc-4b80-9917-d73d5ed6eb71 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.325310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.325907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.326186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.326456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.327091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.328971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.363681 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4106/8239] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:51.364932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.375995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d53495-cb54-433d-b410-5f0da40d5e2d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.436095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.436628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.436915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.437220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.437910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.439863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.461643 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4134/8240] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/users => generated 304 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:51.465925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.477136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524a40-276e-49a8-b73a-9fc10a8c6325 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.481767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.482361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.482641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.482914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.483546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.485174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.496222 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4107/8241] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:51.500197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.510272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc395ca-29ff-4c80-b8e8-23d89bb706d1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.514888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.515701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.516072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.516406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.517072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.518656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b553d9-e9e7-4b1a-8070-a15f13a7abf6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.529590 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4135/8242] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:45:51.533714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.544236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf56f11-38a7-4127-8dca-3a45c6e22396 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.549082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.549729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.550007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.550280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] PATH_INFO: `/v3/projects/2d1ef0b515b94cd6a5163141ab1f3f53/users/503340ae12954ba095d98fdba67fb25e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.567091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1ef0b515b94cd6a5163141ab1f3f53, user_id=503340ae12954ba095d98fdba67fb25e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.570106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.583932 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4108/8243] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:51 2022] PUT /identity/v3/projects/2d1ef0b515b94cd6a5163141ab1f3f53/users/503340ae12954ba095d98fdba67fb25e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:51.594938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.595281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.595557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.603134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:51.626523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] MFA Rules not processed for user `503340ae12954ba095d98fdba67fb25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:51.627733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:51.692555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4136/8244] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:51.698194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.762289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025961a2-f57f-4b76-a5d5-632965c4a576 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.767055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.767652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.767923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.768192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.768802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.770714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.798547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4109/8245] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:45:51.802575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.813374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0664b1-f67f-4f4e-8e95-f63b6e62cb43 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.870890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.871500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.871778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.872046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.872684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.874619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.897155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4137/8246] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:45:51 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:45:51.901786 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.912202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6dfd-a8f2-47be-b1ab-d998187010d2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.917271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.917859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.918130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.918391 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.919014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.920591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.932437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4110/8247] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:51.936722 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:51.947968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025794-bc78-4bd0-877c-9b54b41e50d9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:51.954277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:51.955152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:51.955428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:51.955695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] PATH_INFO: `/v3/projects/32191caccf6c4051be42af339085051d/users/d9d904eb99204c98b5c20b36a4d40ea2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:51.971039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32191caccf6c4051be42af339085051d, user_id=d9d904eb99204c98b5c20b36a4d40ea2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:51.973690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:51.986744 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4138/8248] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:51 2022] PUT /identity/v3/projects/32191caccf6c4051be42af339085051d/users/d9d904eb99204c98b5c20b36a4d40ea2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:51.991825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:52.002157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7931c-65af-4cae-9e89-19f1ada743a6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:52.051798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:52.060421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:52.061205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:52.061611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:52.062042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:52.062750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:52.064449 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccb2d4-0c10-4544-970a-36783fc3dd34 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:52.075285 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4111/8249] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:45:52.079473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:52.089938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cdb0b-50de-452c-9544-95fbe3f349e1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:52.094642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:52.095290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:52.095594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:52.095865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] PATH_INFO: `/v3/projects/32191caccf6c4051be42af339085051d/users/d9d904eb99204c98b5c20b36a4d40ea2/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:52.097782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32191caccf6c4051be42af339085051d, user_id=d9d904eb99204c98b5c20b36a4d40ea2, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:52.100529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:52.111136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4139/8250] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:45:52 2022] PUT /identity/v3/projects/32191caccf6c4051be42af339085051d/users/d9d904eb99204c98b5c20b36a4d40ea2/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:45:52.123295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:52.123582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:52.123862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:52.152594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] MFA Rules not processed for user `d9d904eb99204c98b5c20b36a4d40ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:45:52.153850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:52.223149 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4112/8251] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:45:52.234480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:52.236259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:45:52.283589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:45:52.299161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12545c7b-8d5a-4526-9108-3ea07493983a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:52.303905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:52.304534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:52.304813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:52.305106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:52.314401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:52.315812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:52.325730 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4140/8252] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:45:52.483827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:45:52.497338 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d725e-56e0-46ad-a566-d1cd0a754b9b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:45:52.501017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:45:52.501633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:45:52.501906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:45:52.502197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:45:52.561904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:45:52.563375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bc224-de01-439a-be85-b46c1a4f6ec3 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:45:52.572470 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4113/8253] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:01.015746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:01.082831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b53b91-fd39-4b6d-83f4-b06e7930dc62 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:01.089765 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:01.090493 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:01.090775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:01.091046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] PATH_INFO: `/v3/users/503340ae12954ba095d98fdba67fb25e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:01.092199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=503340ae12954ba095d98fdba67fb25e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:01.094135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:01.144709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503340ae12954ba095d98fdba67fb25e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.153350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503340ae12954ba095d98fdba67fb25e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.153964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503340ae12954ba095d98fdba67fb25e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.161097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503340ae12954ba095d98fdba67fb25e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.161754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503340ae12954ba095d98fdba67fb25e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.179635 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4141/8254] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:01 2022] DELETE /identity/v3/users/503340ae12954ba095d98fdba67fb25e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:01.184221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:01.184685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:01.184785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:01.203874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:01.205089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:01.265140 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4114/8255] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:01.275349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:01.276777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:01.342804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f069baf-1a19-42e2-9a70-fd458a581cfc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:01.346519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:01.347123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:01.347398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:01.347695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:01.358396 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:01.359874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:01.371418 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4142/8256] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:01.661713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:01.663984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:01.682803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960687-35ff-4525-afd9-52cdd70be8b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:01.688199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:01.688819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:01.689106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:01.689375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] PATH_INFO: `/v3/projects/2d1ef0b515b94cd6a5163141ab1f3f53` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:01.690487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1ef0b515b94cd6a5163141ab1f3f53)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:01.692392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:01.704468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:01.743967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1ef0b515b94cd6a5163141ab1f3f53', 'request_id': 'req-77985c3a-8495-4340-8d1c-6af4244093b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.752035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1ef0b515b94cd6a5163141ab1f3f53', 'request_id': 'req-77985c3a-8495-4340-8d1c-6af4244093b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.759034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1ef0b515b94cd6a5163141ab1f3f53', 'request_id': 'req-77985c3a-8495-4340-8d1c-6af4244093b5'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.770288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] The token cache is being invalidate because project 2d1ef0b515b94cd6a5163141ab1f3f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:01.770580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.771236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.773519 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4115/8257] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:01 2022] DELETE /identity/v3/projects/2d1ef0b515b94cd6a5163141ab1f3f53 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:01.777358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:01.787297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784729c-9d31-4da6-b751-7a77cc733b7a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:01.793374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:01.846004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:01.846638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:01.846916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:01.847188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] PATH_INFO: `/v3/users/d9d904eb99204c98b5c20b36a4d40ea2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:01.848305 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d904eb99204c98b5c20b36a4d40ea2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:01.851057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:01.897966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d904eb99204c98b5c20b36a4d40ea2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.906123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d904eb99204c98b5c20b36a4d40ea2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.906723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d904eb99204c98b5c20b36a4d40ea2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.915484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d904eb99204c98b5c20b36a4d40ea2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.916246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-6d81a2a1-02b1-4113-b7f3-828780449482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d904eb99204c98b5c20b36a4d40ea2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:01.944868 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4143/8258] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:01 2022] DELETE /identity/v3/users/d9d904eb99204c98b5c20b36a4d40ea2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:02.218541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.220122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:02.234463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985c3a-8495-4340-8d1c-6af4244093b5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.294480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.295102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.295373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.295638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] PATH_INFO: `/v3/projects/32191caccf6c4051be42af339085051d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.296725 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32191caccf6c4051be42af339085051d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.298860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.345931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32191caccf6c4051be42af339085051d', 'request_id': 'req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:02.353815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32191caccf6c4051be42af339085051d', 'request_id': 'req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:02.360263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32191caccf6c4051be42af339085051d', 'request_id': 'req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:02.373248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] The token cache is being invalidate because project 32191caccf6c4051be42af339085051d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:02.373533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:02.374179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d3a567b7-e443-4b48-a6f1-bbec3c5c6375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:02.375652 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4116/8259] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:02 2022] DELETE /identity/v3/projects/32191caccf6c4051be42af339085051d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:02.380524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51886-4044-4a09-9621-d59c12431798 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.380980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51886-4044-4a09-9621-d59c12431798 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.381119 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab51886-4044-4a09-9621-d59c12431798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.401420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-aab51886-4044-4a09-9621-d59c12431798 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:02.402599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-aab51886-4044-4a09-9621-d59c12431798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:02.464086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4144/8260] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:02.471891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.472174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.472443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.493231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:02.494517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:02.503951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4117/8261] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:02.509221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab51886-4044-4a09-9621-d59c12431798 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.518879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab51886-4044-4a09-9621-d59c12431798 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.523516 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.524139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.524415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.524684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.525359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:46:02.525657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.527262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.539096 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4145/8262] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:46:02.543830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.553817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d35a1-406d-4027-97a7-38b7dac19ff0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.558663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.559250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.559521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.559820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.560476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.562387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.590919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4118/8263] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:46:02.594894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.604930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a401524-45b9-4f3b-b852-a8d9e42bf7b5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.618245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:02.664401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.665086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.665382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.665657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.666280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.668176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.689953 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4146/8264] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:02.694916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.700445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:02.706747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d39a3d-a854-4126-bc7f-955dc5b94499 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.712682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.713298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.713574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.713836 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.714511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.716037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.726441 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4119/8265] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:02.730748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.741857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35098bab-35f4-4988-bb82-9f440e70b947 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.746427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.747005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.747281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.747545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.748172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.749778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807dddd-4c7f-41dc-8959-1063a1143fc3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.760784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4147/8266] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:02.765089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.775073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387db43-046c-4a2f-b8c8-278b62971045 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:02.779605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:02.780258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.780509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.780775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] PATH_INFO: `/v3/projects/cee3f0a63a294a689e1b2f969b0869df/users/b3e58bf5934c48bc93f5fa99dc368b96/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.796041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee3f0a63a294a689e1b2f969b0869df, user_id=b3e58bf5934c48bc93f5fa99dc368b96, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:02.798723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:02.814739 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4120/8267] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:02 2022] PUT /identity/v3/projects/cee3f0a63a294a689e1b2f969b0869df/users/b3e58bf5934c48bc93f5fa99dc368b96/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:02.826977 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:02.827272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:02.827514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:02.858673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] MFA Rules not processed for user `b3e58bf5934c48bc93f5fa99dc368b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:02.859910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:02.930749 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4148/8268] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:46:02.935064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:02.997095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e622f-2bbc-4bbf-99b1-4070adb49b26 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.001742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.002341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.002618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.002892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.003524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.005467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.032966 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4121/8269] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:02 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:03.037010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.048488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f9a2-c2a1-46f4-b18e-48ab22957efe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.105169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.105774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.106057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.106328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.106957 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.108869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.134127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4149/8270] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:03 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:03.135279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.145565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbbb08-8b3a-4c7b-8474-bcfb38b7e58f admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.150452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.151046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.151326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.151599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.152233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.153867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.164633 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4122/8271] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:46:03.168512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.179047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93350b-dc61-4a3c-a7b5-881038ad99ce admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.184097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.184746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.185056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.185334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] PATH_INFO: `/v3/projects/54214bc09d9a480eaa247b7a027c1802/users/4ae271224e444f3fb9ce88720abd9e74/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.197452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:03.201834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=54214bc09d9a480eaa247b7a027c1802, user_id=4ae271224e444f3fb9ce88720abd9e74, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.205250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.218762 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4150/8272] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:03 2022] PUT /identity/v3/projects/54214bc09d9a480eaa247b7a027c1802/users/4ae271224e444f3fb9ce88720abd9e74/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:03.222854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.234923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f2889-03cc-4339-b581-c314169536d1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.292557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.293111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.293392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.293661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.294295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.295886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a88a-b237-46f0-ab97-8d3a69a97102 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.310269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4123/8273] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:03.311368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.322805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43192e93-c656-4f82-95cf-1d88ab994bcc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.327621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.328269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.328545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.328812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] PATH_INFO: `/v3/projects/54214bc09d9a480eaa247b7a027c1802/users/4ae271224e444f3fb9ce88720abd9e74/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.330888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54214bc09d9a480eaa247b7a027c1802, user_id=4ae271224e444f3fb9ce88720abd9e74, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.333513 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.344827 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4151/8274] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:03 2022] PUT /identity/v3/projects/54214bc09d9a480eaa247b7a027c1802/users/4ae271224e444f3fb9ce88720abd9e74/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:03.355131 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.355420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.355696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.384385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] MFA Rules not processed for user `4ae271224e444f3fb9ce88720abd9e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:03.385603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:03.411258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:03.454436 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4124/8275] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:03.465259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.466989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:03.526987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740d474-9b76-4755-837c-9eae041efd75 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.530634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.531227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.531501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.531767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.541488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:03.542959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad49ee-4509-4134-be47-f155a727406a service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:03.552229 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4152/8276] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:03.928508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:03.992628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0acbbb-bc6d-4dd3-91a3-962571067be4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:03.997331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:03.997957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:03.998238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:03.998508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] PATH_INFO: `/v3/users/b3e58bf5934c48bc93f5fa99dc368b96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:03.999627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e58bf5934c48bc93f5fa99dc368b96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:04.001582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:04.047342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e58bf5934c48bc93f5fa99dc368b96'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.047910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e58bf5934c48bc93f5fa99dc368b96'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.055090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e58bf5934c48bc93f5fa99dc368b96'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.055709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e58bf5934c48bc93f5fa99dc368b96'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.062866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e58bf5934c48bc93f5fa99dc368b96'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.079757 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4125/8277] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:03 2022] DELETE /identity/v3/users/b3e58bf5934c48bc93f5fa99dc368b96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:04.084216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:04.084498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:04.085297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:04.104847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:04.106061 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:04.166127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4153/8278] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:04.176001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:04.177459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:04.229179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:04.244939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63397b-3043-459b-8023-c5e5bc5a27a4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:04.248854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:04.249506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:04.249797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:04.250063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:04.260231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:04.261691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:04.271138 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4126/8279] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:04.548939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:04.550419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:04.562673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f646d1-41d2-4849-bccc-663e00a7b01b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:04.567355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:04.567987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:04.568260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:04.568524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] PATH_INFO: `/v3/projects/cee3f0a63a294a689e1b2f969b0869df` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:04.570186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee3f0a63a294a689e1b2f969b0869df)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:04.572063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:04.620679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee3f0a63a294a689e1b2f969b0869df', 'request_id': 'req-737068dd-fedf-4349-a21c-068cefaafd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.626770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee3f0a63a294a689e1b2f969b0869df', 'request_id': 'req-737068dd-fedf-4349-a21c-068cefaafd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.633597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee3f0a63a294a689e1b2f969b0869df', 'request_id': 'req-737068dd-fedf-4349-a21c-068cefaafd2d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.651360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] The token cache is being invalidate because project cee3f0a63a294a689e1b2f969b0869df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:04.651629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.652359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.654030 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4154/8280] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:04 2022] DELETE /identity/v3/projects/cee3f0a63a294a689e1b2f969b0869df => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:04.658560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:04.669767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d423c-47b9-4d5c-a218-b12375b0aa21 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:04.729333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:04.729964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:04.730236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:04.730505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] PATH_INFO: `/v3/users/4ae271224e444f3fb9ce88720abd9e74` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:04.731609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae271224e444f3fb9ce88720abd9e74)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:04.733588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:04.780305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae271224e444f3fb9ce88720abd9e74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.780954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae271224e444f3fb9ce88720abd9e74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.787863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae271224e444f3fb9ce88720abd9e74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.788678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae271224e444f3fb9ce88720abd9e74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.796630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25cf1793-bc84-4d4a-afee-33e3dd014d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae271224e444f3fb9ce88720abd9e74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:04.816155 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4127/8281] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:04 2022] DELETE /identity/v3/users/4ae271224e444f3fb9ce88720abd9e74 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:05.092953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.094497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:05.103408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:05.110982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737068dd-fedf-4349-a21c-068cefaafd2d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.170720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.171260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.171531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.171798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] PATH_INFO: `/v3/projects/54214bc09d9a480eaa247b7a027c1802` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.172886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54214bc09d9a480eaa247b7a027c1802)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.174903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.221706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54214bc09d9a480eaa247b7a027c1802', 'request_id': 'req-8786e166-5e52-4cf2-bdbb-97c2c584a996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:05.228441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54214bc09d9a480eaa247b7a027c1802', 'request_id': 'req-8786e166-5e52-4cf2-bdbb-97c2c584a996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:05.234309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54214bc09d9a480eaa247b7a027c1802', 'request_id': 'req-8786e166-5e52-4cf2-bdbb-97c2c584a996'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:05.247845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] The token cache is being invalidate because project 54214bc09d9a480eaa247b7a027c1802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:05.248130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:05.248771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8786e166-5e52-4cf2-bdbb-97c2c584a996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:05.250291 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4155/8282] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:05 2022] DELETE /identity/v3/projects/54214bc09d9a480eaa247b7a027c1802 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:05.255192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.255659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.255773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.275406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:05.276597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:05.338579 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4128/8283] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:05.346587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.347001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.347359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.368851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:05.370180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:05.378033 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4156/8284] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:05.383046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.389164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:05.393064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244a36-a144-41bb-a968-323ac3915688 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.399886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.400494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.401063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.401401 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.402209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:46:05.402543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.404167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.417157 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4129/8285] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:46:05.421478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.430912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b8ec-9715-4ad0-8943-f7833c59bea0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.435492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.436085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.436359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.436627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.437289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.439167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.469807 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4157/8286] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:05.473973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.484831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c780c-c2e0-46b1-bbf0-aa14cb07fc37 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.542976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.543631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.543912 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.544186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.544822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.546794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.567832 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4130/8287] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:46:05.572550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.583056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152b6b0-2e6c-4776-8754-8af3ca7a94db admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.589355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.589964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.590238 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.590508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.591151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.592734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.603866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4158/8288] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:05.607817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.618864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9990c-27f6-4d3b-86c7-bc86e9be30d5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.623494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.624086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.624363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.624629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.625292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.626876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa236f70-dcfa-4527-ae48-c0bd9b457551 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.637752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4131/8289] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:05.642356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.653172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065062ac-3d3b-4857-808d-62cca4f32869 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.657713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.658387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.658663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.658930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] PATH_INFO: `/v3/projects/334647fce2a74c24aa783e37a440d8d1/users/ce9eb8d208f045fda0df74c5a0f09e95/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.674064 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334647fce2a74c24aa783e37a440d8d1, user_id=ce9eb8d208f045fda0df74c5a0f09e95, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.676600 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.691709 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4159/8290] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:05 2022] PUT /identity/v3/projects/334647fce2a74c24aa783e37a440d8d1/users/ce9eb8d208f045fda0df74c5a0f09e95/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:05.703459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.703747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.704019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.732627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] MFA Rules not processed for user `ce9eb8d208f045fda0df74c5a0f09e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:05.733859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:05.798542 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4132/8291] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:05.803024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.834052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:05.867031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc01369-4105-414b-95ca-ce9a237daa65 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.871810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.872424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.872696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.872964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.873623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.875520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.907717 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4160/8292] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:05.909174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:05.920551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c210e7-b753-4dab-9034-c8d1f3b4788a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:05.981771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:05.982380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:05.982658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:05.982934 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:05.983558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:05.985545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:05.994176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:06.008625 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4133/8293] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:05 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:06.012828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.024379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd118ce-ed67-46b6-a64b-9b2bf303c457 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.029017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.029612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.029888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.030159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.030799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.032375 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.043333 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4161/8294] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:46:06.047269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.058208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f8cf6-7924-4fdf-9099-bbac681564cb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.062903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.063499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.063778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.064103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.064774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.066444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362492-6234-41b3-9534-55e73558b7fe admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.077218 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4134/8295] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:06.081333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.094203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71879d4b-47d2-48ca-976e-212635dd2b5f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.099590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.100323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.100323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.101038 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] PATH_INFO: `/v3/projects/b07fbc65f0f546208843a373f0130d12/users/5e35547190014eee9ddfff28a2b21175/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.116698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07fbc65f0f546208843a373f0130d12, user_id=5e35547190014eee9ddfff28a2b21175, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.119536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.133500 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4162/8296] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:06 2022] PUT /identity/v3/projects/b07fbc65f0f546208843a373f0130d12/users/5e35547190014eee9ddfff28a2b21175/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:06.143897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.144186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.144456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.172819 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] MFA Rules not processed for user `5e35547190014eee9ddfff28a2b21175`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:06.174047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:06.238181 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4135/8297] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:06.243184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.306872 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218060df-4d76-46f3-824b-fd6fe0a631ea admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.311514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.312113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.312388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.312656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.313316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.315190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.342177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4163/8298] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:06 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:06.346362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.357620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe99580-ed80-4ffa-a4a2-b0905de4af5d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.416163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.416761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.417071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.417342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.417963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.419858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.442100 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4136/8299] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:06 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:06.446982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.457399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fe2f6-b00e-436e-a738-4e6789e9539f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.462183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.462857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.463136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.463402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.464032 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.465671 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.476800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4164/8300] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:06.480907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.491994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67018133-b07e-4373-bf3c-27b019b7db7d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.496378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.497073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.497856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.497856 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] PATH_INFO: `/v3/projects/0cdb3a315590418db420c7bedbeebf74/users/9d140538382e4fe1b2c55951f3aff861/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.512464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdb3a315590418db420c7bedbeebf74, user_id=9d140538382e4fe1b2c55951f3aff861, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.515159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.528215 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4137/8301] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:06 2022] PUT /identity/v3/projects/0cdb3a315590418db420c7bedbeebf74/users/9d140538382e4fe1b2c55951f3aff861/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:06.532229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.543413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583304b4-c3b9-4834-9f23-41348f42e2d6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.594001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:06.604399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.605098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.605391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.605663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.606302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.607961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc8c96-28df-44cf-bcb2-c4749824c63e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.618726 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4165/8302] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:46:06.622930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.633511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863b9f5-7732-43f8-a8fd-b51cbdf37e7d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.638379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.639032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.639324 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.639583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] PATH_INFO: `/v3/projects/0cdb3a315590418db420c7bedbeebf74/users/9d140538382e4fe1b2c55951f3aff861/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.641564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdb3a315590418db420c7bedbeebf74, user_id=9d140538382e4fe1b2c55951f3aff861, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.644376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.655419 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4138/8303] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:06 2022] PUT /identity/v3/projects/0cdb3a315590418db420c7bedbeebf74/users/9d140538382e4fe1b2c55951f3aff861/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:06.666453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831671-54c9-48da-840e-f5d7219160eb None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.666733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831671-54c9-48da-840e-f5d7219160eb None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.667018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61831671-54c9-48da-840e-f5d7219160eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.696452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-61831671-54c9-48da-840e-f5d7219160eb None None] MFA Rules not processed for user `9d140538382e4fe1b2c55951f3aff861`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:06.697697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61831671-54c9-48da-840e-f5d7219160eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:06.766560 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4166/8304] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:06.779317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:06.781062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:06.803050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:06.843248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489a8b9-18a3-46b6-8b93-e03713c7d239 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:06.846887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:06.847511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:06.847784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:06.848048 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:06.906451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:06.907905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:06.919735 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4139/8305] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:08.438040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831671-54c9-48da-840e-f5d7219160eb None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:08.439552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-61831671-54c9-48da-840e-f5d7219160eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:08.454649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61831671-54c9-48da-840e-f5d7219160eb None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:08.458317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:08.458946 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:08.459336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:08.460141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:08.519802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:08.521324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:08.531415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4167/8306] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:09.101946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:09.114224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0799c3-2723-4406-a68b-d819af453186 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:09.118361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:09.119030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:09.119307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:09.119573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:09.129545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:09.130984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:09.141683 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4140/8307] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:10.202074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:10.204341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:10.284876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4c050-204c-4992-bc86-3381deb197a5 service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:10.289681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:10.290402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:10.290752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:10.291091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:10.293359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:10.330397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:10.395809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:10.398260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:10.436247 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4168/8308] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:11.664855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:11.666291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:11.682805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c10c6-1d54-429d-a7e9-033b9fa6ec18 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:11.686499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:11.687161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:11.687567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:11.687840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:11.689636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:11.707428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:11.708891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:11.729744 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4141/8309] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:15.020841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:15.025019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:15.053434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800470d-764d-4a2c-a2d3-4ec2f0cd5e02 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:15.079145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:15.079145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:15.079145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:15.079145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:15.080479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:15.153519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:15.156589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:15.169806 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4169/8310] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:15.406643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:15.412389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:15.438652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4985a2-e60a-4330-9458-8d59237cc8fb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:15.446152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:15.447160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:15.447776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:15.448416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:15.451813 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:15.521545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:15.523685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:15.534099 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4142/8311] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:16.385599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:16.489676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:16.521432 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748415-8b2e-4c3d-ae18-37e029cf6f8f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:16.539624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:16.541662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:16.541973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:16.542188 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:16.550230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:16.591184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f628a-de1c-42f7-b25e-1eb58dc39aa8 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:16.593198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:16.594839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8ea4c-8d60-4561-9e21-8c81d6d2cee0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:16.610588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:16.611651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:16.612109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:16.612790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] PATH_INFO: `/v3/users/ce9eb8d208f045fda0df74c5a0f09e95` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:16.615696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9eb8d208f045fda0df74c5a0f09e95)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:16.619089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:16.628492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4143/8312] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:16.781908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9eb8d208f045fda0df74c5a0f09e95'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:16.786655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:16.801780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9eb8d208f045fda0df74c5a0f09e95'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:16.804065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9eb8d208f045fda0df74c5a0f09e95'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:16.824111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9eb8d208f045fda0df74c5a0f09e95'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:16.825701 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9eb8d208f045fda0df74c5a0f09e95'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:16.888778 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4170/8313] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:16 2022] DELETE /identity/v3/users/ce9eb8d208f045fda0df74c5a0f09e95 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:16.892858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:16.893171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:16.893662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:16.932871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:16.934392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:16.994510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:17.058344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4144/8314] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:17.064647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:17.066853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.178984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b490-2eae-4d11-b4f2-0b7266cac489 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:17.186670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:17.187784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:17.188133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:17.188406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:17.207877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:17.210246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:17.229303 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4171/8315] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:17.245221 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:17.247031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.272371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8acafa-b686-4a34-8819-b50b46a46591 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:17.279885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:17.282601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:17.283156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:17.283749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:17.289419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.425551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:17.427515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:17.445765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4145/8316] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:17.541955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:17.544507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.591942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:17.594268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.618915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd9b94-c717-4baa-aa74-82c00cc042ec service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:17.629393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:17.630266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:17.631072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:17.631551 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] PATH_INFO: `/v3/projects/334647fce2a74c24aa783e37a440d8d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:17.634419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334647fce2a74c24aa783e37a440d8d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:17.636966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:17.668683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af002-0cf0-4871-aea2-4107c99baa2c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:17.674412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223344-282d-4177-9115-f66b463670b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:17.675232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223344-282d-4177-9115-f66b463670b0 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:17.676093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223344-282d-4177-9115-f66b463670b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:17.676517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56223344-282d-4177-9115-f66b463670b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:17.682442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-56223344-282d-4177-9115-f66b463670b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:17.701987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56223344-282d-4177-9115-f66b463670b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:17.703733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56223344-282d-4177-9115-f66b463670b0 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:17.710403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334647fce2a74c24aa783e37a440d8d1', 'request_id': 'req-8b4ab226-6335-41e6-8e5a-502dde84c646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.720559 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4172/8317] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:17.723030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334647fce2a74c24aa783e37a440d8d1', 'request_id': 'req-8b4ab226-6335-41e6-8e5a-502dde84c646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.730381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334647fce2a74c24aa783e37a440d8d1', 'request_id': 'req-8b4ab226-6335-41e6-8e5a-502dde84c646'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.743087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] The token cache is being invalidate because project 334647fce2a74c24aa783e37a440d8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:17.743300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.745091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.745720 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4146/8318] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:17 2022] DELETE /identity/v3/projects/334647fce2a74c24aa783e37a440d8d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:17.750470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223344-282d-4177-9115-f66b463670b0 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:17.764676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56223344-282d-4177-9115-f66b463670b0 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:17.858028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:17.858816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:17.859173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:17.859518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] PATH_INFO: `/v3/users/5e35547190014eee9ddfff28a2b21175` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:17.861257 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e35547190014eee9ddfff28a2b21175)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:17.863762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:17.869867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:17.945524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e35547190014eee9ddfff28a2b21175'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.953533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e35547190014eee9ddfff28a2b21175'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.954246 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e35547190014eee9ddfff28a2b21175'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.963661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e35547190014eee9ddfff28a2b21175'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.964552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e35547190014eee9ddfff28a2b21175'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:17.989785 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4173/8319] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:17 2022] DELETE /identity/v3/users/5e35547190014eee9ddfff28a2b21175 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:18.498898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:18.500972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:18.533407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ab226-6335-41e6-8e5a-502dde84c646 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:18.593399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:18.613555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:18.614235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:18.614508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:18.614775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] PATH_INFO: `/v3/projects/b07fbc65f0f546208843a373f0130d12` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:18.616576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07fbc65f0f546208843a373f0130d12)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:18.618507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:18.667904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07fbc65f0f546208843a373f0130d12', 'request_id': 'req-d85da8cd-3154-4034-98f8-0b9262bc3573'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.676055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07fbc65f0f546208843a373f0130d12', 'request_id': 'req-d85da8cd-3154-4034-98f8-0b9262bc3573'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.683515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07fbc65f0f546208843a373f0130d12', 'request_id': 'req-d85da8cd-3154-4034-98f8-0b9262bc3573'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.694504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] The token cache is being invalidate because project b07fbc65f0f546208843a373f0130d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:18.694796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.695454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.696944 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4147/8320] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:18 2022] DELETE /identity/v3/projects/b07fbc65f0f546208843a373f0130d12 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:18.700963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:18.702453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:18.715591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04639-2576-4677-af57-ce48b890b890 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:18.784639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:18.785408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:18.785688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:18.785943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] PATH_INFO: `/v3/users/9d140538382e4fe1b2c55951f3aff861` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:18.787145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d140538382e4fe1b2c55951f3aff861)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:18.789777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:18.864197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d140538382e4fe1b2c55951f3aff861'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.880886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d140538382e4fe1b2c55951f3aff861'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.883384 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d140538382e4fe1b2c55951f3aff861'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.899161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d140538382e4fe1b2c55951f3aff861'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.900333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ec615d23-1372-4a73-a845-41c0a24d5e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d140538382e4fe1b2c55951f3aff861'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:18.926206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:18.940444 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4174/8321] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:46:18 2022] DELETE /identity/v3/users/9d140538382e4fe1b2c55951f3aff861 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:19.267643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.269420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:19.284590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85da8cd-3154-4034-98f8-0b9262bc3573 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.373980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.375238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.375580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.375857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] PATH_INFO: `/v3/projects/0cdb3a315590418db420c7bedbeebf74` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.377065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdb3a315590418db420c7bedbeebf74)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.379003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.439787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdb3a315590418db420c7bedbeebf74', 'request_id': 'req-dbebd0e4-831e-4733-bf3a-cefff5bc754f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:19.451562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdb3a315590418db420c7bedbeebf74', 'request_id': 'req-dbebd0e4-831e-4733-bf3a-cefff5bc754f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:19.461298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdb3a315590418db420c7bedbeebf74', 'request_id': 'req-dbebd0e4-831e-4733-bf3a-cefff5bc754f'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:19.475582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] The token cache is being invalidate because project 0cdb3a315590418db420c7bedbeebf74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:46:19.476055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:19.476851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-dbebd0e4-831e-4733-bf3a-cefff5bc754f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:46:19.478569 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4148/8322] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:46:19 2022] DELETE /identity/v3/projects/0cdb3a315590418db420c7bedbeebf74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:46:19.483916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.485160 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.485743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.508908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:19.510176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:19.597155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4175/8323] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:19.603768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.604728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.605177 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.627399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:19.642954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:19.644777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:19.658639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4149/8324] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:19.662742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.676667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88774-6ec2-4b79-883a-4c8872b09e70 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.682665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.685465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.686563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.687130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.687499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.687788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:19.688430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:46:19.688827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.690731 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.715610 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4176/8325] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:46:19.720115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.735978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dda4c-9bbc-41a5-8461-573614fcd247 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.742409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.743039 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.743715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.744297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.745149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.747087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.783852 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4177/8326] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:46:19 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:46:19.790047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.804794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31daf41-c79f-4b89-9fae-3e96a8d6f41a None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.875446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a499-0ba3-4b48-bd09-0a25f4c175ab admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.880279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.880969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.881214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.881554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.884104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:19.887952 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.888782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.889240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.889644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.890343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.892566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.899264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.900713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.912668 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4150/8327] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:46:19.919062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4178/8328] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:46:19 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:46:19.922906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.936485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cf68e-c734-468b-9572-c7fe91428bd0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.941794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.942403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.942675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.942942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.943768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.946676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:19.961049 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4151/8329] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:19.963425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:19.975031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3edb21-0b28-46fc-95b8-91191f2f93f9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:19.980749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:19.981862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:19.981862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:19.982080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:19.982617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:19.984226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdccf2-6fed-41ed-b4c5-279565115984 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:20.001143 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4179/8330] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:46:20.002440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:20.014325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aff3e-0877-4cbc-aee4-96cf5f72ad28 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:20.023091 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:20.024005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:20.024290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:20.024565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] PATH_INFO: `/v3/projects/0b93599474964d94a2f675ec746dcce7/users/5e99b9cd9bfc4d9c9e5726ec86efc352/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:20.041601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b93599474964d94a2f675ec746dcce7, user_id=5e99b9cd9bfc4d9c9e5726ec86efc352, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:20.044350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:20.061202 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4152/8331] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:46:20 2022] PUT /identity/v3/projects/0b93599474964d94a2f675ec746dcce7/users/5e99b9cd9bfc4d9c9e5726ec86efc352/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:46:20.072689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09da5a-c868-4a32-a7e9-0ec8ab2525d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:20.073159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09da5a-c868-4a32-a7e9-0ec8ab2525d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:20.073343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09da5a-c868-4a32-a7e9-0ec8ab2525d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:20.106922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ee09da5a-c868-4a32-a7e9-0ec8ab2525d5 None None] MFA Rules not processed for user `5e99b9cd9bfc4d9c9e5726ec86efc352`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:20.108199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ee09da5a-c868-4a32-a7e9-0ec8ab2525d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:20.146033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:20.196723 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4180/8332] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:20.209490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:20.212787 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:20.288870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1321f-4e02-4bad-b6f3-833127f25592 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:20.293350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:20.293766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:20.294044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:20.294315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:20.305553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:20.307180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:20.317454 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4153/8333] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:21.814003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd26f-ec8a-4a1e-be57-e346c86336bc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:21.814558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd26f-ec8a-4a1e-be57-e346c86336bc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:21.814756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dd26f-ec8a-4a1e-be57-e346c86336bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:21.842241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2d7dd26f-ec8a-4a1e-be57-e346c86336bc None None] MFA Rules not processed for user `5e99b9cd9bfc4d9c9e5726ec86efc352`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:21.843503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2d7dd26f-ec8a-4a1e-be57-e346c86336bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:21.851377 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4181/8334] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:30.312902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:31.835182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=16 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:31.835936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:31.837343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:31.983208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a48c1-c126-467b-96b7-464a22526f68 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:31.990378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:31.991339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:31.991627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:31.991906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:31.993904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:32.020025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:32.022557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:32.038036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4154/8335] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:33.790975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:33.791562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:33.791935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:33.817414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] MFA Rules not processed for user `928b7b2e278d406eac6ecf01af7b91bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:46:33.818514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:33.908397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4182/8336] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:46:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:46:34.309097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:46:34.397698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea09f20-b724-4702-9b4e-71442e528c65 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:46:34.402617 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:46:34.403673 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:46:34.403949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:46:34.404219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:46:34.406842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:46:34.421540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:46:34.422998 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:46:34.446434 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4155/8337] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:46:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:46:43.901416 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:46:44.428492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=60 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:06.547874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:47:06.550255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:06.660540 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598f460-7988-47cc-95d4-f4c4eb2dbc69 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:47:06.665988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:47:06.666609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:47:06.666886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:47:06.667150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:47:06.675754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:47:06.677386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:47:06.686452 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4183/8338] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:47:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:47:16.682643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=41 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:31.759749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:47:31.761214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:31.776981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b7c95-f0dd-4b6a-97f5-e30f9a356a9f service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:47:31.780706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:47:31.781351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:47:31.781625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:47:31.781890 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:47:31.783612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:31.797267 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:47:31.798688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:47:31.809526 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4156/8339] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:47:41.357572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:47:41.377541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31ffb0-214c-4189-bd21-398e0fcb2c8a service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:47:41.387342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:47:41.388217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:47:41.388655 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:47:41.389910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:47:41.391973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:41.411714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:47:41.413449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350e39c-e213-42ac-a1f9-8835b6d08942 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:47:41.432677 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4184/8340] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:47:41.803217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:46.225218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:47:46.226686 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:46.375908 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b735ab-b040-4d67-b60f-a52341413dac service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:47:46.381460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:47:46.382660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:47:46.383308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:47:46.383891 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:47:46.386378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:46.406014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:47:46.407873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:47:46.425759 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4157/8341] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:47:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:47:51.423742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:47:53.243187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:47:53.243898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:47:53.243898 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:47:53.268824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] MFA Rules not processed for user `c0d13a891f6445a2b12c8b30182df7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:47:53.270487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:47:53.394401 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4185/8342] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:47:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:47:56.418495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=32 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:03.385562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:13.329121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:13.346467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d991586-f326-4c33-a036-0bcd5c722c93 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:13.354945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:13.356044 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:13.356320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:13.356585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:13.358727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:13.380474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:13.383121 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0fe52-f341-4403-9155-635920fd93e4 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:13.405399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4158/8343] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:48:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:48:13.418093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:13.419543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:13.501492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29052d33-10bf-4e1b-a755-e65c1564485a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:13.506768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:13.507427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:13.507839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:13.508612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] PATH_INFO: `/v3/users/928b7b2e278d406eac6ecf01af7b91bf` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:13.509940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=928b7b2e278d406eac6ecf01af7b91bf)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:13.511968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:13.563672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928b7b2e278d406eac6ecf01af7b91bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:13.571325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928b7b2e278d406eac6ecf01af7b91bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:13.572036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928b7b2e278d406eac6ecf01af7b91bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:13.578980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928b7b2e278d406eac6ecf01af7b91bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:13.579625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928b7b2e278d406eac6ecf01af7b91bf'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:13.596720 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4186/8344] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:48:13 2022] DELETE /identity/v3/users/928b7b2e278d406eac6ecf01af7b91bf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:48:13.601290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:13.602059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:13.602327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:13.622370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:13.623558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:13.689485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4159/8345] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:13.700285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:13.701738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:13.762867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977be0f6-2112-4878-bc8e-ffb7098b7fad admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:13.766514 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:13.767117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:13.767418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:13.767681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:13.777337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:13.778756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:13.788800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4187/8346] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:48:13.967907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:13.969378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:13.982503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0fa7-2750-42f3-8bed-7a70f28e330d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:13.987537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:13.988186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:13.988454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:13.988720 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] PATH_INFO: `/v3/projects/65f1daaa3adc40258f909dc2ff87eba8` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:13.990237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f1daaa3adc40258f909dc2ff87eba8)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:13.993120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:14.042889 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f1daaa3adc40258f909dc2ff87eba8', 'request_id': 'req-9836538c-6b4a-4fd9-946b-4f484b23a747'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.050553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f1daaa3adc40258f909dc2ff87eba8', 'request_id': 'req-9836538c-6b4a-4fd9-946b-4f484b23a747'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.057453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f1daaa3adc40258f909dc2ff87eba8', 'request_id': 'req-9836538c-6b4a-4fd9-946b-4f484b23a747'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.067754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] The token cache is being invalidate because project 65f1daaa3adc40258f909dc2ff87eba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:48:14.068035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.068669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.070826 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4160/8347] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:48:13 2022] DELETE /identity/v3/projects/65f1daaa3adc40258f909dc2ff87eba8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:48:14.074893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:14.084706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea34af4-3d20-41f6-af66-420b4a70c2b2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:14.102932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:14.144771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:14.145425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.145698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.145967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] PATH_INFO: `/v3/users/281dabe586b2400db0c00623fb27f1fc` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.147069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281dabe586b2400db0c00623fb27f1fc)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:14.149018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:14.196909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281dabe586b2400db0c00623fb27f1fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.210242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281dabe586b2400db0c00623fb27f1fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.210959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281dabe586b2400db0c00623fb27f1fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.218573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281dabe586b2400db0c00623fb27f1fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.219243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-c685737a-e38b-426b-9916-e8af4992aa25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281dabe586b2400db0c00623fb27f1fc'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.236568 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4188/8348] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:48:14 2022] DELETE /identity/v3/users/281dabe586b2400db0c00623fb27f1fc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:48:14.547698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:14.549344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:14.573095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836538c-6b4a-4fd9-946b-4f484b23a747 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:14.651351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:14.652174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.652472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.652743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] PATH_INFO: `/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.654076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=969a56c12a5c4bbb90d9cb48cefa5839)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:14.656261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:14.670561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:14.717150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969a56c12a5c4bbb90d9cb48cefa5839', 'request_id': 'req-25202e63-6630-48cd-927e-339945f5c11c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.725456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969a56c12a5c4bbb90d9cb48cefa5839', 'request_id': 'req-25202e63-6630-48cd-927e-339945f5c11c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.732545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969a56c12a5c4bbb90d9cb48cefa5839', 'request_id': 'req-25202e63-6630-48cd-927e-339945f5c11c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.744921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] The token cache is being invalidate because project 969a56c12a5c4bbb90d9cb48cefa5839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:48:14.745240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.745894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-25202e63-6630-48cd-927e-339945f5c11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:48:14.747385 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4161/8349] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:48:14 2022] DELETE /identity/v3/projects/969a56c12a5c4bbb90d9cb48cefa5839 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:48:14.753240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.753892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.754174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.775044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:14.776248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:14.840315 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4189/8350] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:14.848962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.849492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.849881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.871494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:14.872702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:14.881036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4162/8351] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:14.886113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:14.896213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f0ae8-e168-4667-8563-9d0c10549bfd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:14.901358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:14.901958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.902232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.902500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.903146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:48:14.903444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:14.905059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:14.917602 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4190/8352] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:48:14.921863 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:14.942697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068cf63-6d7e-47fb-a92a-32661c82c53d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:14.948713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:14.949459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:14.949842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:14.950136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:14.950867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:14.952882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:14.984370 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4163/8353] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:48:14 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:48:14.986046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:14.997465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c03a5f-759b-458d-8d0a-74272432e117 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:15.025451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:15.061296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:15.061911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.062182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.062447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.063079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:15.064965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:15.089849 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4191/8354] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:48:14 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:48:15.091293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:15.102248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7d988-cbcd-42a4-80eb-23c1b0b85af1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:15.106975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:15.107568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.107840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.108106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.108732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:15.110350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:15.121331 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4164/8355] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:48:15.125567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:15.135762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5caae-f307-48f6-9bf7-73dbde105cc5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:15.140974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:15.141592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.141862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.142130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.142788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:15.144361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83408b65-d5b1-4b06-9ba4-5c615d86c09a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:15.154998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4192/8356] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:48:15.159211 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:15.170347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f525b-a57b-4625-b7cc-94055270217b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:15.175136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:15.175793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.176076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.176346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] PATH_INFO: `/v3/projects/ae3ccea24f5143d6aeadd47d1715855d/users/0642bec465064e618f1e633b4e5001b6/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.193074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3ccea24f5143d6aeadd47d1715855d, user_id=0642bec465064e618f1e633b4e5001b6, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:15.195766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:15.208811 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4165/8357] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:48:15 2022] PUT /identity/v3/projects/ae3ccea24f5143d6aeadd47d1715855d/users/0642bec465064e618f1e633b4e5001b6/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:48:15.214325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55f78-79eb-4127-82ea-1160fc4d64b8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.214610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55f78-79eb-4127-82ea-1160fc4d64b8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.214878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55f78-79eb-4127-82ea-1160fc4d64b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.235011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-57e55f78-79eb-4127-82ea-1160fc4d64b8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:15.236157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-57e55f78-79eb-4127-82ea-1160fc4d64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:15.301973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4193/8358] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:15.312833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:15.314727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:15.382948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15203b9-7c97-4827-b71a-b4e52ace73ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:15.386742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:15.387348 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:15.387626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:15.387899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:15.397412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:15.399656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:15.409537 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4166/8359] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:48:20.001498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef335-c231-43d8-a304-c56496286487 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.001996 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef335-c231-43d8-a304-c56496286487 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.002102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ef335-c231-43d8-a304-c56496286487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.055535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-425ef335-c231-43d8-a304-c56496286487 None None] MFA Rules not processed for user `0642bec465064e618f1e633b4e5001b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:20.056841 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-425ef335-c231-43d8-a304-c56496286487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:20.169561 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4194/8360] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:20.174552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.186549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29099b-03c1-493f-9fd2-f6478c9c7fef service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.192606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.193462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.193734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.194008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.194652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.198020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.246931 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4167/8361] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:48:20 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:48:20.251478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef335-c231-43d8-a304-c56496286487 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.265499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ef335-c231-43d8-a304-c56496286487 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.308984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:20.339121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.339756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.340036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.340304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.340975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.343049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.395941 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4195/8362] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:48:20 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:48:20.400162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.410987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761312a-4143-479a-9e99-194f2e67b4bb admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.416310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.416910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.417242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.417511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.418153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.419741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.435866 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4168/8363] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:48:20.440318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.451794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932207f3-9097-4deb-a678-ec2fbcc472b1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.456589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.457301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.457581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.457856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] PATH_INFO: `/v3/projects/9a110f605c9b42349631e73154b82e85/users/0ed827713408402cb9fb1c1e0a82760a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.474732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a110f605c9b42349631e73154b82e85, user_id=0ed827713408402cb9fb1c1e0a82760a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.478235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.495162 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4196/8364] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:48:20 2022] PUT /identity/v3/projects/9a110f605c9b42349631e73154b82e85/users/0ed827713408402cb9fb1c1e0a82760a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:48:20.499447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.512714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cf0e0-5cb7-4d8f-a855-04c5608884da admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.519245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:20.578765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.579406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.579685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.579955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.580599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.582242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f097e-f13a-4e3f-87ec-cb315f045c49 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.596302 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4169/8365] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:48:20.597487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:20.611123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74407-e75f-472f-b16f-c24a50468dc2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:20.616376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:20.617790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:20.618077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:20.618351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] PATH_INFO: `/v3/projects/9a110f605c9b42349631e73154b82e85/users/0ed827713408402cb9fb1c1e0a82760a/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:20.620418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a110f605c9b42349631e73154b82e85, user_id=0ed827713408402cb9fb1c1e0a82760a, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:20.623149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:20.634419 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4197/8366] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:48:20 2022] PUT /identity/v3/projects/9a110f605c9b42349631e73154b82e85/users/0ed827713408402cb9fb1c1e0a82760a/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:48:26.159742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616d43-f056-4f26-a2f8-93bd2af70b87 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:26.160215 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616d43-f056-4f26-a2f8-93bd2af70b87 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:26.160321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616d43-f056-4f26-a2f8-93bd2af70b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:26.207335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-35616d43-f056-4f26-a2f8-93bd2af70b87 None None] MFA Rules not processed for user `0ed827713408402cb9fb1c1e0a82760a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:26.208814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-35616d43-f056-4f26-a2f8-93bd2af70b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:26.322597 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4170/8367] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:26.336616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:26.339521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:26.451339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb23b2a-1851-4e4f-83d3-7d1a34982d04 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:26.458886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:26.459611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:26.459960 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:26.460303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:26.470935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:26.473141 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:26.485910 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4198/8368] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:48:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:48:26.552598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e926-52f9-4ec2-b40d-256e00b44ab2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:26.552913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e926-52f9-4ec2-b40d-256e00b44ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:26.553202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8e926-52f9-4ec2-b40d-256e00b44ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:26.576134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6ba8e926-52f9-4ec2-b40d-256e00b44ab2 None None] MFA Rules not processed for user `0642bec465064e618f1e633b4e5001b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:26.577431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6ba8e926-52f9-4ec2-b40d-256e00b44ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:26.653265 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4171/8369] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:48:27.089591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:48:27.091252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:27.162864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46d6e-c890-4801-8c95-89d2dcfb9696 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:48:27.166789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:48:27.167510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:27.167889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:27.168290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:27.170415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:27.185507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:48:27.187333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:48:27.200310 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4199/8370] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:48:36.644588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=85 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:37.192665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:48:41.352834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:48:41.353506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:48:41.353506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:48:41.373792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] MFA Rules not processed for user `0642bec465064e618f1e633b4e5001b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:48:41.375004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:48:41.382288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4172/8371] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:48:51.368681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:07.847335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:07.949268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58053344-6544-41ae-a6cd-20ca1098a650 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:07.954406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:07.955059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:07.955390 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:07.955657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] PATH_INFO: `/v3/users/0642bec465064e618f1e633b4e5001b6` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:07.956806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0642bec465064e618f1e633b4e5001b6)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:07.958730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:08.008527 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0642bec465064e618f1e633b4e5001b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.017281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0642bec465064e618f1e633b4e5001b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.017926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0642bec465064e618f1e633b4e5001b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.025638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0642bec465064e618f1e633b4e5001b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.026355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0642bec465064e618f1e633b4e5001b6'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.047473 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4200/8372] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:49:07 2022] DELETE /identity/v3/users/0642bec465064e618f1e633b4e5001b6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:49:08.243003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:08.279272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c965a9-230f-401f-a0ba-4fcd4962c35e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:08.345881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:08.346783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:08.347086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:08.347363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] PATH_INFO: `/v3/projects/ae3ccea24f5143d6aeadd47d1715855d` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:08.348580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3ccea24f5143d6aeadd47d1715855d)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:08.353707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:08.416413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3ccea24f5143d6aeadd47d1715855d', 'request_id': 'req-b10a881a-3c94-40e5-b870-83a9e8f83ea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.424016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3ccea24f5143d6aeadd47d1715855d', 'request_id': 'req-b10a881a-3c94-40e5-b870-83a9e8f83ea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.431943 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3ccea24f5143d6aeadd47d1715855d', 'request_id': 'req-b10a881a-3c94-40e5-b870-83a9e8f83ea4'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.442906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] The token cache is being invalidate because project ae3ccea24f5143d6aeadd47d1715855d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:49:08.443321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.444311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.446356 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4173/8373] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:49:08 2022] DELETE /identity/v3/projects/ae3ccea24f5143d6aeadd47d1715855d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:49:08.450196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:08.451727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:08.476770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855984-d749-4b4e-b368-1287ebe5e71f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:08.527019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:08.543559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:08.544432 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:08.544566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:08.544746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] PATH_INFO: `/v3/users/0ed827713408402cb9fb1c1e0a82760a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:08.545918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed827713408402cb9fb1c1e0a82760a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:08.547858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:08.595109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed827713408402cb9fb1c1e0a82760a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.603313 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed827713408402cb9fb1c1e0a82760a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.603903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed827713408402cb9fb1c1e0a82760a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.611185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed827713408402cb9fb1c1e0a82760a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.611846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed827713408402cb9fb1c1e0a82760a'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.629996 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4201/8374] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:49:08 2022] DELETE /identity/v3/users/0ed827713408402cb9fb1c1e0a82760a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:49:08.842481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:08.843949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:08.857692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a881a-3c94-40e5-b870-83a9e8f83ea4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:08.919042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:08.919681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:08.919961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:08.920231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] PATH_INFO: `/v3/projects/9a110f605c9b42349631e73154b82e85` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:08.921378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a110f605c9b42349631e73154b82e85)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:08.923294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:08.941234 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:08.975603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a110f605c9b42349631e73154b82e85', 'request_id': 'req-9d6067d8-3862-4018-8433-cbb346005f74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.984301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a110f605c9b42349631e73154b82e85', 'request_id': 'req-9d6067d8-3862-4018-8433-cbb346005f74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:08.990810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a110f605c9b42349631e73154b82e85', 'request_id': 'req-9d6067d8-3862-4018-8433-cbb346005f74'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:09.001865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] The token cache is being invalidate because project 9a110f605c9b42349631e73154b82e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:49:09.002150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:09.002796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:49:09.004279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4174/8375] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:49:08 2022] DELETE /identity/v3/projects/9a110f605c9b42349631e73154b82e85 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:49:11.763335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:11.764863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:11.863400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdae63-a132-4345-aae8-57944827f2cf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:11.923336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:11.946744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:11.947389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:11.947666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:11.947936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:11.949834 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:11.964718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:11.966371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6226c-8e1a-44c8-84f8-da5bafd04de2 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:11.980601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4202/8376] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:49:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:49:18.998946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:20.190316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:20.191840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:20.223464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6067d8-3862-4018-8433-cbb346005f74 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:20.228533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:20.229152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:20.229436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:20.229710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:20.231404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:20.249927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:20.251527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e2248-603e-4b03-a6e9-742c36ac9fd7 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:20.266246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4175/8377] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:49:21.972221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=8 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:30.261039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:40.663337 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:40.664846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:40.665168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:40.715660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] MFA Rules not processed for user `c0d13a891f6445a2b12c8b30182df7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:49:40.717069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:40.845841 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4203/8378] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:49:41.792517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:41.793111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:41.793111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:41.891839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:49:41.893086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:49:41.908633 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4176/8379] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:49:41.926224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:49:41.944863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18039614-e30a-4e00-92ba-1ef97ad50643 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:49:41.950696 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:49:41.951380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:49:41.951663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:49:41.951929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:49:41.962471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:49:41.964060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8072e-0433-4433-8f73-8022bcab08cb service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:49:41.974870 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4204/8380] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:49:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:49:51.889159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=17 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:49:51.970216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=31 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:50:25.585163 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:50:25.599210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ad95d-8e0f-46e3-8de5-8f5f1f368676 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:50:25.605968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:50:25.609897 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:50:25.610182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:50:25.610453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:50:25.612283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:50:25.628448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:50:25.630085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:50:25.644016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4177/8381] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:50:35.636568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:11.438549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e207-34cb-47c5-bf12-75bac3c7618a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:11.439017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e207-34cb-47c5-bf12-75bac3c7618a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:11.439091 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7e207-34cb-47c5-bf12-75bac3c7618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:11.513111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e3d7e207-34cb-47c5-bf12-75bac3c7618a None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:11.514512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3d7e207-34cb-47c5-bf12-75bac3c7618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:11.576624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4205/8382] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:11.587421 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:11.598447 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f819e2-6083-40e3-9db5-8fdd9f8fffce service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:11.603054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:11.603690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:11.604085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:11.604366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:11.606227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:11.708446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:11.709647 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:11.724275 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4178/8383] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:12.924575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:12.925135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:12.925486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:12.948964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:12.950289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:12.956879 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4206/8384] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:12.963571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:12.973520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca12342-e154-46f8-98fd-37abcb6a1c2d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:12.977596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:12.978199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:12.978510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:12.978762 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:12.980608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:12.998938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:13.000694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:13.017510 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4179/8385] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:19.753858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:19.755272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:19.816626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15459f4-b1b9-4c32-96ed-90a0a2d8a882 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:19.820820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:19.821490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:19.821771 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:19.822042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:19.823783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:19.887394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:19.888873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bfa11-d153-4f16-94ed-b7d5cd279318 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:19.900304 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4207/8386] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:19.949543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:19.951052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.042713 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9e3ae-4841-45de-9c8c-8bdfaac1b908 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:20.047197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:20.047823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.048098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.048369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] PATH_INFO: `/v3/users/5e99b9cd9bfc4d9c9e5726ec86efc352` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.049536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e99b9cd9bfc4d9c9e5726ec86efc352)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:20.051452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:20.092364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:20.104361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e99b9cd9bfc4d9c9e5726ec86efc352'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.105032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e99b9cd9bfc4d9c9e5726ec86efc352'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.111977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e99b9cd9bfc4d9c9e5726ec86efc352'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.112627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e99b9cd9bfc4d9c9e5726ec86efc352'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.121090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e99b9cd9bfc4d9c9e5726ec86efc352'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.139036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4180/8387] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:51:19 2022] DELETE /identity/v3/users/5e99b9cd9bfc4d9c9e5726ec86efc352 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:20.143505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.143787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.144063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.172239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:20.173475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.194474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:20.235088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4208/8388] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:51:20.245701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:20.247092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.306888 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91492-7e8a-4955-b0f4-06126339b9f1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:20.310502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:20.311113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.311445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.311659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.322135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:20.323575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d466-ccfd-4252-a6c4-fe660bf722b0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:20.334323 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4181/8389] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:51:20.506324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:20.509099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.521629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0b22c-10b2-49d9-97c1-0af59a0a7e50 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:20.528001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:20.528641 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.528913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.529372 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] PATH_INFO: `/v3/projects/0b93599474964d94a2f675ec746dcce7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.530469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b93599474964d94a2f675ec746dcce7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:20.532442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:20.595754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b93599474964d94a2f675ec746dcce7', 'request_id': 'req-1628787f-8115-4558-8a38-b30d85ff3428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.604586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b93599474964d94a2f675ec746dcce7', 'request_id': 'req-1628787f-8115-4558-8a38-b30d85ff3428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.613928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b93599474964d94a2f675ec746dcce7', 'request_id': 'req-1628787f-8115-4558-8a38-b30d85ff3428'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.628444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] The token cache is being invalidate because project 0b93599474964d94a2f675ec746dcce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:51:20.628738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.629395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-1628787f-8115-4558-8a38-b30d85ff3428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:51:20.630978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4209/8390] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:51:20 2022] DELETE /identity/v3/projects/0b93599474964d94a2f675ec746dcce7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:20.638385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.638689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.638962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.679141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:20.681014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.743134 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4182/8391] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:51:20.854732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.855270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.855270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.876214 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:20.877450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:20.886821 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4210/8392] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:20.890881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:20.900692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f66d27-161d-4598-9638-bdf4a59c0f70 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:20.905195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:20.905784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.906057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.906404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.907162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:51:20.907465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:20.909084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:20.921720 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4183/8393] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:51:20.925896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:20.937325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b307559-b2b1-43c7-b14a-95bfdd947087 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:20.942005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:20.942619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:20.942897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:20.943169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:20.943799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:20.946711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:20.984391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4211/8394] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:51:20 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:51:20.988610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:20.999664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f67e-377c-4e58-9aac-5e387978cb15 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.025576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:21.059598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.060199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.060472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.060745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.061412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.063304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.085191 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4184/8395] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:51:20 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:51:21.089369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.099917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373440e3-93c1-4815-826c-182742db3713 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.105495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.106019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.106288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.106550 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.107189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.108755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.120009 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4212/8396] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:51:21.124500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.138648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a84e3-7ab4-4b0f-9071-89171b9b10be admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.144778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.145607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.145999 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.146417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.147303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.149622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71385753-7780-4e16-9b71-d7e605569329 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.163220 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4185/8397] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:51:21.168326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.178490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067d0a1-2ea6-49fe-80ac-893da47f6923 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.184124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.184796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.185137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.185377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] PATH_INFO: `/v3/projects/a41380f5938b427c977e7b68dcb484bb/users/da01928a55724b48807fa0b5f88db27f/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.200425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41380f5938b427c977e7b68dcb484bb, user_id=da01928a55724b48807fa0b5f88db27f, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.203073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.216170 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4213/8398] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:51:21 2022] PUT /identity/v3/projects/a41380f5938b427c977e7b68dcb484bb/users/da01928a55724b48807fa0b5f88db27f/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:21.227839 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.228116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.228384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.261346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] MFA Rules not processed for user `da01928a55724b48807fa0b5f88db27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:21.262596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:21.334951 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4186/8399] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:21.340042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.382654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:21.405250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3fb57-2232-4d13-9af3-5179c9a08240 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.410013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.410625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.410905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.411182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.411857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.414823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.443565 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4214/8400] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:51:21.448105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.459643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbb7e7-6b15-441f-8877-bf75de09c41f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.520237 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.520830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.521137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.521406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.522022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.524343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.556636 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4187/8401] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:51:21.560794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.571964 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222283f-6111-42cc-b121-cd4011a76696 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.576515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.577148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.577426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.577694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.578328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.579897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.590816 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4215/8402] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:51:21.594930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.605381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d82fb-6cdf-4ace-9ea7-7b775aff9516 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.610050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.610637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.610913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.611183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.611822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.613484 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168363b1-545c-4dbc-91fd-dca49e27ba58 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.624280 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4188/8403] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:51:21.628386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.639831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056c2a-5b80-4415-bd72-f0016ac7ee15 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.644471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.645156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.645440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.645715 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] PATH_INFO: `/v3/projects/cc631097c31a42299c659f3584c0a8a2/users/b09c38851ce7406cb123db1b1fbda88c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.660798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc631097c31a42299c659f3584c0a8a2, user_id=b09c38851ce7406cb123db1b1fbda88c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.663578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.677511 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4216/8404] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:51:21 2022] PUT /identity/v3/projects/cc631097c31a42299c659f3584c0a8a2/users/b09c38851ce7406cb123db1b1fbda88c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:21.688704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.688986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.689286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.720107 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] MFA Rules not processed for user `b09c38851ce7406cb123db1b1fbda88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:21.721351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:21.725429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:21.792651 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4189/8405] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:21.797223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.863699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e22d8f-1c66-4f95-b494-e0d900d0202e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.869680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.870276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.870546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.870810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.871474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.873418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:21.903582 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4217/8406] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:51:21.904587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:21.915746 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231ae04-ecbf-4647-9486-326225cb21db None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:21.982775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:21.983383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:21.983659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:21.983955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:21.984607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:21.986545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.013226 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4190/8407] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:51:21 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:51:22.017290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:22.027925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f6afc-72e8-434f-a1ac-a778896bc2c6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:22.032486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:22.033107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.033385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.033654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.034547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:22.036292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.048114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4218/8408] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:51:22.052191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:22.063340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08f73-912b-49ed-8220-c6b9d4a2a04d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:22.068284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:22.068931 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.069307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.069580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] PATH_INFO: `/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2/users/78250baa1d64427eb6f3ccd075fc004d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.085259 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cdbd948d3a4064bd6c04949dd3f3f2, user_id=78250baa1d64427eb6f3ccd075fc004d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:22.088501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.102661 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4191/8409] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:51:22 2022] PUT /identity/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2/users/78250baa1d64427eb6f3ccd075fc004d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:22.106905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:22.116770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f74823-8ff6-4f0b-b840-94611cc902ca admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:22.176636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:22.177185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.177458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.177729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.178356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:22.180041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f04de-0b72-4694-aafa-156a9f7202e0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.182139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:22.190866 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4219/8410] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:51:22.195939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:22.209973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71120ead-c511-4054-8188-ace01b3f2d89 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:22.215320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:22.215959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.216232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.216499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] PATH_INFO: `/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2/users/78250baa1d64427eb6f3ccd075fc004d/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.218462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cdbd948d3a4064bd6c04949dd3f3f2, user_id=78250baa1d64427eb6f3ccd075fc004d, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:22.221179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.232550 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4192/8411] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:51:22 2022] PUT /identity/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2/users/78250baa1d64427eb6f3ccd075fc004d/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:51:22.244798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.245225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.245529 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.275780 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] MFA Rules not processed for user `78250baa1d64427eb6f3ccd075fc004d`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:22.277018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:22.349137 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4220/8412] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:22.364843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:22.366796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:22.428148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:22.451480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cb36f-3a0a-4bf8-9cc6-5ee2c5dc8d86 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:22.458174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:22.458845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:22.459154 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:22.459464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:22.517778 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:22.520083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5ef52-1920-4e6f-a39c-5442d458f943 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:22.529985 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4193/8413] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:24.695830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:24.697524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:24.759914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3642a-47fb-47cf-872b-4785bcc90d67 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:24.763517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:24.764123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:24.764393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:24.764658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:24.774413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:24.775831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14419e22-5b08-412e-8b80-c6917e3c75c7 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:24.785716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4221/8414] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:28.267887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:28.268381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:28.268491 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:28.292386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] MFA Rules not processed for user `da01928a55724b48807fa0b5f88db27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:28.293671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:28.301096 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4194/8415] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:29.069113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:29.073359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:29.073359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:29.096264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:51:29.098471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:29.193913 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4222/8416] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:51:29.215233 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:29.216748 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:29.243087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada9727-bfb4-490f-8676-5db83b5ee695 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:29.249469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:29.250116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:29.250404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:29.250671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:29.261343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:29.263981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:29.274490 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4195/8417] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:32.058954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:32.060522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:32.080117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca8397-5915-4878-9749-4331ba7ecc49 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:32.086541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:32.087225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:32.087511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:32.087784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:32.089823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:32.108122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:32.109761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:32.129126 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4223/8418] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:32.314494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:32.324667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7195fc5-a57c-4c40-a334-4bfb608586e6 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:32.328403 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:32.328919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:32.329245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:32.329518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:32.331278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:32.346341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:32.347802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:32.359619 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4196/8419] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:37.613479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:37.631040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067369-29e0-4eb3-b1d3-bf91e748eff7 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:37.639280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:37.640190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:37.640620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:37.641099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:37.643239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:37.654312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:37.660058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:37.662430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:37.677981 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4224/8420] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:42.353409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=45 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:47.669905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:51:49.807127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:51:49.824061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a331018-f89e-4c3a-8e98-a8adf4a368eb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:51:49.829546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:51:49.830140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:51:49.830416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:51:49.830685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:51:49.832402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:51:49.926987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:51:49.928593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46668bb-5301-4931-a960-69ea43a1e1dc service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:51:49.948461 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4197/8421] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:51:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:51:59.945727 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=41 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:28.673137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:28.674718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:28.741035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1561-38a3-450e-8642-d5dd998bb7df service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:28.746651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:28.746651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:28.746812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:28.747016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] PATH_INFO: `/v3/users/c0d13a891f6445a2b12c8b30182df7e2` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:28.749370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d13a891f6445a2b12c8b30182df7e2)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:28.751245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:28.802737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d13a891f6445a2b12c8b30182df7e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:28.809879 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d13a891f6445a2b12c8b30182df7e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:28.811357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d13a891f6445a2b12c8b30182df7e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:28.819063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d13a891f6445a2b12c8b30182df7e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:28.819759 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d13a891f6445a2b12c8b30182df7e2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:28.838487 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4225/8422] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:52:28 2022] DELETE /identity/v3/users/c0d13a891f6445a2b12c8b30182df7e2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:28.843230 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:28.843743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:28.844042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:28.864615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:28.865913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:28.927283 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4198/8423] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:28.938096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:28.939576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:29.000239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46fca9-ad7a-436b-a331-5008e0f6b052 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:29.003868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:29.004498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.004772 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.005188 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.015175 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:29.016684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:29.026338 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4226/8424] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:29.203413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:29.204814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:29.217167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab04b06-f8d6-433a-8d35-492b561b3dd8 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:29.222264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:29.222905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.223179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.223471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] PATH_INFO: `/v3/projects/79a339cc5db643808022cf6e080fc9d5` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.224605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a339cc5db643808022cf6e080fc9d5)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:29.226750 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:29.276224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a339cc5db643808022cf6e080fc9d5', 'request_id': 'req-b06f91de-b2a4-40e6-9d80-583dab4d171e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.284515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a339cc5db643808022cf6e080fc9d5', 'request_id': 'req-b06f91de-b2a4-40e6-9d80-583dab4d171e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.291436 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a339cc5db643808022cf6e080fc9d5', 'request_id': 'req-b06f91de-b2a4-40e6-9d80-583dab4d171e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.302732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] The token cache is being invalidate because project 79a339cc5db643808022cf6e080fc9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:52:29.303020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.303744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.306622 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4199/8425] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:52:29 2022] DELETE /identity/v3/projects/79a339cc5db643808022cf6e080fc9d5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:29.311875 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:29.322107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475db842-2d12-42ed-bebc-20e365e31409 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:29.342434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:29.386611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:29.387157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.387438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.387712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] PATH_INFO: `/v3/users/6ffde37ad3364246b878de50a1fbef50` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.401463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffde37ad3364246b878de50a1fbef50)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:29.403399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:29.457596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffde37ad3364246b878de50a1fbef50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.466387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffde37ad3364246b878de50a1fbef50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.467616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffde37ad3364246b878de50a1fbef50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.474809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffde37ad3364246b878de50a1fbef50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.475477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e24df934-150c-43c4-98e2-2fbc7c56cacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffde37ad3364246b878de50a1fbef50'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.494102 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4227/8426] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:52:29 2022] DELETE /identity/v3/users/6ffde37ad3364246b878de50a1fbef50 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:29.675413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:29.677194 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:29.693666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f91de-b2a4-40e6-9d80-583dab4d171e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:29.759337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:29.759975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.760249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.760516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] PATH_INFO: `/v3/projects/0715cffedd40429f9755053f748669f2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.772410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0715cffedd40429f9755053f748669f2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:29.774392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:29.793019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:29.833394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0715cffedd40429f9755053f748669f2', 'request_id': 'req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.841202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0715cffedd40429f9755053f748669f2', 'request_id': 'req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.849141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0715cffedd40429f9755053f748669f2', 'request_id': 'req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.861086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] The token cache is being invalidate because project 0715cffedd40429f9755053f748669f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:52:29.861379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.862041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2283e5a2-b5c9-46c6-9db8-3cdab4627a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:29.863515 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4200/8427] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:52:29 2022] DELETE /identity/v3/projects/0715cffedd40429f9755053f748669f2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:29.868697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.869220 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.869312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.889970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:29.891189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:29.962554 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4228/8428] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:29.972918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:29.973314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:29.973589 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:29.993622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:29.994829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:30.003639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4201/8429] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:30.007932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.018846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172050d4-8810-46a9-a48c-5e33520817a3 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.025574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.026205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.026482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.026766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.027412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:52:30.027714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.030063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.042733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4229/8430] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:52:30.047514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.057816 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781e995-33ab-4eb0-af79-2b02005c2fa3 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.062561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.063240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.063559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.063823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.064544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.066519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.099373 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4202/8431] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:52:30.103821 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.117824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54810a33-93ae-4bb6-86e2-c085725ed602 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.131679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:30.180831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.181468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.181742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.182008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.182638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.184556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.208608 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4230/8432] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:52:30 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:52:30.214251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.226279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed5978-2df7-4a27-841d-095cd65c1c33 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.231051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.231689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.231963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.232275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.233536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.234815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.245745 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4203/8433] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:52:30.251469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.261979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc442de9-41da-4916-b829-4f4e04ee12b1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.267391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.267979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.268260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.268536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.269198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.270767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb9543-7e3b-41b3-b731-8d01fe2a57b2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.282351 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4231/8434] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:52:30.287807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.298023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bbf46-4a28-402e-bcf1-436da680b4a5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.302690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.303343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.303616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.303885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] PATH_INFO: `/v3/projects/1ea2eb8b2ec747cfa27880a6d9543559/users/27f082de59aa4dbdb994ecb7fc812f08/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.320175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea2eb8b2ec747cfa27880a6d9543559, user_id=27f082de59aa4dbdb994ecb7fc812f08, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.322906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.341553 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4204/8435] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:52:30 2022] PUT /identity/v3/projects/1ea2eb8b2ec747cfa27880a6d9543559/users/27f082de59aa4dbdb994ecb7fc812f08/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:30.346851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0592d3-001d-4713-a5cf-738865de33ce None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.347135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0592d3-001d-4713-a5cf-738865de33ce None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.347408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0592d3-001d-4713-a5cf-738865de33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.377302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ed0592d3-001d-4713-a5cf-738865de33ce None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:30.378533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed0592d3-001d-4713-a5cf-738865de33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:30.442299 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4232/8436] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:30.452242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:30.459707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:30.527618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca390e8c-d93e-4d94-ba52-574e18900a5e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:30.532920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:30.533573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:30.533843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:30.534106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:30.543742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:30.545396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:30.555288 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4205/8437] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:31.199399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.199900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.200056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.230282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] MFA Rules not processed for user `27f082de59aa4dbdb994ecb7fc812f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:31.231627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:31.303716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4233/8438] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:31.305597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.328052 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611d794-de09-4533-a82a-dd5110b91c65 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.333472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.334079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.334508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.334847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.335490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.337558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.367908 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4206/8439] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:52:31 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:52:31.370373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.381925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728a01d-02c1-4985-96b0-8e21e211855b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.406273 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:31.442224 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.442830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.443105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.443376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.444042 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.446004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.467733 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4234/8440] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:52:31 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:52:31.471732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.481957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16770fa-4b74-4cae-891f-cdfe971393bc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.487588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.488192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.488469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.488741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.489414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.491032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.502547 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4207/8441] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:52:31.507090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.517154 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6603e1-6f62-49a8-8354-7a62a0086f10 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.521812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.522461 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.522736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.523006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] PATH_INFO: `/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135/users/4b524785b4f343d9b19680244a878918/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.538058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb9c6c5750e4a08b82be9cdbc4c8135, user_id=4b524785b4f343d9b19680244a878918, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.540665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.554652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4235/8442] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:52:31 2022] PUT /identity/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135/users/4b524785b4f343d9b19680244a878918/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:31.558626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.569408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411783ff-cf8d-4e56-95fa-f06cfe91bc3a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.577827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:31.634127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.634755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.635036 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.635307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.635951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.637615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596dfec-01d1-4d01-be54-a7f0f403d3f4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.649640 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4208/8443] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:52:31.653793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:31.665810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deaae3-0275-4407-8d04-cd1f6cac044b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:31.671593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:31.672281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:31.672558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:31.672835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] PATH_INFO: `/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135/users/4b524785b4f343d9b19680244a878918/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:31.674871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb9c6c5750e4a08b82be9cdbc4c8135, user_id=4b524785b4f343d9b19680244a878918, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:31.677627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dcb76-5c74-48d9-8b55-2e0816a9817c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:31.689867 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4236/8444] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:52:31 2022] PUT /identity/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135/users/4b524785b4f343d9b19680244a878918/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:52:32.334691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:32.335231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:32.335231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:32.366922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] MFA Rules not processed for user `4b524785b4f343d9b19680244a878918`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:32.368144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:32.440451 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4209/8445] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:32.451186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:32.451816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:32.451816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:32.472379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] MFA Rules not processed for user `27f082de59aa4dbdb994ecb7fc812f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:32.473593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:32.533766 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4237/8446] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:32.546543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:32.547916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:32.625869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1685-42db-4314-ad3e-680dbed1bcdc None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:32.631599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:32.632199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:32.632471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:32.632738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:32.640717 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:32.642317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61075b18-b193-4b15-bf54-c968eb1a2ab4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:32.651193 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4210/8447] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:37.735551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:37.737018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:37.794726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300f3a7-e58a-492c-830f-7221f18695dc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:37.798321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:37.798926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:37.799196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:37.799460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:37.801198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:37.814097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:37.815560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:37.826859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4238/8448] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:42.647198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:47.820040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:52:55.321526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:55.322112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:55.322112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:55.345096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] MFA Rules not processed for user `da01928a55724b48807fa0b5f88db27f`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:52:55.346519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:55.433545 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4211/8449] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:52:55.740587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:55.751189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c63e30-25d7-42d7-9c92-81aa3c312c64 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:55.755522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:55.756402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:55.757426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:55.757713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:55.759814 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:55.776013 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:55.777714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:55.812267 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4239/8450] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:57.447730 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:57.449261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:57.490212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d2d5-c391-42c3-8d82-8d17f7f4b5e2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:57.496514 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:57.497672 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:57.498127 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:57.498526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:57.500520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:57.528593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:57.531146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:57.560568 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4212/8451] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:59.748374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:59.749894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:59.829980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:52:59.849630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afb35-96d3-4cab-9cf1-118749d23051 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:59.856022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:59.856904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:59.857651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:59.858111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:59.860646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:52:59.877628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:59.879177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:59.894958 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4240/8452] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:52:59.915377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6484ef-3b08-4276-91a4-adf5a07fc7dc service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:52:59.920625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:52:59.921293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:52:59.921660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:52:59.922119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] PATH_INFO: `/v3/users/27f082de59aa4dbdb994ecb7fc812f08` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:52:59.924337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f082de59aa4dbdb994ecb7fc812f08)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:52:59.928261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:52:59.985092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f082de59aa4dbdb994ecb7fc812f08'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:59.986275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f082de59aa4dbdb994ecb7fc812f08'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:59.993590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f082de59aa4dbdb994ecb7fc812f08'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:52:59.994517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f082de59aa4dbdb994ecb7fc812f08'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.003217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f082de59aa4dbdb994ecb7fc812f08'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.022085 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4213/8453] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:52:59 2022] DELETE /identity/v3/users/27f082de59aa4dbdb994ecb7fc812f08 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:00.208766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:00.221134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297464-ce98-4215-a8b2-b8827ffd5cf3 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:00.286169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:00.286963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:00.287323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:00.287652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] PATH_INFO: `/v3/projects/1ea2eb8b2ec747cfa27880a6d9543559` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:00.289255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea2eb8b2ec747cfa27880a6d9543559)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:00.292705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:00.346409 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea2eb8b2ec747cfa27880a6d9543559', 'request_id': 'req-08197869-6fa2-4849-8c37-f67881e93d6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.354729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea2eb8b2ec747cfa27880a6d9543559', 'request_id': 'req-08197869-6fa2-4849-8c37-f67881e93d6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.362262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea2eb8b2ec747cfa27880a6d9543559', 'request_id': 'req-08197869-6fa2-4849-8c37-f67881e93d6f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.376363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] The token cache is being invalidate because project 1ea2eb8b2ec747cfa27880a6d9543559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:53:00.376660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.377399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.378900 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4241/8454] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:53:00 2022] DELETE /identity/v3/projects/1ea2eb8b2ec747cfa27880a6d9543559 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:00.384296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:00.386430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:00.404244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4e3a0-2cff-42fb-854a-2e83d8145707 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:00.412749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:00.466616 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:00.467245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:00.467525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:00.467793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] PATH_INFO: `/v3/users/4b524785b4f343d9b19680244a878918` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:00.468906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b524785b4f343d9b19680244a878918)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:00.471076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:00.518827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b524785b4f343d9b19680244a878918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.519481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b524785b4f343d9b19680244a878918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.526510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b524785b4f343d9b19680244a878918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.527139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b524785b4f343d9b19680244a878918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.535134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3d4d09bf-272d-4a16-8c0e-a25484170ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b524785b4f343d9b19680244a878918'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.554564 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4214/8455] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:53:00 2022] DELETE /identity/v3/users/4b524785b4f343d9b19680244a878918 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:00.740198 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:00.741782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:00.756510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08197869-6fa2-4849-8c37-f67881e93d6f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:00.761515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:00.825089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:00.825680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:00.825956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:00.826229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] PATH_INFO: `/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:00.827426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb9c6c5750e4a08b82be9cdbc4c8135)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:00.830024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:00.893420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb9c6c5750e4a08b82be9cdbc4c8135', 'request_id': 'req-cb3db67e-b53e-4772-b47c-354d70dac9ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.903278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb9c6c5750e4a08b82be9cdbc4c8135', 'request_id': 'req-cb3db67e-b53e-4772-b47c-354d70dac9ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.911721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb9c6c5750e4a08b82be9cdbc4c8135', 'request_id': 'req-cb3db67e-b53e-4772-b47c-354d70dac9ce'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.926567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] The token cache is being invalidate because project 7fb9c6c5750e4a08b82be9cdbc4c8135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:53:00.926868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.927637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-cb3db67e-b53e-4772-b47c-354d70dac9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:00.933316 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4242/8456] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:53:00 2022] DELETE /identity/v3/projects/7fb9c6c5750e4a08b82be9cdbc4c8135 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:00.936207 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:00.937038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:00.937735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:00.963853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:00.965533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:01.032839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4215/8457] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:01.040645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.040929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.041233 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.061318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:01.062533 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:01.071514 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4243/8458] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:01.075759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.086533 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1e755-ae80-4e46-a943-e868884d7b42 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.091204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.091812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.092116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.092386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.093050 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 16:53:01.093356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.095462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.107276 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4216/8459] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 16:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 16:53:01.111894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.121535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4446634-52f1-4621-b3ea-dbafff4825c7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.127127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.127717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.127992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.128258 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.128880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.130793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.160237 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4244/8460] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:53:01 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:53:01.164607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.175374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d45d64-b3dd-4c61-8fe1-c235ab9497de admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.187451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:01.233984 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.234608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.235394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.235774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.236407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.238323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.260240 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4217/8461] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:53:01 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 16:53:01.264472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.275706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae396e74-80b4-4270-8977-9018a55f18ef admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.280310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.280901 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.281205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.281473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.282342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.283917 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.293802 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4245/8462] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:53:01.298531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.308510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e646a-89b7-4709-980b-902f8fa06cf2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.313175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.314381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.314742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.314913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.315648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.317174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bbc13-83ae-4890-9144-300dff158f6f admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.328148 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4218/8463] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:53:01.337978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.348930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310aace-0bc1-4c16-976a-ecabd130e508 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.353790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.354440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.354719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.354991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] PATH_INFO: `/v3/projects/f1c0cd39309c4ba7bfce299a9ee0516a/users/d1d84bc45eab4331867402556438b14e/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.370519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c0cd39309c4ba7bfce299a9ee0516a, user_id=d1d84bc45eab4331867402556438b14e, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.373443 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.387703 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4246/8464] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:53:01 2022] PUT /identity/v3/projects/f1c0cd39309c4ba7bfce299a9ee0516a/users/d1d84bc45eab4331867402556438b14e/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:01.392892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb017b-ff2f-4117-838f-45c5f6c1687d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.393193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb017b-ff2f-4117-838f-45c5f6c1687d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.393464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb017b-ff2f-4117-838f-45c5f6c1687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.412429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9dbb017b-ff2f-4117-838f-45c5f6c1687d None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:01.413655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9dbb017b-ff2f-4117-838f-45c5f6c1687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:01.475272 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4219/8465] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:01.485552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:01.487438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:01.524221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:01.548355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27307f-e7f9-4e8a-b42c-a611a1453cd3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:01.552350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:01.553010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:01.553304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:01.553574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:01.562965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:01.564955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:01.575660 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4247/8466] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:53:06.221742 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.222164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.222272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.253467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:06.254608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:06.327703 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4220/8467] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:06.334921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.365383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648237e-bd70-406b-938a-63550b3e5377 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.370097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.370973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.371255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.371525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.372161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.374131 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.405112 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4248/8468] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 16:53:06 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:53:06.409940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.423389 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f2c8c-85e8-4313-8f53-a4095b3c5e67 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.450041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:06.501265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.502428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.502859 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.503341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.504130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.508170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.534046 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4221/8469] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 16:53:06 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 16:53:06.538491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.559727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f877-507d-4a57-a27e-9f2ae8d20936 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.564857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.565609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.565894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.566180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.567365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.569893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.581117 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4249/8470] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 16:53:06.585557 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.596331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30b73f-6bcc-471a-89b0-c77b1f743c7d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.601751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.602674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.602902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.603184 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] PATH_INFO: `/v3/projects/b7ccded2fda1461ab0b35370ad69a81e/users/f8d5276253d942169de4d4f93d6e1c8f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.623911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ccded2fda1461ab0b35370ad69a81e, user_id=f8d5276253d942169de4d4f93d6e1c8f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.628640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.647181 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4222/8471] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:53:06 2022] PUT /identity/v3/projects/b7ccded2fda1461ab0b35370ad69a81e/users/f8d5276253d942169de4d4f93d6e1c8f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:53:06.651183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.665115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add645d8-3c90-42a2-b539-c65bfecd7fb1 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.742153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.742677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.743581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.743581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.743989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.746017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c056922-2a2d-496c-81e2-a4f46b93d742 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.761279 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4250/8472] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 16:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 16:53:06.763081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:06.791390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30be43-62d2-4913-aeea-6a6e7d9f08e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:06.796543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:06.797854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:06.798288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:06.798870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] PATH_INFO: `/v3/projects/b7ccded2fda1461ab0b35370ad69a81e/users/f8d5276253d942169de4d4f93d6e1c8f/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:06.801063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ccded2fda1461ab0b35370ad69a81e, user_id=f8d5276253d942169de4d4f93d6e1c8f, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:06.803982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6da2e-83b1-4265-b851-90e353cc4a35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:06.817020 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4223/8473] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 16:53:06 2022] PUT /identity/v3/projects/b7ccded2fda1461ab0b35370ad69a81e/users/f8d5276253d942169de4d4f93d6e1c8f/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:12.628500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:12.629087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:12.629367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:12.673681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] MFA Rules not processed for user `f8d5276253d942169de4d4f93d6e1c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:12.674817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:12.764736 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4251/8474] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:12.782222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:12.783039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:12.783039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:12.894555 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] MFA Rules not processed for user `5cdf82dd7b714a26a2c4f396ca0b20be`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:12.896308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:12.989829 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4224/8475] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 18 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:12.996275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:13.011319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ce8a-a3e5-4551-bd18-0693af18a94e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:13.017628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:13.018442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:13.019231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:13.019338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:13.036058 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:13.037649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614d808-1f4b-454c-95ec-14e47bca73c4 service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:13.051407 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4252/8476] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:53:13.163956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:13.173820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7e4b2-2920-4aac-9015-0597834893d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:13.177924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:13.178834 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:13.179214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:13.179585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:13.242884 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:13.244531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:13.255791 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4225/8477] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:53:14.986330 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:14.987009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:14.987373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:15.028129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:15.029756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:15.052578 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4253/8478] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:16.634306 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:16.636278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:16.642395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:16.766755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2700-3576-40da-b635-adadd9789965 service cinder] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:16.775140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:16.775964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:16.776393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:16.776972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:16.780047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:16.800905 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:16.802553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79dcbc-8008-4043-b685-240bf54c3481 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:16.819567 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4226/8479] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:53:25.016043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:25.118839 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:25.120298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:25.242904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4148ad-818f-46e0-a247-d0ea0900f5ac None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:25.248140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:25.249018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:25.249598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:25.249876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] PATH_INFO: `/v3/users/da01928a55724b48807fa0b5f88db27f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:25.252504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da01928a55724b48807fa0b5f88db27f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:25.254494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:25.309445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da01928a55724b48807fa0b5f88db27f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.317505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da01928a55724b48807fa0b5f88db27f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.318146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da01928a55724b48807fa0b5f88db27f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.325504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da01928a55724b48807fa0b5f88db27f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.326254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da01928a55724b48807fa0b5f88db27f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.345798 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4254/8480] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:53:25 2022] DELETE /identity/v3/users/da01928a55724b48807fa0b5f88db27f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 16:53:25.350080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:25.350601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:25.350601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:25.371599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:25.372784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:25.431769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4227/8481] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:25.441993 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:25.443331 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:25.501080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5f7af-67b4-46d6-a497-b5049340df33 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:25.504677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:25.505317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:25.505596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:25.505865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:25.514948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:25.517136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:25.526677 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4255/8482] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:53:25.699869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:25.701362 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:25.715124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9edbf-d4cb-4d79-b039-a20cdff8e3ad None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:25.720263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:25.720909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:25.721256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:25.721550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] PATH_INFO: `/v3/projects/a41380f5938b427c977e7b68dcb484bb` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:25.722691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41380f5938b427c977e7b68dcb484bb)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:25.724643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:25.786628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41380f5938b427c977e7b68dcb484bb', 'request_id': 'req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.793394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41380f5938b427c977e7b68dcb484bb', 'request_id': 'req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.799909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41380f5938b427c977e7b68dcb484bb', 'request_id': 'req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.810638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] The token cache is being invalidate because project a41380f5938b427c977e7b68dcb484bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:53:25.810922 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.811567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.813976 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4228/8483] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:53:25 2022] DELETE /identity/v3/projects/a41380f5938b427c977e7b68dcb484bb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:25.817991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:25.827828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b4e36-a47b-4952-a87d-1752450eefb3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:25.837441 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:25.886939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:25.887567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:25.887844 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:25.888109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] PATH_INFO: `/v3/users/b09c38851ce7406cb123db1b1fbda88c` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:25.889250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09c38851ce7406cb123db1b1fbda88c)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:25.891321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:25.940155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09c38851ce7406cb123db1b1fbda88c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.947854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09c38851ce7406cb123db1b1fbda88c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.948476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09c38851ce7406cb123db1b1fbda88c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.956743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09c38851ce7406cb123db1b1fbda88c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.957415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09c38851ce7406cb123db1b1fbda88c'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:25.975229 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4256/8484] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:53:25 2022] DELETE /identity/v3/users/b09c38851ce7406cb123db1b1fbda88c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:26.274268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:26.275821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:26.291761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c9cd5-7ead-4e4b-b65f-4f031dde8db6 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:26.305371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:26.377151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:26.377880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:26.378245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:26.378640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] PATH_INFO: `/v3/projects/cc631097c31a42299c659f3584c0a8a2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:26.379843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc631097c31a42299c659f3584c0a8a2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:26.382105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:26.441766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc631097c31a42299c659f3584c0a8a2', 'request_id': 'req-cadedc13-63a7-4b3d-b393-9aca39583246'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.450375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc631097c31a42299c659f3584c0a8a2', 'request_id': 'req-cadedc13-63a7-4b3d-b393-9aca39583246'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.457782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc631097c31a42299c659f3584c0a8a2', 'request_id': 'req-cadedc13-63a7-4b3d-b393-9aca39583246'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.468236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] The token cache is being invalidate because project cc631097c31a42299c659f3584c0a8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:53:26.468431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.469321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.470942 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4229/8485] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:53:26 2022] DELETE /identity/v3/projects/cc631097c31a42299c659f3584c0a8a2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:26.475232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:26.476682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:26.490365 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2275-d6a2-4b24-a539-877312544800 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:26.552215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:26.552865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:26.553179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:26.553455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] PATH_INFO: `/v3/users/78250baa1d64427eb6f3ccd075fc004d` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:26.554608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78250baa1d64427eb6f3ccd075fc004d)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:26.556555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:26.602347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:26.615095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78250baa1d64427eb6f3ccd075fc004d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.628582 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78250baa1d64427eb6f3ccd075fc004d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.629455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78250baa1d64427eb6f3ccd075fc004d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.638022 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78250baa1d64427eb6f3ccd075fc004d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.638889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-744bce7d-71e7-4d5e-89a6-052db9f29a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78250baa1d64427eb6f3ccd075fc004d'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.659973 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4257/8486] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 16:53:26 2022] DELETE /identity/v3/users/78250baa1d64427eb6f3ccd075fc004d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:26.840596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:26.842078 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:26.855964 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadedc13-63a7-4b3d-b393-9aca39583246 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:26.917072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:26.917707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:26.917983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:26.918253 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] PATH_INFO: `/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:26.919360 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cdbd948d3a4064bd6c04949dd3f3f2)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:26.921295 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:26.967900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:26.969424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cdbd948d3a4064bd6c04949dd3f3f2', 'request_id': 'req-b86fdbff-8209-440c-ae77-e4d9e82e557a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.977520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cdbd948d3a4064bd6c04949dd3f3f2', 'request_id': 'req-b86fdbff-8209-440c-ae77-e4d9e82e557a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.985077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cdbd948d3a4064bd6c04949dd3f3f2', 'request_id': 'req-b86fdbff-8209-440c-ae77-e4d9e82e557a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.995745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] The token cache is being invalidate because project 00cdbd948d3a4064bd6c04949dd3f3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 16:53:26.996283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.996928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 16:53:26.998522 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4230/8487] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 16:53:26 2022] DELETE /identity/v3/projects/00cdbd948d3a4064bd6c04949dd3f3f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 16:53:36.655452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:36.992744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:53:50.730777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:50.731311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:50.731311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:50.751579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:53:50.752777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:50.809789 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4258/8488] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:53:51.071772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:53:51.073195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:51.139425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fdbff-8209-440c-ae77-e4d9e82e557a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:53:51.143903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:53:51.144575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:53:51.144963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:53:51.145316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:53:51.147126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:53:51.159274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:53:51.160814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376c4b7-3a9b-42cc-a475-1708789e4149 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:53:51.171291 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4231/8489] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:54:00.803077 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=25 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:01.165140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=30 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:26.023068 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:54:26.024574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:54:26.115227 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6b752-8877-480d-bab1-b04fa6ce4842 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:54:26.121315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:54:26.122145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:54:26.122418 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:54:26.122684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:54:26.124622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:54:26.139499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:54:26.141201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:54:26.156489 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4259/8490] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:54:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:54:36.148451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=36 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:40.139344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:54:40.139910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:54:40.139910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:54:40.159419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:54:40.160622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:54:40.167711 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4232/8491] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:54:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:54:40.841829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:54:40.856192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3beb291-ec75-4fc0-996a-e6c70d77dd4d service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:54:40.861853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:54:40.862480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:54:40.862761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:54:40.863033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:54:40.864787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:54:40.877675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:54:40.879321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617433b-cf19-4dce-ad85-f331dea7b20d service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:54:40.890480 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4260/8492] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:54:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:54:50.154419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:54:50.886373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:31.555877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:55:31.557379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:55:31.577371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80777-0bc2-4538-8c00-4f439e678a7c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:55:31.584716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:55:31.585380 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:55:31.585651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:55:31.585916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:55:31.587697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:55:31.619139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:55:31.620731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4ad3-5347-408a-bc4e-4f8e94b255d5 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:55:31.635143 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4233/8493] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:55:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:55:40.134707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74498b-6c82-40a9-93f3-6b5184195940 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:55:40.135269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74498b-6c82-40a9-93f3-6b5184195940 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:55:40.135269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74498b-6c82-40a9-93f3-6b5184195940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:55:40.154908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ca74498b-6c82-40a9-93f3-6b5184195940 None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:55:40.156108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ca74498b-6c82-40a9-93f3-6b5184195940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:55:40.163964 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4261/8494] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:55:41.627258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:55:50.149969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:01.785634 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:01.786136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:01.786331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:01.840823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:01.842054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:01.912623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4234/8495] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 16:56:01.974615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833034a-3128-47c4-8598-ad8cd81f5fd1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:01.975071 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833034a-3128-47c4-8598-ad8cd81f5fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:01.975292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833034a-3128-47c4-8598-ad8cd81f5fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:02.015530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a833034a-3128-47c4-8598-ad8cd81f5fd1 None None] MFA Rules not processed for user `8f98d1b53918419bad2040f49ad08092`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:02.016881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a833034a-3128-47c4-8598-ad8cd81f5fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:02.081887 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4262/8496] 10.222.0.78 () {58 vars in 1040 bytes} [Tue Oct 18 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:02.088381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:02.101088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a66495-8338-41de-bb6f-beeff278b66b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:02.106069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:02.106669 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:02.106949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:02.107223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:02.115985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:02.117604 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:02.126344 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4235/8497] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:56:03.411583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:03.412122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:03.412122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:03.435260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:03.436492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:03.444258 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4263/8498] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:12.123007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=46 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:12.468095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:12.469925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:12.483571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839de8f-79d2-4e77-8693-559fb2d684d5 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:12.487735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:12.488636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:12.488955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:12.489171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:12.491086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:12.574160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:12.575592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:12.601442 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4236/8499] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 16:56:13.429690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=38 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:13.793541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:13.803507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4532370-f173-4a95-836d-7b4ba50b744d None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:13.807145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:13.807752 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:13.808028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:13.808301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:13.810049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:13.826262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:13.827681 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:13.841820 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4264/8500] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:56:22.597979 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=38 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:23.834424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:37.150949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:37.159900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914e37-2006-4e6b-9860-05c13a14374a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:37.165257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:37.165872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:37.166150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:37.166420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:37.168278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:37.181830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:37.183271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5558-f4ff-488e-9c87-06d35aa0fb22 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:37.194587 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4237/8501] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:56:38.402202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:38.404024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:38.432808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9d3c-3339-4ce0-bfdc-b53353192ef2 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:38.439262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:38.440000 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:38.440563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:38.440842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:38.444709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:38.470419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:38.476878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:38.504739 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4265/8502] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:56:42.928936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c8ff-c249-4415-a625-d7bf46a0db37 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:42.929466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c8ff-c249-4415-a625-d7bf46a0db37 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:42.929466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c8ff-c249-4415-a625-d7bf46a0db37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:42.959665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-18f8c8ff-c249-4415-a625-d7bf46a0db37 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:42.961189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-18f8c8ff-c249-4415-a625-d7bf46a0db37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:42.969731 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4238/8503] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Oct 18 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:42.982429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:42.997278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec774c1-5db1-4258-8756-a3b6bda4dcc8 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:43.003217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:43.004532 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:43.004903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:43.005358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:43.016016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:43.017640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b92b6-8076-44ca-8cf1-d4ba8c3ba75c service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:43.029410 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4266/8504] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:56:52.951661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:53.024580 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:56:55.377879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:55.378927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:55.378927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:55.401921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:55.403126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:55.412765 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4239/8505] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 18 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:55.426093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94af1-5f9c-4d38-8dfa-0f5c2bdda1cf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:55.426975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94af1-5f9c-4d38-8dfa-0f5c2bdda1cf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:55.427388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94af1-5f9c-4d38-8dfa-0f5c2bdda1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:55.449292 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7ac94af1-5f9c-4d38-8dfa-0f5c2bdda1cf None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:55.450756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7ac94af1-5f9c-4d38-8dfa-0f5c2bdda1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:55.459638 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4267/8506] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:55.465869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:55.476879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043076f-ae76-4616-8c6a-c6d7f101a78e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:55.482228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:55.482830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:55.483103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:55.483370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:55.493580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:55.495313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:55.506854 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4240/8507] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:56:59.032864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551697-5953-4b36-8784-30ed0fada628 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:59.033386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551697-5953-4b36-8784-30ed0fada628 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:59.033475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2551697-5953-4b36-8784-30ed0fada628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:59.053494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f2551697-5953-4b36-8784-30ed0fada628 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:56:59.054700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f2551697-5953-4b36-8784-30ed0fada628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:56:59.062127 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4268/8508] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:56:59.075020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:56:59.087728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ea19-e043-4b29-9d6d-bff855b1a10e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:56:59.092870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:56:59.093515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:56:59.093784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:56:59.094046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:56:59.102879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:56:59.104429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75265-dc00-407d-9e79-456fa53ad7f7 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:56:59.112335 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4241/8509] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 16:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 16:57:09.048099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:09.109176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=15 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:15.752761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:57:15.753349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:57:15.753446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:57:15.773003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:57:15.774228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:57:15.781309 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4269/8510] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:57:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:57:16.555428 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:57:16.555875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:57:16.555976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:57:16.576716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:57:16.577981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:57:16.587511 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4242/8511] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:57:16.593793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:57:16.605862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8c69-0f24-4399-88d2-d7c5066334d7 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:57:16.610854 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:57:16.611467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:57:16.611766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:57:16.612037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:57:16.613945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:57:16.626524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:57:16.628100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7f436-185c-4c69-b553-fedb16379681 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:57:16.638746 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4270/8512] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:57:26.571721 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:26.634490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:57:32.767893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:57:32.790094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d454b-ed46-4b6c-9d6c-c918a1486548 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:57:32.796776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:57:32.797556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:57:32.798516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:57:32.798516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:57:32.800205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:57:32.817392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:57:32.819898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:57:32.835926 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4243/8513] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:57:42.826901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:28.915741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523d0f-ca2c-4b12-86c2-721f8578495e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:28.916652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523d0f-ca2c-4b12-86c2-721f8578495e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:28.917450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44523d0f-ca2c-4b12-86c2-721f8578495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:28.970877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-44523d0f-ca2c-4b12-86c2-721f8578495e None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:28.972105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-44523d0f-ca2c-4b12-86c2-721f8578495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:29.026893 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4271/8514] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:29.033366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:29.078846 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb0c-a573-41b1-bab5-a20da356068d service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:29.084340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:29.084946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:29.085252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:29.085524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:29.087868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:29.099123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:29.100691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce15d7-be50-49ec-b223-45873313c9d4 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:29.111326 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4244/8515] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:29.316325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:29.316613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:29.316913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:29.339559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:29.340760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:29.350912 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4272/8516] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:29.357520 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f036-bb45-41a3-890e-2efc3ef610e7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:29.357800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f036-bb45-41a3-890e-2efc3ef610e7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:29.358073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843f036-bb45-41a3-890e-2efc3ef610e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:29.379287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6843f036-bb45-41a3-890e-2efc3ef610e7 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:29.380515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6843f036-bb45-41a3-890e-2efc3ef610e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:29.390356 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4245/8517] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:29.404496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:29.413867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c7db4-86e6-4071-afb1-3465277bde5b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:29.418211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:29.418808 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:29.419083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:29.419350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:29.429490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:29.431783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:29.443001 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4273/8518] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:30.641227 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead397e2-ae8c-41c9-9968-7525f4ada0ea None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:30.641772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead397e2-ae8c-41c9-9968-7525f4ada0ea None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:30.641772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead397e2-ae8c-41c9-9968-7525f4ada0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:30.661841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ead397e2-ae8c-41c9-9968-7525f4ada0ea None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:30.663035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ead397e2-ae8c-41c9-9968-7525f4ada0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:30.673228 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4246/8519] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:30.683758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:30.692380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545782-3d8b-4bfa-a70a-7b1f5010476d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:30.696124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:30.696737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:30.697534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:30.697988 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:30.708100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:30.709555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:30.721037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4274/8520] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:31.926764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4f57f-1c18-4365-a8f5-cf109b084e31 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:31.927278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4f57f-1c18-4365-a8f5-cf109b084e31 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:31.927278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4f57f-1c18-4365-a8f5-cf109b084e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:31.977451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8a4f57f-1c18-4365-a8f5-cf109b084e31 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:31.980274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8a4f57f-1c18-4365-a8f5-cf109b084e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:31.997671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4247/8521] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:32.010937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:32.022561 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33730ff-b781-4890-a0af-e6aaaa526556 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:32.030145 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:32.030784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:32.031063 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:32.031335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:32.044132 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:32.047104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:32.058986 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4275/8522] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:37.477016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efffc-e4bf-4476-86b8-aca5bf3ecc38 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:37.477519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efffc-e4bf-4476-86b8-aca5bf3ecc38 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:37.477598 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473efffc-e4bf-4476-86b8-aca5bf3ecc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:37.499712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-473efffc-e4bf-4476-86b8-aca5bf3ecc38 None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:37.500935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-473efffc-e4bf-4476-86b8-aca5bf3ecc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:37.507819 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4248/8523] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:37.852123 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:37.861938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d831b3-04f6-40f8-9014-5bf6b68f570f service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:37.865819 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:37.866450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:37.866734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:37.867009 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:37.868948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:37.882920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:37.884352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:37.896295 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4276/8524] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:40.169624 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511a78-6a43-40bd-989a-e3ffbec945fe None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:40.170179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511a78-6a43-40bd-989a-e3ffbec945fe None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:40.170179 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511a78-6a43-40bd-989a-e3ffbec945fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:40.192101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-24511a78-6a43-40bd-989a-e3ffbec945fe None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:40.193431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-24511a78-6a43-40bd-989a-e3ffbec945fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:40.201030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4249/8525] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 18 16:59:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:40.214455 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:40.223480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b986e-ea3b-4741-aef4-4a5e5491e283 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:40.227598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:40.228231 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:40.229139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:40.229583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:40.238667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:40.240146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:40.254620 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4277/8526] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:50.186341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=35 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:50.250343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=64 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 16:59:55.424670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:55.425258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:55.425258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:55.476006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:55.477246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:55.489264 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4250/8527] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:55.505573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:55.521619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8893f-7264-4a91-bfe0-e35c7dffe173 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:55.528522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:55.529157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:55.529436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:55.529702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:55.538573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:55.540134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f495-8f31-4d4c-abfc-7a31747eb945 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:55.555756 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4278/8528] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:57.586336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:57.596148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f398e5-60bd-41cc-ab76-17d4b6869065 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:57.599858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:57.600473 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:57.600745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:57.601200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:57.603361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:57.676229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:57.678766 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:57.691586 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4251/8529] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 16:59:59.362028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bb81a-d9f9-4d9d-8a11-f5145c9ad7d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:59.362542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bb81a-d9f9-4d9d-8a11-f5145c9ad7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:59.362695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bb81a-d9f9-4d9d-8a11-f5145c9ad7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:59.384628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b28bb81a-d9f9-4d9d-8a11-f5145c9ad7d5 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 16:59:59.385919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b28bb81a-d9f9-4d9d-8a11-f5145c9ad7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 16:59:59.396097 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4279/8530] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 16:59:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 16:59:59.410262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 16:59:59.424814 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6d1fd-114f-480c-8351-03012cc70520 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 16:59:59.431334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 16:59:59.432063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 16:59:59.432343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 16:59:59.432610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 16:59:59.442992 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 16:59:59.444731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720411fd-cc7f-45dd-b19a-29bafc26385a service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 16:59:59.457474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4252/8531] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 16:59:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:00:09.378415 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:00:09.452007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=47 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:38.954617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:01:38.955105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:01:38.955212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:01:38.974280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] MFA Rules not processed for user `d1d84bc45eab4331867402556438b14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:01:38.975464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:01:38.982219 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4280/8532] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:01:39.318694 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b59935-7f47-4253-9734-883b3e966c0b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:01:39.319278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b59935-7f47-4253-9734-883b3e966c0b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:01:39.319278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b59935-7f47-4253-9734-883b3e966c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:01:39.369775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-d1b59935-7f47-4253-9734-883b3e966c0b None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:01:39.371063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d1b59935-7f47-4253-9734-883b3e966c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:01:39.377753 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4253/8533] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:01:39.389956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:01:39.400163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa3316-a27e-4732-a0bc-6224526b81fa None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:01:39.403682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:01:39.404284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:01:39.404560 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:01:39.404831 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:01:39.412369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:01:39.413813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:01:39.421464 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4281/8534] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:01:42.742477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:01:42.743356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:01:42.743356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:01:42.773170 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:01:42.774538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:01:42.781386 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4254/8535] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Oct 18 17:01:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:01:42.793081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:01:42.803591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2a9ee-84af-41fc-b481-6c12b999abca service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:01:42.807697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:01:42.808312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:01:42.808591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:01:42.808864 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:01:42.819084 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:01:42.821199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:01:42.831390 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4282/8536] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:01:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:01:52.767272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=17 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:01:52.828534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=15 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:02:31.020012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:02:31.031950 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c86ca6-c253-4e1d-8523-37c673d29ec4 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:02:31.036795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:02:31.037422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:02:31.037697 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:02:31.037967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:02:31.047243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:02:31.048823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:02:31.059354 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4255/8537] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:02:38.548363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:02:38.560079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e226de-ca46-4527-8398-44b6d9ddc01d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:02:38.565222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:02:38.565810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:02:38.566083 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:02:38.566351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:02:38.574491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:02:38.576045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e63c-5216-40e4-a4a5-cf76934a21af service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:02:38.585550 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4283/8538] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:02:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:02:41.054587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:02:48.581618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:01.186132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:01.187754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:01.261308 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8feb9-cf50-4173-98d5-44b4d8ad1fa5 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:01.266138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:01.266754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:01.267026 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:01.267296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:01.269585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:01.357075 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:01.358439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:01.378067 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4256/8539] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:04:04.876638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:04.877241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:04.877241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:04.945326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:04.946828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:04.960750 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4284/8540] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:04:04.986743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:05.004684 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf79e-4569-48b6-9bfb-606e426723fc service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:05.019329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:05.019972 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:05.020245 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:05.020513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:05.030095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:05.031707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:05.044677 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4257/8541] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:08.116470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:08.118100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:08.134052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c3db-34dc-4e75-9e2b-081000dbecdf None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:08.138673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:08.139314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:08.139588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:08.139863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] PATH_INFO: `/v3/users/d1d84bc45eab4331867402556438b14e` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:08.155486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d84bc45eab4331867402556438b14e)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:08.157599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:08.208744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d84bc45eab4331867402556438b14e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.216393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d84bc45eab4331867402556438b14e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.217078 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d84bc45eab4331867402556438b14e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.225187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d84bc45eab4331867402556438b14e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.225836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d84bc45eab4331867402556438b14e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.243374 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4285/8542] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:04:08 2022] DELETE /identity/v3/users/d1d84bc45eab4331867402556438b14e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:08.429152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:08.442745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0def39-4594-4ecb-9591-de74cd65bf23 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:08.503817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:08.504440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:08.504716 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:08.504988 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] PATH_INFO: `/v3/projects/f1c0cd39309c4ba7bfce299a9ee0516a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:08.506818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=100 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:08.516630 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c0cd39309c4ba7bfce299a9ee0516a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:08.518739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:08.568098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'request_id': 'req-1e738d1b-ba48-4db6-bbf1-acfc392be28b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.575404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'request_id': 'req-1e738d1b-ba48-4db6-bbf1-acfc392be28b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.582498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c0cd39309c4ba7bfce299a9ee0516a', 'request_id': 'req-1e738d1b-ba48-4db6-bbf1-acfc392be28b'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.593098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] The token cache is being invalidate because project f1c0cd39309c4ba7bfce299a9ee0516a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:04:08.593385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.594034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.595723 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4258/8543] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:04:08 2022] DELETE /identity/v3/projects/f1c0cd39309c4ba7bfce299a9ee0516a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:08.601190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:08.602634 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:08.616306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750944b9-601d-45c6-b73c-4f7a39097ecf admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:08.673067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:08.673703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:08.673981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:08.674252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] PATH_INFO: `/v3/users/f8d5276253d942169de4d4f93d6e1c8f` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:08.687956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d5276253d942169de4d4f93d6e1c8f)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:08.689920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:08.712467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:08.738419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d5276253d942169de4d4f93d6e1c8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.745926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d5276253d942169de4d4f93d6e1c8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.746572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d5276253d942169de4d4f93d6e1c8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.754297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d5276253d942169de4d4f93d6e1c8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.754969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-47ff222e-9607-4e53-9d4b-6f609ef4e39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d5276253d942169de4d4f93d6e1c8f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:08.772551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4286/8544] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:04:08 2022] DELETE /identity/v3/users/f8d5276253d942169de4d4f93d6e1c8f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:08.952843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:08.954954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:08.970553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738d1b-ba48-4db6-bbf1-acfc392be28b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:09.032342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:09.032971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:09.033289 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:09.033560 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] PATH_INFO: `/v3/projects/b7ccded2fda1461ab0b35370ad69a81e` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:09.044827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ccded2fda1461ab0b35370ad69a81e)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:09.046855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:09.092952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ccded2fda1461ab0b35370ad69a81e', 'request_id': 'req-c0877060-3b22-44c8-8d18-ab0958d9f660'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:09.102683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ccded2fda1461ab0b35370ad69a81e', 'request_id': 'req-c0877060-3b22-44c8-8d18-ab0958d9f660'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:09.111918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ccded2fda1461ab0b35370ad69a81e', 'request_id': 'req-c0877060-3b22-44c8-8d18-ab0958d9f660'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:09.123981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] The token cache is being invalidate because project b7ccded2fda1461ab0b35370ad69a81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:04:09.124270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:09.125054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c0877060-3b22-44c8-8d18-ab0958d9f660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:09.126805 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4259/8545] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:04:08 2022] DELETE /identity/v3/projects/b7ccded2fda1461ab0b35370ad69a81e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:18.768579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:19.053665 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.054079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.054428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.103414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:19.104609 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:19.120638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:19.172975 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4287/8546] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:19.184229 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.184516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.184793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.204653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:19.206438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:19.214491 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4260/8547] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:19.219453 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.230177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54df9e-c4fc-4534-a97d-67cb109e998a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.234982 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.235430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.235709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.235980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.236661 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:04:19.236943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.238664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.250775 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4288/8548] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:04:19.265033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.274873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187f618-2ae7-41a5-bf41-49c0e8aec44c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.279655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.280252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.280527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.280796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.281467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.283375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.321653 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4261/8549] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:04:19.325926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.343151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb84-857f-478b-ba7d-9449d51fdfe9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.406446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.407098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.407410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.408048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.409454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.411377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.434215 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4289/8550] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:04:19.437729 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.448545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d24e-2c76-461b-9eb5-2427ac1b468b admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.453368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.453969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.454248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.454542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.455204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.457430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.468230 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4262/8551] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:04:19.473601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.483663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0351456-634c-4b45-9b72-e19ab361b79d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.488382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.488979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.489282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.489548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.490180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.491758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90d681-03e6-4dbd-893a-6e5bdc56ace3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.503481 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4290/8552] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:04:19.507687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.518644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d3987-985a-400e-810c-558ad5ce2ad8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.523556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.523946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.524217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.524495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] PATH_INFO: `/v3/projects/61b0c7bca57442c5a27df4586ea9c1b7/users/67e4bd35d43546fa8b05663559f01a9c/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.542572 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b0c7bca57442c5a27df4586ea9c1b7, user_id=67e4bd35d43546fa8b05663559f01a9c, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.545271 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.559492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4263/8553] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:04:19 2022] PUT /identity/v3/projects/61b0c7bca57442c5a27df4586ea9c1b7/users/67e4bd35d43546fa8b05663559f01a9c/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:19.571820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.571820 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.572431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.602564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] MFA Rules not processed for user `67e4bd35d43546fa8b05663559f01a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:19.603796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:19.636805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:19.671420 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4291/8554] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:19.676310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.743542 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2e0e-ab2b-4c33-b9cb-6dfaa7fd1ca1 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.748326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.748926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.749235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.749502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.750124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.752287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.780927 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4264/8555] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:04:19.785746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.797689 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c9a06-c061-4d9f-b022-e657599a6d07 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.855739 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.856358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.856640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.856912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.857572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.859647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.889177 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4292/8556] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:04:19 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:04:19.893822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.904186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ed51d-0c41-4968-b688-b8718c52c747 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.909823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.910419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.910692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.910959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.911590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.913190 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.924198 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4265/8557] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:04:19.929967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:19.946271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e6a6-e62a-40c7-8536-403f0526471b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:19.951121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:19.951785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:19.952059 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:19.952332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] PATH_INFO: `/v3/projects/86b3e67110a842468e7cb0b06e283c0a/users/6489a248796748aeaf0d7b220ddf0f1c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:19.969536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b3e67110a842468e7cb0b06e283c0a, user_id=6489a248796748aeaf0d7b220ddf0f1c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:19.972736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:19.985633 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4293/8558] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:04:19 2022] PUT /identity/v3/projects/86b3e67110a842468e7cb0b06e283c0a/users/6489a248796748aeaf0d7b220ddf0f1c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:19.989872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:20.001416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7903eac-0255-4f2d-b2c5-400b2142b3ac admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:20.059499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:20.060109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.060388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.060659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.061337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:20.062937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379ec9-a40b-4cf7-ae34-7e5f4e661d6b admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:20.065187 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.075192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4266/8559] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:04:20.079398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:20.090279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4d1af-4f8d-4fde-bebc-c8b5d0103173 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:20.094983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:20.095637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.095909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.096250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] PATH_INFO: `/v3/projects/86b3e67110a842468e7cb0b06e283c0a/users/6489a248796748aeaf0d7b220ddf0f1c/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.098165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b3e67110a842468e7cb0b06e283c0a, user_id=6489a248796748aeaf0d7b220ddf0f1c, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:20.100778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22b6a-2741-4d47-9945-149e24bcec28 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:20.111482 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4294/8560] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:04:20 2022] PUT /identity/v3/projects/86b3e67110a842468e7cb0b06e283c0a/users/6489a248796748aeaf0d7b220ddf0f1c/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:20.122788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.123327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.123327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.152178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] MFA Rules not processed for user `6489a248796748aeaf0d7b220ddf0f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:20.153483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:20.222869 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4267/8561] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:20.237517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.237517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.238373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.260304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] MFA Rules not processed for user `67e4bd35d43546fa8b05663559f01a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:20.261643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:20.317422 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4295/8562] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:20.331375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:20.332973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:20.434180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e964b-bc00-4f3c-9cba-1323cb4bc59d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:20.439696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:20.440810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.441117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.441393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.449303 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:20.450883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:20.460064 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4268/8563] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:20.866945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:20.868531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:20.907620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:20.953589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82928f9-b7b0-45f7-a081-1b522f602f3b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:20.959736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:20.960380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:20.960697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:20.960970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:20.962811 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:20.976700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:20.978277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:20.989800 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4296/8564] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:30.455674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=77 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:30.620260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:30.621702 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:30.683769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a831770-a62a-428a-abe9-b92bd789d124 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:30.687444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:30.688056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:30.688361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:30.688629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:30.694197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:30.710927 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:30.712284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:30.725108 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4269/8565] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:30.984300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=18 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:31.914700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:31.916003 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:31.927159 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6371d-b59e-427d-8a3e-0bcab0c657e3 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:31.930719 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:31.931317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:31.931598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:31.931863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:31.933563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:31.948165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:31.949727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed1825-fb75-444b-b7a7-a82ee05b67cc service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:31.961852 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4297/8566] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:33.278035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:33.279412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:33.292850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab520688-ea54-47c8-84e5-644212789160 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:33.298339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:33.298953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.299223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.299489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.307743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:33.309339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:33.319066 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4270/8567] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:33.335031 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc0a-ad7e-428c-827a-b834010d4ba6 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.335467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc0a-ad7e-428c-827a-b834010d4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.335564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39cc0a-ad7e-428c-827a-b834010d4ba6 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.336896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4298/8568] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 17:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 17:04:33.341622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 17:04:33.352619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:33.361019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e46fc-f992-43c4-b012-1e318148920f service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:33.366192 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6489a248796748aeaf0d7b220ddf0f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b3e67110a842468e7cb0b06e283c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:33.366801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.367076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.367366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] PATH_INFO: `/v3/projects/86b3e67110a842468e7cb0b06e283c0a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.368466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: Authorizing `identity:get_project(project_id=86b3e67110a842468e7cb0b06e283c0a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:33.370264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:33.371865 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4271/8569] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 17:04:33 2022] GET /identity/v3/projects/86b3e67110a842468e7cb0b06e283c0a => generated 393 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:04:33.680709 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7c0f-e1c2-43ac-a51e-e75557e93798 None None] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.681033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7c0f-e1c2-43ac-a51e-e75557e93798 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.681325 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7c0f-e1c2-43ac-a51e-e75557e93798 None None] PATH_INFO: `/` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.682680 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4299/8570] 10.222.0.78 () {54 vars in 912 bytes} [Tue Oct 18 17:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 17:04:33.688178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Authenticating service token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 18 17:04:33.701266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:33.710493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c18e-82b2-42ef-8bee-2a4c5408a6ce tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:33.715024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6489a248796748aeaf0d7b220ddf0f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86b3e67110a842468e7cb0b06e283c0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:33.715639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.715919 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.716195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] PATH_INFO: `/v3/projects/86b3e67110a842468e7cb0b06e283c0a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.717342 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: Authorizing `identity:get_project(project_id=86b3e67110a842468e7cb0b06e283c0a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:33.719133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:33.720748 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4272/8571] 10.222.0.78 () {58 vars in 1443 bytes} [Tue Oct 18 17:04:33 2022] GET /identity/v3/projects/86b3e67110a842468e7cb0b06e283c0a => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:04:33.870828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.871112 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.871383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.891411 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:33.892591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:33.899972 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4300/8572] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:33.912077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:33.921788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f189dd-119b-4ca2-8c8d-4c410d4d3fd6 tempest-ServersAdminNegativeTestJSON-1942844947 tempest-ServersAdminNegativeTestJSON-1942844947-project-admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:33.925866 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:33.926456 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:33.926732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:33.927000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:33.937940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:33.940009 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:33.949712 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4273/8573] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:36.293295 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:36.308554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49331fc-d771-42df-be9f-a7ba5c7448e4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:36.316586 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:36.318572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:36.319036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:36.319260 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:36.321229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:36.334147 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:36.335789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b17da6-b7d9-4154-b2b3-e08d032ff2fa service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:36.348090 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4301/8574] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:37.733205 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:37.794821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b54f9c-39a2-4217-ba85-4b783593e4e2 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:37.799238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:37.799855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:37.800228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:37.800506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] PATH_INFO: `/v3/users/67e4bd35d43546fa8b05663559f01a9c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:37.801677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e4bd35d43546fa8b05663559f01a9c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:37.803585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:37.851718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e4bd35d43546fa8b05663559f01a9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:37.852373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e4bd35d43546fa8b05663559f01a9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:37.859515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e4bd35d43546fa8b05663559f01a9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:37.860141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e4bd35d43546fa8b05663559f01a9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:37.863768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:37.868277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e4bd35d43546fa8b05663559f01a9c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:37.888480 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4274/8575] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:04:37 2022] DELETE /identity/v3/users/67e4bd35d43546fa8b05663559f01a9c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:37.892983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:37.893483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:37.893590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:37.914192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:37.915388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:37.976206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4302/8576] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:37.986096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:37.987567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:38.043940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bf547-62fe-4d67-85d0-c717c462be12 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:38.047496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:38.048089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:38.048361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:38.048627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:38.058132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:38.059547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:38.069408 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4275/8577] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:38.241146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:38.242573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:38.255382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a86c92-c27f-49c6-8e93-8e616a33a321 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:38.259969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:38.260595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:38.261018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:38.261296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] PATH_INFO: `/v3/projects/61b0c7bca57442c5a27df4586ea9c1b7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:38.262417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b0c7bca57442c5a27df4586ea9c1b7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:38.264376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:38.313585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b0c7bca57442c5a27df4586ea9c1b7', 'request_id': 'req-77ba7714-98fd-4c46-823e-de5add26da63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.320607 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b0c7bca57442c5a27df4586ea9c1b7', 'request_id': 'req-77ba7714-98fd-4c46-823e-de5add26da63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.326216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b0c7bca57442c5a27df4586ea9c1b7', 'request_id': 'req-77ba7714-98fd-4c46-823e-de5add26da63'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.339528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] The token cache is being invalidate because project 61b0c7bca57442c5a27df4586ea9c1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:04:38.339815 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.340438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.341966 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4303/8578] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:04:38 2022] DELETE /identity/v3/projects/61b0c7bca57442c5a27df4586ea9c1b7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:38.346071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:38.356479 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1cad-2a92-4acf-b1ae-b24a492528c2 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:38.414012 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:38.414666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:38.414926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:38.415223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] PATH_INFO: `/v3/users/6489a248796748aeaf0d7b220ddf0f1c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:38.416345 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6489a248796748aeaf0d7b220ddf0f1c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:38.418297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:38.465648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6489a248796748aeaf0d7b220ddf0f1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.466359 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6489a248796748aeaf0d7b220ddf0f1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.474668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6489a248796748aeaf0d7b220ddf0f1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.475310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6489a248796748aeaf0d7b220ddf0f1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.482486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-88a701af-9095-43a1-8ca8-6d8d71563067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6489a248796748aeaf0d7b220ddf0f1c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.500486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:38.506174 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4276/8579] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:04:38 2022] DELETE /identity/v3/users/6489a248796748aeaf0d7b220ddf0f1c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:38.782889 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:38.784658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:38.802806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7714-98fd-4c46-823e-de5add26da63 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:38.853170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:38.864599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:38.865862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:38.866336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:38.866684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] PATH_INFO: `/v3/projects/86b3e67110a842468e7cb0b06e283c0a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:38.868045 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b3e67110a842468e7cb0b06e283c0a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:38.870189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:38.918958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b3e67110a842468e7cb0b06e283c0a', 'request_id': 'req-48dc16a9-27a3-45a4-96c7-c8061f60e052'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.925118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b3e67110a842468e7cb0b06e283c0a', 'request_id': 'req-48dc16a9-27a3-45a4-96c7-c8061f60e052'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.931740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b3e67110a842468e7cb0b06e283c0a', 'request_id': 'req-48dc16a9-27a3-45a4-96c7-c8061f60e052'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.948627 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] The token cache is being invalidate because project 86b3e67110a842468e7cb0b06e283c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:04:38.948916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.949576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-48dc16a9-27a3-45a4-96c7-c8061f60e052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:04:38.951119 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4304/8580] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:04:38 2022] DELETE /identity/v3/projects/86b3e67110a842468e7cb0b06e283c0a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:38.957321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:38.957321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:38.957858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:38.978329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:38.979535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:39.039937 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4277/8581] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:04:39.048008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.048289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.048555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.069576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:39.070761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:39.078586 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4305/8582] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:39.083077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.092869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad05a-46fc-4d61-80ae-a823eab86e3c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.097457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.098057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.098336 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.098610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.099251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:04:39.099553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.101191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.113580 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4278/8583] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:04:39.117799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.127209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94676ba-55b3-42e7-9a4c-1403a9648c86 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.132352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.132948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.133255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.133523 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.134151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.136020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.166636 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4306/8584] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:04:39 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:04:39.168135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.178524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d5ace-24a0-4b8b-a571-acad61ef2cfc admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.234731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.235341 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.235620 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.235893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.236531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.239241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.260534 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4279/8585] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:04:39 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:04:39.264753 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.275111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afee40-d2a0-4ead-a1a5-4a039ec71a5b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.279720 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.280318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.280599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.280874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.281548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.283134 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.293713 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4307/8586] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:04:39.297864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.308425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bae9e-6e2d-4976-bdfb-0f9c417654e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.312987 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.313596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.313902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.314176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.314809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.316503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fafc4-e358-43f1-a8d9-b5e7500d4fcd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.327176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4280/8587] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:04:39.331285 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.341801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aea19-98e3-4c75-b222-40065a257343 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.346547 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.347201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.348521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.348804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] PATH_INFO: `/v3/projects/a9ad5c546e4347e8b509097ff87db145/users/5736d7229efa498ab1e3ad6676b239a9/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.364795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ad5c546e4347e8b509097ff87db145, user_id=5736d7229efa498ab1e3ad6676b239a9, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.367471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.381617 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4308/8588] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:04:39 2022] PUT /identity/v3/projects/a9ad5c546e4347e8b509097ff87db145/users/5736d7229efa498ab1e3ad6676b239a9/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:04:39.386774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd61d5-b7f4-476e-bb28-a59aa0a874fa None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.387060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd61d5-b7f4-476e-bb28-a59aa0a874fa None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.387354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd61d5-b7f4-476e-bb28-a59aa0a874fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.407105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e7dd61d5-b7f4-476e-bb28-a59aa0a874fa None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:39.408305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7dd61d5-b7f4-476e-bb28-a59aa0a874fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:39.467208 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4281/8589] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:39.477793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:39.479498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:39.537359 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95213397-2975-4f5b-80fe-66e858cb9210 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:39.541097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:39.541708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:39.542073 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:39.542349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:39.552230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:39.554117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802b223-39db-4950-8fe5-ac53e131ae78 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:39.565232 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4309/8590] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:43.658879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:43.659370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:43.659544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:43.676756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:43.693914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] MFA Rules not processed for user `5736d7229efa498ab1e3ad6676b239a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:43.695171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:43.766518 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4282/8591] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:43.778801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:43.779279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:43.779473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:43.806299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] MFA Rules not processed for user `5736d7229efa498ab1e3ad6676b239a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:43.807892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:43.821026 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4310/8592] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:43.836201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:43.837767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:43.925249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd64fd3-ca75-440b-b4cc-0b43190535b1 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:43.931701 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:43.932334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:43.932614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:43.932883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:43.942577 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:43.944493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:43.955642 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4283/8593] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:45.578237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:45.579850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:45.599894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:45.671454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8685e-b1ab-48f1-b3ef-a831fa0d1f80 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:45.676790 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:45.677546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:45.677818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:45.678085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:45.679792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:45.692116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:45.693705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e196a8-e217-467d-af62-053e9a5b9a29 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:45.703549 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4311/8594] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:47.545696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:47.560612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4d30a-bc40-4563-974e-517438827a36 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:47.568225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:47.572685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:47.573208 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:47.573602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:47.579601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:47.598636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:47.600196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:47.619852 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4284/8595] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:55.699400 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=30 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:57.568472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e633-2010-4e44-9c50-8d75339a3dd0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:57.569496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e633-2010-4e44-9c50-8d75339a3dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:57.569773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e633-2010-4e44-9c50-8d75339a3dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:57.589694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-55c2e633-2010-4e44-9c50-8d75339a3dd0 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:57.590926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-55c2e633-2010-4e44-9c50-8d75339a3dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:57.597678 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4312/8596] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:04:57.611268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:57.614143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=69 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:04:57.623379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2860b02-2f6c-4f08-b388-54f395aa81f3 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:57.627626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:57.628222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:57.629118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:57.629507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:57.637062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:57.638482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:57.647016 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4285/8597] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:04:57.726640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:57.726923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:57.727195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:57.747481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:04:57.748670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:57.758510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4313/8598] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:04:57.770276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:57.782314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcaf30-88bf-4d79-a384-2766d266c1e1 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:57.787281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:57.787864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:57.788135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:57.788398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:57.796632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:57.798218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:57.808423 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4286/8599] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:04:57.990542 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:04:57.999874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7552ea-a4b8-43ce-a4f4-87d38d49a575 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:04:58.004740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:04:58.005403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:04:58.005682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:04:58.005956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:04:58.007714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:04:58.024334 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:04:58.025792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:04:58.039360 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4314/8600] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:05:07.804356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=12 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:08.031865 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:27.069968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:27.083222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f627a3-8688-4268-9565-34730d875bb0 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:27.089144 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:27.089743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:27.090016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:27.090287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:27.092084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:27.105545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:27.107161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:27.118392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4287/8601] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:05:33.441911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:33.454213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8b8eb-4e4e-41eb-8138-d89225af9d82 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:33.459913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:33.460519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:33.460800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:33.461401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:33.463252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:33.475651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:33.477286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:33.487947 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4315/8602] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:05:37.113404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:39.906689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:39.920185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4397ea-2889-4fc4-97a0-bdc829bba5e2 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:39.924581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:39.925492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:39.925833 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:39.926174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] PATH_INFO: `/v3/users/5736d7229efa498ab1e3ad6676b239a9` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:39.927511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5736d7229efa498ab1e3ad6676b239a9)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:39.930957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:39.986369 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5736d7229efa498ab1e3ad6676b239a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:39.987035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5736d7229efa498ab1e3ad6676b239a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:39.995002 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5736d7229efa498ab1e3ad6676b239a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:39.995738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5736d7229efa498ab1e3ad6676b239a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.006030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-ef46b42e-cd0c-4d26-9122-3118e3316786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5736d7229efa498ab1e3ad6676b239a9'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.025529 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4288/8603] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:05:39 2022] DELETE /identity/v3/users/5736d7229efa498ab1e3ad6676b239a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:05:40.206049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.217877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61f247-9f54-4b35-aa65-4cabe44384f1 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.283777 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.284408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.284682 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.284951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] PATH_INFO: `/v3/projects/a9ad5c546e4347e8b509097ff87db145` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.286125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ad5c546e4347e8b509097ff87db145)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.288011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.333721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ad5c546e4347e8b509097ff87db145', 'request_id': 'req-d6dab4ae-726b-449d-af1c-3acb9161dec9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.339797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ad5c546e4347e8b509097ff87db145', 'request_id': 'req-d6dab4ae-726b-449d-af1c-3acb9161dec9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.345345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ad5c546e4347e8b509097ff87db145', 'request_id': 'req-d6dab4ae-726b-449d-af1c-3acb9161dec9'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.357049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] The token cache is being invalidate because project a9ad5c546e4347e8b509097ff87db145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:05:40.357272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.357888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-d6dab4ae-726b-449d-af1c-3acb9161dec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:05:40.359352 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4316/8604] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:05:40 2022] DELETE /identity/v3/projects/a9ad5c546e4347e8b509097ff87db145 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:05:40.364596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.364882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.365185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.386609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:05:40.387815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:40.447388 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4289/8605] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:05:40.456632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.456919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.457223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.477264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:05:40.479328 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:40.487455 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4317/8606] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:05:40.491945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.502632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804264d6-5572-40f6-9872-d79b186dd007 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.507329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.508602 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.508977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.509442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.510088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:05:40.510387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.511976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.525036 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4290/8607] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:05:40.529588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.539712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bba16-cefe-44ac-948c-8ef667f6bb11 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.544498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.545130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.545407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.545699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.546335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.548219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.578844 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4318/8608] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:05:40.583126 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.593453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e984b-6dcf-4cc3-bb6e-271992c5b7b2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.651246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.651883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.652160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.652434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.653089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.654994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.662983 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:40.680923 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4291/8609] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:05:40 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:05:40.682633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.693434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92af80d-5083-4be0-ab4a-987352cef6ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.698571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.699170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.699448 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.699717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.700361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.701981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.712261 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4319/8610] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:05:40.716301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.726260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af90b3-6e02-4629-8e98-4c9c8460a23a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.731554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.732134 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.732405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.732677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.733334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.734911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd721da-1597-4bab-8a22-c021f5f6c8aa admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.746210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4292/8611] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:05:40.750639 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.763499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c667dc-e214-488d-8737-7791789035ba admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.768393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.769206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.769485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.769783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] PATH_INFO: `/v3/projects/81547b3d503f4b5bb056399d6c353ebb/users/16cc5ee3776f44278d82caa0299cc37a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.786025 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81547b3d503f4b5bb056399d6c353ebb, user_id=16cc5ee3776f44278d82caa0299cc37a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.788651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.802037 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4320/8612] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:05:40 2022] PUT /identity/v3/projects/81547b3d503f4b5bb056399d6c353ebb/users/16cc5ee3776f44278d82caa0299cc37a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:05:40.808256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050838-6726-4aa9-8852-eeda706a8f6a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.808531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050838-6726-4aa9-8852-eeda706a8f6a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.808801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050838-6726-4aa9-8852-eeda706a8f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.827876 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fa050838-6726-4aa9-8852-eeda706a8f6a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:05:40.829111 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fa050838-6726-4aa9-8852-eeda706a8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:40.888838 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4293/8613] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:05:40.898352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:40.900111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:40.916118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:40.964684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c331-487d-4c50-8837-498597d4ff30 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:40.968350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:40.968958 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:40.969271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:40.969543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:40.978732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:40.980142 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beceb6b-2d5f-49bc-9758-44830d2dbb44 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:40.989948 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4321/8614] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:05:45.140304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:45.140862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:45.140862 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:45.183867 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] MFA Rules not processed for user `16cc5ee3776f44278d82caa0299cc37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:05:45.185507 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:45.276806 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4294/8615] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:05:45.287590 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a85348-42c2-4f4e-8e29-c4dea165b034 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:45.288473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a85348-42c2-4f4e-8e29-c4dea165b034 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:45.289444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a85348-42c2-4f4e-8e29-c4dea165b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:45.313608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e6a85348-42c2-4f4e-8e29-c4dea165b034 None None] MFA Rules not processed for user `16cc5ee3776f44278d82caa0299cc37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:05:45.314968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e6a85348-42c2-4f4e-8e29-c4dea165b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:45.322660 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4322/8616] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:05:45.334199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:05:45.335599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:05:45.432409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63af8-4a9d-45e5-93d5-35f49065944f None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:05:45.440671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:05:45.441550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:05:45.442001 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:05:45.442441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:05:45.447662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:45.452789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:05:45.454925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:05:45.468161 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4295/8617] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:05:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:05:55.307632 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=23 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:05:55.466783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:37.004085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ccad-8682-4f10-be23-fb2b07e545ba None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:06:37.005286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ccad-8682-4f10-be23-fb2b07e545ba None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:06:37.005286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ccad-8682-4f10-be23-fb2b07e545ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:06:37.027322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2be5ccad-8682-4f10-be23-fb2b07e545ba None None] MFA Rules not processed for user `16cc5ee3776f44278d82caa0299cc37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:06:37.028528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2be5ccad-8682-4f10-be23-fb2b07e545ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:06:37.035486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4323/8618] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:06:43.247714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:06:43.249149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:06:43.261185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d56ce-3859-41c0-9d27-fb9b555797df service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:06:43.265291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:06:43.265885 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:06:43.266156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:06:43.266418 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:06:43.268081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:06:43.277368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:06:43.279486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:06:43.287222 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4296/8619] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:06:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:06:47.021749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:06:53.283763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:32.101900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.102498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.102498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.126526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:32.128309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:32.172603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.197626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ec292-420e-470f-bdf4-0d5edbd50dea service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.202971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.203595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.203869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.204138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] PATH_INFO: `/v3/users/16cc5ee3776f44278d82caa0299cc37a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.205440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cc5ee3776f44278d82caa0299cc37a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.207738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.221271 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4324/8620] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:07:32.235158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.236851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:32.251645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a27f1-ae5b-4078-845d-85e9d60565c1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.258362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.258974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.259279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.259548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.269344 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cc5ee3776f44278d82caa0299cc37a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.269571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.271027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.271802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cc5ee3776f44278d82caa0299cc37a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.280674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cc5ee3776f44278d82caa0299cc37a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.281455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cc5ee3776f44278d82caa0299cc37a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.282354 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4325/8621] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:07:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:07:32.292235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-2359cc5f-ca83-4be7-b048-70630d63d217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cc5ee3776f44278d82caa0299cc37a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.314407 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4297/8622] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:07:32 2022] DELETE /identity/v3/users/16cc5ee3776f44278d82caa0299cc37a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:07:32.490571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.503697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c904400-8740-410f-8dd4-f65ad5d002cf service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.561300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.561995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.562216 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.562487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] PATH_INFO: `/v3/projects/81547b3d503f4b5bb056399d6c353ebb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.563594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81547b3d503f4b5bb056399d6c353ebb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.565546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.614487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81547b3d503f4b5bb056399d6c353ebb', 'request_id': 'req-f4a57915-d83d-4562-b5de-ce4ae28f61b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.621264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81547b3d503f4b5bb056399d6c353ebb', 'request_id': 'req-f4a57915-d83d-4562-b5de-ce4ae28f61b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.627275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81547b3d503f4b5bb056399d6c353ebb', 'request_id': 'req-f4a57915-d83d-4562-b5de-ce4ae28f61b0'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.640056 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] The token cache is being invalidate because project 81547b3d503f4b5bb056399d6c353ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:07:32.640371 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.641015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-f4a57915-d83d-4562-b5de-ce4ae28f61b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:07:32.642555 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4326/8623] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:07:32 2022] DELETE /identity/v3/projects/81547b3d503f4b5bb056399d6c353ebb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:07:32.647882 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.648158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.648423 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.670365 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:32.671610 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:32.733392 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4298/8624] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:07:32.741368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.741650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.741919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.763126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:32.764479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:32.772474 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4327/8625] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:07:32.776940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.787646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675c7f-cd71-400b-a9c4-671c0a9dd0a9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.792238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.792845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.793138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.793407 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.794642 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:07:32.795223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.796663 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.812532 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4299/8626] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:07:32.817584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.827564 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1c06d-d12e-491f-887d-0cc77eba5966 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.832199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.832802 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.833116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.833389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.834016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.835909 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.840454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:32.866674 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4328/8627] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:07:32 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:07:32.871031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.881825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85d6e-9a94-4c8d-9e65-e8335a706f69 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.943142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.943751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:32.944024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:32.944292 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:32.944915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:32.946851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:32.955564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:32.973003 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4300/8628] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:07:32 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:07:32.977311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:32.989923 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de239d-1c9d-4165-87aa-d8370092d7c7 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:32.999215 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:32.999842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:33.000118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:33.000386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:33.001070 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:33.002967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:33.015098 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4329/8629] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:07:33.020534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:33.032689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f33e0-2ff1-4421-8652-aa98201b8ace admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:33.037405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:33.038011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:33.038290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:33.038563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:33.039200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:33.040792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dab5f-ca75-4ed2-a4d5-56df1aa44fc5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:33.052791 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4301/8630] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:07:33.057212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:33.068256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b453a1b-8447-4883-98dc-82cc58668495 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:33.072916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:33.073613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:33.073896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:33.074161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] PATH_INFO: `/v3/projects/48cf8bb1719c49e597f6ca98c34e9889/users/101a08f6424e4c18a6eb2befca74cf68/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:33.090249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cf8bb1719c49e597f6ca98c34e9889, user_id=101a08f6424e4c18a6eb2befca74cf68, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:33.093921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:33.107688 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4330/8631] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:07:33 2022] PUT /identity/v3/projects/48cf8bb1719c49e597f6ca98c34e9889/users/101a08f6424e4c18a6eb2befca74cf68/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:07:33.113085 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b188-1a03-4fff-b45c-7ce23bc3313e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:33.113371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b188-1a03-4fff-b45c-7ce23bc3313e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:33.113671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b188-1a03-4fff-b45c-7ce23bc3313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:33.137332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fb34b188-1a03-4fff-b45c-7ce23bc3313e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:33.139129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb34b188-1a03-4fff-b45c-7ce23bc3313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:33.204704 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4302/8632] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:07:33.214956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:33.217272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:33.279499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3253b9-cf6a-49fa-920b-a4b2972da629 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:33.284744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:33.284930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:33.285775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:33.286060 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:33.296730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:33.298202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:33.308553 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4331/8633] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:07:37.555994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:37.556566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:37.556664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:37.589605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] MFA Rules not processed for user `101a08f6424e4c18a6eb2befca74cf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:37.590929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:37.664623 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4303/8634] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:07:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:07:37.680614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:37.682222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:37.784374 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fad6e4-c60c-41c0-92b9-3a2c0a07f1d0 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:37.790507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:37.791138 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:37.791413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:37.791683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:37.802915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:37.805707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891c466-afdd-4924-a064-afb617c47237 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:37.817202 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4332/8635] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:07:38.984896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:38.987755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:39.077674 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a920-966a-41bd-8b70-4ffe17825770 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:39.084759 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:39.086326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:39.086803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:39.087236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:39.089457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:39.110495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:39.113265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:39.119176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:39.127793 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4304/8636] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:07:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:07:39.163086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dfd8-0c29-4edf-a53e-62cf33261a22 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:39.163652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dfd8-0c29-4edf-a53e-62cf33261a22 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:39.163949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4dfd8-0c29-4edf-a53e-62cf33261a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:39.185245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d3e4dfd8-0c29-4edf-a53e-62cf33261a22 None None] MFA Rules not processed for user `101a08f6424e4c18a6eb2befca74cf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:07:39.186460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d3e4dfd8-0c29-4edf-a53e-62cf33261a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:39.193710 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4333/8637] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:07:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:07:42.567947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:07:42.579656 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcfaa9-a3bf-4a07-a74a-d6506ae13582 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:07:42.584847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:07:42.585547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:07:42.585896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:07:42.586257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:07:42.588018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:07:42.600854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:07:42.602556 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:07:42.613837 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4305/8638] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:07:49.178726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:07:52.609427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=7 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:23.331857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:09:23.332428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:09:23.332428 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:09:23.351174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] MFA Rules not processed for user `101a08f6424e4c18a6eb2befca74cf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:09:23.352362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:09:23.359136 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4334/8639] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:09:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:09:30.939132 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:09:30.941668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:09:30.982851 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8eefa-88b9-4b4c-98d1-98306455e37f service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:09:30.987083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:09:30.987679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:09:30.987955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:09:30.988223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:09:30.989940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:09:31.025802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:09:31.027258 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:09:31.039561 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4306/8640] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:09:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:09:32.218800 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:09:32.233303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87315b-97d1-4ff7-8920-303fc86701e2 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:09:32.237882 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:09:32.238484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:09:32.238757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:09:32.239024 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:09:32.240732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:09:32.255395 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:09:32.256860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:09:32.268405 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4335/8641] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:09:41.033994 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=28 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:09:42.263387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:10:50.629981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:50.639119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f863b-1423-4c66-b3e2-c1fb63bafbbe service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:50.642968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:50.642968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:50.643887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:50.643982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:50.645828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:50.656511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:50.658039 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:50.666485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4307/8642] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:10:50.757115 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:50.758521 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:50.773743 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df594f-3abe-4288-87cc-59dae17754c3 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:50.781885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:50.782505 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:50.782833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:50.783106 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:50.784862 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:50.797062 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:50.798657 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:50.809061 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4336/8643] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:10:50.987511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:50.995973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d3ba-0cef-48d5-b7be-39bcb5238ebb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:50.999517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:51.000102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:51.000373 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:51.000637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:51.002653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:51.019028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:51.020434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:51.034733 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4308/8644] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:10:51.098803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:51.110262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb982-8ac4-43a2-a2a9-25b240de2b93 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:51.115250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:51.115853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:51.116136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:51.116408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:51.118169 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:51.129840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:51.131392 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:51.141148 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4337/8645] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:10:55.039254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:55.048966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01d92-184f-4e7d-a1e9-87098a682caa service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:55.052565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:55.053186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:55.053467 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:55.053738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:55.055466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:55.065704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:55.067119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:55.075211 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4309/8646] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:10:55.578591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:10:55.582736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:55.608871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27fcf9-36d3-4dc3-b663-7c80b6288fb4 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:10:55.624057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:10:55.624699 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:10:55.624980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:10:55.625284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:10:55.627043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:10:55.640966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:10:55.642581 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f73265-cac0-4932-95e7-3da4538a165f service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:10:55.655131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4338/8647] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:11:02.274540 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:11:02.290236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332861-0c1e-45a5-9c17-969be4c692ea service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:11:02.298061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:11:02.298955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:02.299236 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:02.299511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:02.301393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:02.314769 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:11:02.316364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:11:02.328196 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4310/8648] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:11:05.650167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=18 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:08.474069 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:08.474625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:08.474625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:08.494121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] MFA Rules not processed for user `101a08f6424e4c18a6eb2befca74cf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:11:08.495244 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:08.503147 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4339/8649] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:11:08.813872 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:11:08.823112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313859e-8e3e-49bb-a9c7-98e844cc2101 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:11:08.827298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:11:08.827901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:08.828162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:08.828430 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:08.830178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:08.839270 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:11:08.841745 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:11:08.849485 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4311/8650] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:11:09.169206 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:11:09.181596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55bd7b-4632-4e6d-a33b-f14932a3601b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:11:09.188316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:11:09.188945 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:09.189254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:09.189525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:09.191286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:09.203403 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:11:09.204974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:11:09.215369 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4340/8651] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:11:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:11:12.032807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:11:12.040368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=31 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:12.048216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86d4a-eb9c-405e-b455-ba0ccde61485 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:11:12.053760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:11:12.054379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:12.054650 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:12.054916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:12.056843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:12.072102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:11:12.073723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b6c2a-5239-40ee-b9a4-e21280c809a7 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:11:12.087460 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4312/8652] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:11:19.210963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:22.082291 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:11:54.704688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:11:54.714101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2779-c3a3-4e8f-af57-0b27fe1fad1e service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:11:54.719693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:11:54.720616 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:11:54.721149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:11:54.721613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:11:54.724268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:11:54.759985 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:11:54.761809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:11:54.769710 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4341/8653] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:12:04.766168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:32.442374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:12:32.442880 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:12:32.442985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:12:32.507855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:12:32.508975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:12:32.518658 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4313/8654] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:12:32.529282 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:12:32.537918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43f0d-3e4d-4cc9-9b28-d493ddf3afe4 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:12:32.542264 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:12:32.542869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:12:32.543148 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:12:32.543424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:12:32.553494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:12:32.554900 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:12:32.565778 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4342/8655] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:12:38.055986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:12:38.067817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c496192-08b2-4d65-9f9d-173c001744d0 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:12:38.073457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:12:38.074051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:12:38.074326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:12:38.074592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:12:38.082349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:12:38.083914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:12:38.092876 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4314/8656] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:12:42.561017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:47.051740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:12:47.064262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7fc18-f0d6-4c15-b4de-3f79dda78f96 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:12:47.069717 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:12:47.070761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:12:47.071279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:12:47.071863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:12:47.082197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:12:47.083793 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e3ae-0867-45d1-9974-9e1f057f3741 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:12:47.093896 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4343/8657] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:12:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:12:48.089189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=23 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:48.509108 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:12:48.522143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67f969-39e9-4b2d-8c18-8f558f89f157 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:12:48.527877 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:12:48.528478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:12:48.528755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:12:48.529053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:12:48.538272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:12:48.539852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:12:48.551176 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4315/8658] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:12:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:12:57.089747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:12:58.546791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:04.611840 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:13:04.612356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:13:04.612446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:13:04.632598 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] MFA Rules not processed for user `101a08f6424e4c18a6eb2befca74cf68`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:13:04.633969 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:13:04.643797 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4344/8659] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:13:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:13:05.287622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:13:05.299041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2ef6c-6379-4193-be93-cf10d8342626 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:13:05.302689 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:13:05.303283 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:13:05.303559 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:13:05.303845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:13:05.305527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:13:05.315757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:13:05.317199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9604-64ab-4139-b693-5313c00e8d06 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:13:05.325837 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4316/8660] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:13:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:13:14.626965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:13:15.321488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:33.389676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:14:33.408679 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2a3bb-2cad-40b3-b167-1e7b425eedad None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:14:33.412207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:14:33.412813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:14:33.413125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:14:33.413397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:14:33.433192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:14:33.433192 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:14:33.444257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4345/8661] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:14:33.642007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:14:33.642427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:14:33.642530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:14:33.691561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] MFA Rules not processed for user `5cdf82dd7b714a26a2c4f396ca0b20be`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:14:33.692749 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:14:33.753840 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4317/8662] 10.222.0.78 () {58 vars in 1060 bytes} [Tue Oct 18 17:14:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:14:33.759714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:14:33.769668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2868a-08b4-42a2-a04a-e76785f425f9 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:14:33.773675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:14:33.774265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:14:33.774539 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:14:33.774807 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:14:33.785515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:14:33.786924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:14:33.797917 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4346/8663] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:14:43.750760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=38 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:14:43.792799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=19 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:01.092318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:01.102397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12936334-9826-41a7-a98a-e68e3d843b8e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:01.105985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:01.106592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:01.106871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:01.107149 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:01.116055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:01.117605 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:01.145833 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4318/8664] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:04.389871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:04.415234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee4121-d6ad-4d44-a27b-147a594385cb service cinder] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:04.420828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:04.421723 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:04.421999 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:04.422267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:04.424758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:04.453410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:04.457866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:04.459526 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:04.467232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c1ba-b046-40db-af63-dea8cf3c200c service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:04.472614 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4347/8665] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:04.475148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:04.478065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:04.478649 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:04.479183 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] PATH_INFO: `/v3/users/101a08f6424e4c18a6eb2befca74cf68` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:04.480633 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] RBAC: Authorizing `identity:delete_user(user_id=101a08f6424e4c18a6eb2befca74cf68)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:04.482842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:04.537597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101a08f6424e4c18a6eb2befca74cf68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.538244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101a08f6424e4c18a6eb2befca74cf68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.546809 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101a08f6424e4c18a6eb2befca74cf68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.547488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101a08f6424e4c18a6eb2befca74cf68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.556284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ab948ff-c99f-439d-b425-357e5a67584a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101a08f6424e4c18a6eb2befca74cf68'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.575957 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4319/8666] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:16:04 2022] DELETE /identity/v3/users/101a08f6424e4c18a6eb2befca74cf68 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:04.754534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:04.768691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14090a55-6e76-45ab-bb4f-ef972545e39a service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:04.828903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:04.829562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:04.829836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:04.830101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] PATH_INFO: `/v3/projects/48cf8bb1719c49e597f6ca98c34e9889` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:04.831201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cf8bb1719c49e597f6ca98c34e9889)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:04.833099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:04.887670 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cf8bb1719c49e597f6ca98c34e9889', 'request_id': 'req-40eebe22-04ab-4ff0-99de-5fe089283e4e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.893690 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cf8bb1719c49e597f6ca98c34e9889', 'request_id': 'req-40eebe22-04ab-4ff0-99de-5fe089283e4e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.899734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cf8bb1719c49e597f6ca98c34e9889', 'request_id': 'req-40eebe22-04ab-4ff0-99de-5fe089283e4e'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.924873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] The token cache is being invalidate because project 48cf8bb1719c49e597f6ca98c34e9889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:16:04.925189 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.925809 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-40eebe22-04ab-4ff0-99de-5fe089283e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:04.927287 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4348/8667] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:16:04 2022] DELETE /identity/v3/projects/48cf8bb1719c49e597f6ca98c34e9889 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:04.932320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:04.932707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:04.933080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:04.982510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:04.983722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:05.042783 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4320/8668] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:05.050801 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.051081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.051887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.072338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:05.073563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:05.081458 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4349/8669] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:05.085627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.095300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b130-a2e2-487a-9a13-654af35b3e14 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.099977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.100568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.100842 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.101644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.102275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:16:05.102570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.104169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.115783 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4321/8670] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:16:05.120579 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.130165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e043c7d-849f-4885-9596-2db619cbe981 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.134991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.135583 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.135859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.136126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.136754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.138664 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.176052 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4350/8671] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:16:05 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:16:05.181017 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.191035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aaaa3-aa66-4721-8f03-8f7c1980e290 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.195887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:05.249305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.249899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.250175 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.250441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.251049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.252942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.278190 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4322/8672] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:16:05 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:16:05.279347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.290741 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f75c0-558d-4d72-94bd-f94593a5e635 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.296536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.297126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.297406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.297674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.298319 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.299897 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.302130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:05.312217 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4351/8673] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:16:05.316250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.326546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5817f1-88af-43c3-b5fc-a72f94683634 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.331276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.331875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.332151 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.332422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.333162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.334815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93076a1-1cb6-4641-91d3-053765f05894 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.347184 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4323/8674] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:16:05.351922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.362270 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fd7e-f025-4e13-89e7-6cd873af2c6e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.367228 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.367956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.368234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.368506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] PATH_INFO: `/v3/projects/55d328634e984b4ca6449d6c1f63f2d1/users/a2567dc42e4c4e949168bc42f88531ef/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.383849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d328634e984b4ca6449d6c1f63f2d1, user_id=a2567dc42e4c4e949168bc42f88531ef, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.386511 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.399698 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4352/8675] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:16:05 2022] PUT /identity/v3/projects/55d328634e984b4ca6449d6c1f63f2d1/users/a2567dc42e4c4e949168bc42f88531ef/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:05.404832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f62a-9d85-49ef-b7a1-f608dd9e018a None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.405162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f62a-9d85-49ef-b7a1-f608dd9e018a None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.405434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36f62a-9d85-49ef-b7a1-f608dd9e018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.424738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0d36f62a-9d85-49ef-b7a1-f608dd9e018a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:05.426049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0d36f62a-9d85-49ef-b7a1-f608dd9e018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:05.487715 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4324/8676] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:05.498120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:05.500018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:05.561207 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7267-c08c-49cc-8890-4205ac89d2fd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:05.564903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:05.565543 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:05.565816 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:05.566111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:05.576120 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:05.577596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb6149-8bd0-4b1c-a1d0-2cb243ade640 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:05.587706 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4353/8677] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:09.483961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:09.484461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:09.484554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:09.517776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] MFA Rules not processed for user `a2567dc42e4c4e949168bc42f88531ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:09.519008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:09.614694 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4325/8678] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:09.628805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:09.629391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:09.629501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:09.652245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] MFA Rules not processed for user `a2567dc42e4c4e949168bc42f88531ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:09.653596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:09.661134 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4354/8679] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:09.673700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:09.675094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:09.701382 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:09.799997 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb197d-c96a-4eb1-8f01-f7382976a2f9 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:09.806977 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:09.807224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:09.807334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:09.807567 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:09.816840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:09.818169 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:09.834752 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4326/8680] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:10.128105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:10.129851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:10.149466 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d82f-9abc-4ed8-bb2c-be632abc4a32 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:10.153654 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:10.154406 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:10.154684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:10.154949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:10.156734 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:10.167434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:10.171702 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:10.182346 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4355/8681] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:10.551747 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:10.553191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:10.642951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b721d29-505f-42c9-8819-d9bf629c3f05 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:10.649072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:10.649683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:10.649958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:10.650223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:10.651930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:10.664785 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:10.666419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:10.677965 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4327/8682] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:12.659290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:12.671574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d71f-d504-4fdf-8557-512d562da192 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:12.675524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:12.676678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:12.676678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:12.676913 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:12.684479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:12.696107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:12.697620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:12.708446 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4356/8683] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:13.501865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:13.527651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf9e66-9f84-4d51-afb2-de79575ed056 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:13.534847 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:13.535468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:13.536120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:13.536954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:13.539411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:13.553463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:13.555709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fab6c-95dc-4359-9d3e-e7e58bae173b service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:13.578557 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4328/8684] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:19.627817 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:19.643054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435aa51-3d13-47b5-81d6-9314e691e124 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:19.648566 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:19.649202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:19.649486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:19.649758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:19.652506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:19.664685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:19.666425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:19.677652 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4357/8685] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:22.514377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:22.514887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:22.515010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:22.534595 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] MFA Rules not processed for user `a2567dc42e4c4e949168bc42f88531ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:22.535822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:22.543384 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4329/8686] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:23.119156 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:23.136035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69432277-7fd0-4524-9073-548370b8e3de service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:23.141480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:23.142088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:23.142366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:23.142636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:23.144368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:23.156447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:23.158041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:23.168650 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4358/8687] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:25.990708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:26.005481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac36ed-8990-41ca-afbd-d78187da44da None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:26.011100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:26.011705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:26.012201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:26.012361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:26.014174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:26.026710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:26.029054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:26.040279 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4330/8688] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:16:33.164226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:36.035500 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:45.647276 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:45.662100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f4229-171b-4be6-8c09-6feeaf8956b5 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:45.664718 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:45.665422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:45.665649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:45.665916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] PATH_INFO: `/v3/users/a2567dc42e4c4e949168bc42f88531ef` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:45.667130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2567dc42e4c4e949168bc42f88531ef)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:45.668916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:45.719373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2567dc42e4c4e949168bc42f88531ef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:45.726876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2567dc42e4c4e949168bc42f88531ef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:45.727515 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2567dc42e4c4e949168bc42f88531ef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:45.734937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2567dc42e4c4e949168bc42f88531ef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:45.735640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-e8f4e37c-0d45-494c-afb1-62b4c53ec5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2567dc42e4c4e949168bc42f88531ef'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:45.753231 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4359/8689] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:16:45 2022] DELETE /identity/v3/users/a2567dc42e4c4e949168bc42f88531ef => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:45.927180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:45.939321 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cffcc-d2a2-4b56-8b1a-e4394cdbf3fd service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:45.995822 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:45.996441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:45.996715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:45.996982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] PATH_INFO: `/v3/projects/55d328634e984b4ca6449d6c1f63f2d1` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:45.998118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d328634e984b4ca6449d6c1f63f2d1)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.000711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.047328 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d328634e984b4ca6449d6c1f63f2d1', 'request_id': 'req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:46.054574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d328634e984b4ca6449d6c1f63f2d1', 'request_id': 'req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:46.061394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d328634e984b4ca6449d6c1f63f2d1', 'request_id': 'req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:46.071801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] The token cache is being invalidate because project 55d328634e984b4ca6449d6c1f63f2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:16:46.072086 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:46.072718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-48ae3aa4-6d7f-495a-8edc-31dcdbf31664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:46.074246 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4331/8690] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:16:45 2022] DELETE /identity/v3/projects/55d328634e984b4ca6449d6c1f63f2d1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:16:46.079373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.079653 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.079921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.099730 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:46.100920 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:46.160546 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4360/8691] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:46.169051 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.169455 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.169675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.190067 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:46.191276 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:46.199119 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4332/8692] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:46.203508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.213397 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5dcb0-b515-47a3-8363-562941d1de72 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.218548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.219149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.219423 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.219688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.220356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:16:46.220651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.222269 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.234391 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4361/8693] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:16:46.238755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.248069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e21a2-4530-4a7d-af7d-ecef1eeb7d42 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.253239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.254082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.254358 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.254628 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.255256 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.257164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.285655 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4333/8694] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:16:46 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:16:46.290027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.300577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72df9f-aba3-4f97-a10f-d8732000a59d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.356247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.356855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.357181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.357483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.358767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.360676 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.368642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:46.386368 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4362/8695] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:16:46 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:16:46.387870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.398347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf26868-d809-4343-a272-75dfe537e5e9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.402951 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.403550 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.403827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.404094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.405331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.406946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.416769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4334/8696] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:16:46.421402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.431605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafec8a-ad33-4141-a413-ea196bfb181d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.436558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.437186 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.437498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.437763 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.438401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.439986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03aa599-1a3c-4814-a35a-dcc10e0cf661 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.450203 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4363/8697] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:16:46.454953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.465057 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41f683-2f2a-4e9a-99a4-357ed4a8bd06 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.470386 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.471032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.471310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.471580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] PATH_INFO: `/v3/projects/706732c4e4fb45999d788f91ab4b9662/users/280ced85406f456681aef6147cb40a50/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.486158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706732c4e4fb45999d788f91ab4b9662, user_id=280ced85406f456681aef6147cb40a50, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.488807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.501541 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4335/8698] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:16:46 2022] PUT /identity/v3/projects/706732c4e4fb45999d788f91ab4b9662/users/280ced85406f456681aef6147cb40a50/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:46.511873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.512157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.512427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.541978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] MFA Rules not processed for user `280ced85406f456681aef6147cb40a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:46.543167 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:46.608855 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4364/8699] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:46.619130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:46.620830 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:46.651643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:46.679845 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a1ae-06c2-435f-a4d6-44af21bc3c35 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:46.683487 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:46.684101 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:46.684368 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:46.684639 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:46.693156 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:46.694580 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:46.703996 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4336/8700] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:52.185219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:52.187288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:52.286789 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a9854-1993-4d7f-b763-12508c416b33 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:52.292729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:52.293436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:52.293716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:52.294843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:52.297213 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:52.310927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:52.312939 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00771f2-9a38-4ecb-9a17-93d25fc3a877 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:52.323290 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4365/8701] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:16:56.699377 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=14 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:57.353280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:57.420614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a91c88-8ee9-4dd8-9b29-2d47a63a346e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:57.425531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:57.426166 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:57.426442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:57.426710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] PATH_INFO: `/v3/users/280ced85406f456681aef6147cb40a50` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:57.427837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280ced85406f456681aef6147cb40a50)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:57.429795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:57.477419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280ced85406f456681aef6147cb40a50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.478007 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280ced85406f456681aef6147cb40a50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.485760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280ced85406f456681aef6147cb40a50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.486417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280ced85406f456681aef6147cb40a50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.493178 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280ced85406f456681aef6147cb40a50'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.510394 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4337/8702] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:16:57 2022] DELETE /identity/v3/users/280ced85406f456681aef6147cb40a50 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:57.515111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:57.515546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:57.515673 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:57.536272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:57.537510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:57.590055 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:57.601318 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4366/8703] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:16:57.612022 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:57.613511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:57.676361 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57d52-c88f-4407-a2de-639632b7a5a0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:57.680035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:57.680643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:57.680918 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:57.681204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:57.692441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:57.693911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fcf4e-943d-4880-bca8-d51ad5a9be00 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:57.704892 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4338/8704] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:16:57.877966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:57.879642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:57.891700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd1383-0d6f-46df-972d-59219baa93c8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:57.896304 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:57.896943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:57.897249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:57.897520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] PATH_INFO: `/v3/projects/706732c4e4fb45999d788f91ab4b9662` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:57.898633 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706732c4e4fb45999d788f91ab4b9662)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:57.900524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:57.952356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706732c4e4fb45999d788f91ab4b9662', 'request_id': 'req-252f2707-82e5-410c-898c-62fb684748c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.958649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706732c4e4fb45999d788f91ab4b9662', 'request_id': 'req-252f2707-82e5-410c-898c-62fb684748c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.964926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706732c4e4fb45999d788f91ab4b9662', 'request_id': 'req-252f2707-82e5-410c-898c-62fb684748c8'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.977506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] The token cache is being invalidate because project 706732c4e4fb45999d788f91ab4b9662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:16:57.977797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.978414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-252f2707-82e5-410c-898c-62fb684748c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:16:57.979901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4367/8705] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:16:57 2022] DELETE /identity/v3/projects/706732c4e4fb45999d788f91ab4b9662 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:57.985843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:57.986128 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:57.986395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.007081 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:58.008280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:58.024909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:16:58.069768 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4339/8706] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:58.077401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.077683 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.077951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.097955 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:58.099143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:58.107062 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4368/8707] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:58.111838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.121465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76cdad-b2ac-46c2-a630-057d98b82e80 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.126279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.126873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.127146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.127414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.128054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:16:58.128608 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.130244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.141781 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4340/8708] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:16:58.145948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.155693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ee16-ea69-4103-9595-b5047b8ff26b None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.160266 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.160851 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.161164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.161431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.162053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.163927 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.191227 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4369/8709] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:16:58 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:16:58.195370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.205445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3806e-e7d8-488a-91f3-dbb8ad2a13d8 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.263181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.264431 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.264774 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.265080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.265767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.267682 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.289289 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4341/8710] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:16:58 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:16:58.293421 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.303850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99fe30-d911-4657-b696-7519e51dc843 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.308485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.309105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.309380 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.309646 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.310797 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.312727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.322998 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4370/8711] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:16:58.327395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.337704 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59165c7-d881-4723-838c-60c10fcb1dd5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.342510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.343109 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.343410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.343662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.344298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.345930 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b67e51-3826-478f-b7ec-5717cbabf3c0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.356651 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4342/8712] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:16:58.360812 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.370856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5ddf-107c-44f6-b836-5f94638ad9cd admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.376508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.377190 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.377471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.377746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] PATH_INFO: `/v3/projects/b4eb7947ca854066a13256e4b9ee28d7/users/18544d02e7b742fe85052096f8af0cea/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.394211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eb7947ca854066a13256e4b9ee28d7, user_id=18544d02e7b742fe85052096f8af0cea, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.396860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.410837 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4371/8713] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:16:58 2022] PUT /identity/v3/projects/b4eb7947ca854066a13256e4b9ee28d7/users/18544d02e7b742fe85052096f8af0cea/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:16:58.421644 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.421935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.422235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.450907 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] MFA Rules not processed for user `18544d02e7b742fe85052096f8af0cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:16:58.452150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:58.518941 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4343/8714] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:16:58.528705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:16:58.530440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:16:58.591597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e30-26d1-4f1e-806a-040748b2ae4a admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:16:58.595268 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:16:58.595873 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:16:58.596152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:16:58.596422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:16:58.604779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:16:58.606275 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab529da-e373-45b8-90b4-5c34ecc2bc3e service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:16:58.615628 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4372/8715] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:03.152425 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:03.172411 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:03.217894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb07c7-f4e3-4c9d-a949-5eee10294f76 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:03.222562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:03.223196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.223453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.223718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] PATH_INFO: `/v3/users/18544d02e7b742fe85052096f8af0cea` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.224823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18544d02e7b742fe85052096f8af0cea)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:03.226755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:03.272714 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18544d02e7b742fe85052096f8af0cea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.273399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18544d02e7b742fe85052096f8af0cea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.281532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18544d02e7b742fe85052096f8af0cea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.282176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18544d02e7b742fe85052096f8af0cea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.289600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18544d02e7b742fe85052096f8af0cea'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.306958 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4344/8716] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:17:03 2022] DELETE /identity/v3/users/18544d02e7b742fe85052096f8af0cea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:17:03.312133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.312674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.312674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.332135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:03.333394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:03.346297 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:03.395490 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4373/8717] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:17:03.405217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:03.406675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:03.463899 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04c63-e36c-4963-af6d-3ed48a1938cd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:03.467677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:03.468460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.468680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.468949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.478692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:03.480159 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74b6f-ecdb-49e0-9a9f-10e71eb63439 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:03.489621 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4345/8718] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:03.668445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:03.670494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:03.682577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108c31d-6cd4-46ed-871d-8d2e105c138e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:03.693877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:03.694281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.694629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.695342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] PATH_INFO: `/v3/projects/b4eb7947ca854066a13256e4b9ee28d7` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.696110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4eb7947ca854066a13256e4b9ee28d7)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:03.698201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:03.750316 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4eb7947ca854066a13256e4b9ee28d7', 'request_id': 'req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.756842 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4eb7947ca854066a13256e4b9ee28d7', 'request_id': 'req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.762562 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4eb7947ca854066a13256e4b9ee28d7', 'request_id': 'req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.774973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] The token cache is being invalidate because project b4eb7947ca854066a13256e4b9ee28d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:17:03.775255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.775880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-38614ac1-e4ac-42be-b9d5-0ec3dddfa68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:17:03.777478 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4374/8719] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:17:03 2022] DELETE /identity/v3/projects/b4eb7947ca854066a13256e4b9ee28d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:17:03.782394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.782671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.782938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.802578 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:03.803761 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:03.836941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:03.863720 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4346/8720] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:17:03.872383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.872747 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.873666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.893504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:03.894693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:03.902426 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4375/8721] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:17:03.906765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:03.916443 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94add-2e5d-4bb8-be01-4786e9923bc2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:03.921611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:03.922202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.922474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.922740 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.923371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:17:03.923667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:03.925379 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:03.939893 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4347/8722] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:17:03.943975 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:03.953863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fb721-0639-4c6d-8aa7-df437868f55a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:03.958737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:03.959355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:03.959619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:03.959887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:03.960512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:03.962449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:03.995486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4376/8723] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:17:03 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:17:04.000213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:04.011071 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072599e-180a-46a2-a539-b1c7e9c22963 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:04.068354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:04.068946 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.069254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.069521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.070152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:04.072045 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:04.096648 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4348/8724] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:17:03 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:17:04.097857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:04.109575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1bce9-75c6-4891-949e-8f68c4661ca9 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:04.114249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:04.114849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.115126 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.115398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.116040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:04.117672 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:04.128069 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4377/8725] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:17:04.132356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:04.142764 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3ab9d-23d3-47df-83dc-2abb0e7c5b99 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:04.147349 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:04.147939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.148216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.148485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.149160 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:04.150738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa58d54-1142-4a63-99df-b644d6c58b4d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:04.162017 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4349/8726] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:17:04.166116 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:04.176867 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95944c59-d454-4595-8b28-400509f5d186 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:04.181427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:04.182067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.182353 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.182599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] PATH_INFO: `/v3/projects/c00ba8b4694a4dd3be03cc8409e130bb/users/87a4596d671f4015b7c79f313330055a/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.196919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00ba8b4694a4dd3be03cc8409e130bb, user_id=87a4596d671f4015b7c79f313330055a, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:04.199591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:04.213206 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4378/8727] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:17:04 2022] PUT /identity/v3/projects/c00ba8b4694a4dd3be03cc8409e130bb/users/87a4596d671f4015b7c79f313330055a/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:17:04.218914 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82abbb-1d41-44a8-88bb-e92863e95223 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.219248 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82abbb-1d41-44a8-88bb-e92863e95223 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.219526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82abbb-1d41-44a8-88bb-e92863e95223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.239626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ba82abbb-1d41-44a8-88bb-e92863e95223 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:04.240829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ba82abbb-1d41-44a8-88bb-e92863e95223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:04.299909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4350/8728] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:17:04.309492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:04.311280 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:04.353845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:04.368643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d98ad-1dd0-46ba-b447-d5bf048999f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:04.372225 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:04.372874 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:04.373187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:04.373457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:04.382732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:04.384158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:04.394203 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4379/8729] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:08.577043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:08.577635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:08.577751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:08.615903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] MFA Rules not processed for user `87a4596d671f4015b7c79f313330055a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:08.617116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:08.653468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:08.688691 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4351/8730] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:17:08.693419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:08.704457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bef45f-3347-4437-b70c-5c64dc55552d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:08.709205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:08.709822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:08.710127 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:08.710436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:08.711080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:08.712978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:08.760847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4380/8731] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:17:08 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:17:08.765904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:08.778113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db03e37-dcc5-4928-aa4e-4fca5818dc41 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:08.842962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:08.843587 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:08.843896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:08.844168 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:08.844802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:08.846798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:08.873910 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4352/8732] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:17:08 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:17:08.878196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:08.890341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f749-6d7f-4a9a-8902-c725907fcbed admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:08.895223 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:08.895928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:08.896288 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:08.896559 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:08.897758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:08.898846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:08.914309 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4381/8733] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:17:08.915404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:08.926393 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff244-1b5b-43d0-be01-c60fb9499dce admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:08.936777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:08.937502 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:08.937783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:08.938062 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] PATH_INFO: `/v3/projects/d2775b8d2cfc44b78e388d42ff24663a/users/a4597650204d4c5a8af34e850cbf2424/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:08.957142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2775b8d2cfc44b78e388d42ff24663a, user_id=a4597650204d4c5a8af34e850cbf2424, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:08.960000 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:08.975073 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4353/8734] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:17:08 2022] PUT /identity/v3/projects/d2775b8d2cfc44b78e388d42ff24663a/users/a4597650204d4c5a8af34e850cbf2424/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:17:08.979080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:08.990644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbe401-9110-46e8-9226-4731bd37611e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:09.053333 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:09.053965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:09.054245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:09.054518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:09.055170 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:09.056787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b77d6d-81d1-4642-8c7e-5ccbe6078510 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:09.067429 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4382/8735] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:17:09.071638 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:09.083129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344405-1e28-4cb4-969a-6b742b5db3a9 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:09.087828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:09.088492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:09.088770 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:09.089073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] PATH_INFO: `/v3/projects/d2775b8d2cfc44b78e388d42ff24663a/users/a4597650204d4c5a8af34e850cbf2424/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:09.091010 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2775b8d2cfc44b78e388d42ff24663a, user_id=a4597650204d4c5a8af34e850cbf2424, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:09.094296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:09.105592 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4354/8736] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:17:09 2022] PUT /identity/v3/projects/d2775b8d2cfc44b78e388d42ff24663a/users/a4597650204d4c5a8af34e850cbf2424/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:17:13.465520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a282-c24b-4764-a30d-78c95b117a5a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:13.465991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a282-c24b-4764-a30d-78c95b117a5a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:13.466482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0a282-c24b-4764-a30d-78c95b117a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:13.495824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a7b0a282-c24b-4764-a30d-78c95b117a5a None None] MFA Rules not processed for user `a4597650204d4c5a8af34e850cbf2424`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:13.497158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a7b0a282-c24b-4764-a30d-78c95b117a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:13.577778 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4383/8737] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:17:13.596632 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:13.600788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:13.681307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f55c9-e584-4618-9064-a40958ffde39 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:13.686712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:13.687346 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:13.687619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:13.687886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:13.713072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:13.746844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:13.748804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:13.758637 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4355/8738] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:13.834870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:13.837150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:13.837503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:13.861522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] MFA Rules not processed for user `87a4596d671f4015b7c79f313330055a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:13.862804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:13.870601 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4384/8739] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:17:23.754080 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=16 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:23.855638 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:24.599909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:24.601320 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:24.658397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7155-788b-43de-89fd-a53e61b4245e service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:24.662003 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cdf82dd7b714a26a2c4f396ca0b20be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:24.662619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:24.662936 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:24.663212 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:24.673400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:24.674820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334734bc-a620-4b91-b17f-fd9e8e17bdaa service cinder] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:24.684194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4356/8740] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:34.680098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=26 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:17:49.031445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:49.032893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:49.102857 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04add-f3c6-44f4-8e1c-384365eaee6a None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:49.108171 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:49.108779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:49.109150 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:49.109420 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:49.111135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:49.123446 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:49.125044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:49.135927 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4385/8741] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:49.972326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ec76-60bd-46b9-ae6b-deba372bb20b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:49.972854 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ec76-60bd-46b9-ae6b-deba372bb20b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:49.973092 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ec76-60bd-46b9-ae6b-deba372bb20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:49.991948 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-90e2ec76-60bd-46b9-ae6b-deba372bb20b None None] MFA Rules not processed for user `87a4596d671f4015b7c79f313330055a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:17:49.993196 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-90e2ec76-60bd-46b9-ae6b-deba372bb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:50.000968 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4357/8742] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:17:51.965196 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:17:51.966650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:51.980004 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a526b-84e6-4893-8e21-49ade60f3093 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:17:51.985886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:17:51.986496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:17:51.986773 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:17:51.987044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:17:51.988736 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:17:52.001781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:17:52.003373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:17:52.014558 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4386/8743] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:17:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:17:59.986549 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:02.009388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=38 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:25.495485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:18:25.496033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:18:25.496033 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:18:25.516305 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] MFA Rules not processed for user `87a4596d671f4015b7c79f313330055a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:18:25.517562 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:18:25.525011 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4358/8744] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:18:25.787076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:18:25.788471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:18:25.844179 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030066a-860f-4e8c-b047-a52915e2a686 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:18:25.847823 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:18:25.848425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:18:25.848700 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:18:25.848971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:18:25.850795 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:18:25.861023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:18:25.862437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:18:25.870302 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4387/8745] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:18:35.511220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:18:35.866798 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=26 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:08.400666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:08.469545 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bea72-925b-4479-9e5e-a9128cb65040 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:08.474202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:08.474841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:08.475122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:08.475394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] PATH_INFO: `/v3/users/87a4596d671f4015b7c79f313330055a` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:08.476516 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a4596d671f4015b7c79f313330055a)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:08.478541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:08.529627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a4596d671f4015b7c79f313330055a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.530250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a4596d671f4015b7c79f313330055a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.537966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a4596d671f4015b7c79f313330055a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.543893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a4596d671f4015b7c79f313330055a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.552293 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a4596d671f4015b7c79f313330055a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.571316 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4359/8746] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:19:08 2022] DELETE /identity/v3/users/87a4596d671f4015b7c79f313330055a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:08.755922 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:08.773017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b513-6f38-4b24-a78b-7dfda980c3c5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:08.835469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:08.836027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:08.836298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:08.836565 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] PATH_INFO: `/v3/projects/c00ba8b4694a4dd3be03cc8409e130bb` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:08.837729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00ba8b4694a4dd3be03cc8409e130bb)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:08.840830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:08.889980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00ba8b4694a4dd3be03cc8409e130bb', 'request_id': 'req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.896230 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00ba8b4694a4dd3be03cc8409e130bb', 'request_id': 'req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.902007 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00ba8b4694a4dd3be03cc8409e130bb', 'request_id': 'req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.915191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] The token cache is being invalidate because project c00ba8b4694a4dd3be03cc8409e130bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:19:08.915475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.916090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:08.917681 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4388/8747] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:19:08 2022] DELETE /identity/v3/projects/c00ba8b4694a4dd3be03cc8409e130bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:08.921741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:08.923223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:08.940356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8d5c-38f5-4637-bdcd-4941384cbfa5 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:09.001364 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:09.002034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.002312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.002596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] PATH_INFO: `/v3/users/a4597650204d4c5a8af34e850cbf2424` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.003723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4597650204d4c5a8af34e850cbf2424)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:09.006498 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:09.028906 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:09.054991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4597650204d4c5a8af34e850cbf2424'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.055665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4597650204d4c5a8af34e850cbf2424'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.063412 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4597650204d4c5a8af34e850cbf2424'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.064120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4597650204d4c5a8af34e850cbf2424'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.073120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-8b8fd3cd-7078-4de4-a2aa-fccff3b0f573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4597650204d4c5a8af34e850cbf2424'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.091486 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4360/8748] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:19:08 2022] DELETE /identity/v3/users/a4597650204d4c5a8af34e850cbf2424 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:09.585541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:09.590621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:09.603503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66693158-caf3-4bc8-a4ca-f3a0bbd5aac2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:09.677102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:09.677748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.678021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.678287 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] PATH_INFO: `/v3/projects/d2775b8d2cfc44b78e388d42ff24663a` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.679475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2775b8d2cfc44b78e388d42ff24663a)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:09.681495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:09.719860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:09.734111 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2775b8d2cfc44b78e388d42ff24663a', 'request_id': 'req-527e7b9d-9719-4cc6-b94c-489911da8142'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.741074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2775b8d2cfc44b78e388d42ff24663a', 'request_id': 'req-527e7b9d-9719-4cc6-b94c-489911da8142'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.746746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2775b8d2cfc44b78e388d42ff24663a', 'request_id': 'req-527e7b9d-9719-4cc6-b94c-489911da8142'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.760422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] The token cache is being invalidate because project d2775b8d2cfc44b78e388d42ff24663a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:19:09.761095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.761355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-527e7b9d-9719-4cc6-b94c-489911da8142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:19:09.762836 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4389/8749] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:19:09 2022] DELETE /identity/v3/projects/d2775b8d2cfc44b78e388d42ff24663a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:09.768084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.768596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.768708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.789462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:09.790662 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:09.856474 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4361/8750] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:09.866345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.866631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.866907 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.888317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:09.889557 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:09.898087 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4390/8751] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:09.902383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:09.915969 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7d927-7b2b-449f-b88a-f78c50752cdf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:09.922706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:09.923334 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.923596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.923929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.924547 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:19:09.924849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:09.927603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:09.942513 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4362/8752] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:19:09.946277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:09.955832 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0bbf-03ac-46d3-b008-e061f399950e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:09.960704 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:09.961339 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:09.961618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:09.961890 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:09.962522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:09.964430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:09.993201 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4391/8753] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:19:09 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:19:09.997437 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:10.008034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675657c-250e-4f48-89ea-f64875f6fa26 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:10.066180 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:10.066858 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.067239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.067518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.068150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:10.070191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:10.091385 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4363/8754] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:19:09 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:19:10.095678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:10.106710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42b4a-4a5c-443c-a9fa-e7447fe3054e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:10.111829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:10.112463 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.112727 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.113852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.114519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:10.116140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:10.127624 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4392/8755] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:19:10.132596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:10.143239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862dfb-4bff-4e17-8165-a4f40d03e84a admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:10.148182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:10.148798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.149112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.149387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.150070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:10.151687 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a3c42-9f5a-4361-8c14-063fbca4a07e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:10.163844 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4364/8756] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:19:10.168086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:10.179460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8115b-03b0-4015-b2ff-6175d39e48f5 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:10.184326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:10.185089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.185367 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.187366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] PATH_INFO: `/v3/projects/1648cc7f75e4409480ce034f375a823c/users/42f5b134175446689dc14bbc58323017/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.203794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1648cc7f75e4409480ce034f375a823c, user_id=42f5b134175446689dc14bbc58323017, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:10.206501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:10.220711 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4393/8757] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:19:10 2022] PUT /identity/v3/projects/1648cc7f75e4409480ce034f375a823c/users/42f5b134175446689dc14bbc58323017/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:10.226509 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621eb6-6290-41a4-ae2b-7552389e8052 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.226861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621eb6-6290-41a4-ae2b-7552389e8052 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.227202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621eb6-6290-41a4-ae2b-7552389e8052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.236191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:10.250325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-f4621eb6-6290-41a4-ae2b-7552389e8052 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:10.251546 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-f4621eb6-6290-41a4-ae2b-7552389e8052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:10.319967 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4365/8758] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:10.330343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:10.332255 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:10.398678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6e38-c587-431b-9989-759f07e87be4 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:10.402482 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:10.403098 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:10.403413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:10.403685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:10.413378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:10.414942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:10.425431 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4394/8759] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:19:14.777771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:14.778263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:14.778374 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:14.809530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] MFA Rules not processed for user `42f5b134175446689dc14bbc58323017`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:14.810909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:14.890870 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4366/8760] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:14.896460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:14.907172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cce83-42c8-4437-87fa-535efcfb5ee8 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:14.912685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:14.913385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:14.913688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:14.913924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:14.914577 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:14.916492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:14.948451 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4395/8761] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:19:14.952612 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:14.978524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79f9fc-4ea5-4be8-8532-068cb2c41d1b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:15.046028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:15.046495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:15.046776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:15.047049 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:15.047696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:15.050060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:15.074434 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4367/8762] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:19:14 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:19:15.078314 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:15.091599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff46f7-f7a7-471a-b1eb-aaccaa102d92 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:15.096706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:15.097363 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:15.098296 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:15.098714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:15.099485 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:15.101130 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:15.112752 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4396/8763] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:19:15.117195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:15.128137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3df72-c40a-456a-acc5-6d08237072ee admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:15.133893 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:15.134568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:15.134848 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:15.135122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] PATH_INFO: `/v3/projects/c24c4e65ba664054a1af32b514cb8c37/users/fd47f6f75c0545ddaa210f80250a63ea/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:15.154025 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24c4e65ba664054a1af32b514cb8c37, user_id=fd47f6f75c0545ddaa210f80250a63ea, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:15.156708 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:15.167695 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:15.173060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4368/8764] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:19:15 2022] PUT /identity/v3/projects/c24c4e65ba664054a1af32b514cb8c37/users/fd47f6f75c0545ddaa210f80250a63ea/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 17:19:15.177302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:15.187992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097327e4-c666-464d-9388-769cd6738bcc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:15.220806 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:15.264151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:15.264905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:15.265267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:15.265548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:15.266253 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:15.267887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3fc3d-9ff4-4a82-816f-ae0c662a817c admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:15.279798 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4397/8765] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:19:15.283958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:15.296261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba60f3-d339-44b6-8667-938529768eb2 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:15.302006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:15.302676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:15.302949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:15.303216 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] PATH_INFO: `/v3/projects/c24c4e65ba664054a1af32b514cb8c37/users/fd47f6f75c0545ddaa210f80250a63ea/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:15.305269 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24c4e65ba664054a1af32b514cb8c37, user_id=fd47f6f75c0545ddaa210f80250a63ea, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:15.308104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72708257-1fc0-4d13-8db3-3d8d895b2804 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:15.320303 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4369/8766] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:19:15 2022] PUT /identity/v3/projects/c24c4e65ba664054a1af32b514cb8c37/users/fd47f6f75c0545ddaa210f80250a63ea/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:19:19.843010 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:19.843585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:19.843585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:19.873680 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] MFA Rules not processed for user `fd47f6f75c0545ddaa210f80250a63ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:19.874892 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:19.949184 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4398/8767] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:19.986528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80b05-5ed3-497e-a4f3-37c0bad59d2c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:19.987065 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80b05-5ed3-497e-a4f3-37c0bad59d2c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:19.987171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb80b05-5ed3-497e-a4f3-37c0bad59d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:20.040811 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2eb80b05-5ed3-497e-a4f3-37c0bad59d2c None None] MFA Rules not processed for user `dd3b359a6c724c67853394a3a8481995`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:20.041971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2eb80b05-5ed3-497e-a4f3-37c0bad59d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:20.104921 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4370/8768] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 18 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:20.111107 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:20.122589 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4b50c-3b71-4fb5-9332-6881df98dab1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:20.126836 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:20.127968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:20.127968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:20.127968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:20.210545 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:20.212035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:20.221890 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4399/8769] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:19:20.406588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbee5-6d2e-4684-ae5e-41064285fc31 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:20.406942 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbee5-6d2e-4684-ae5e-41064285fc31 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:20.407312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbee5-6d2e-4684-ae5e-41064285fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:20.469495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-20adbee5-6d2e-4684-ae5e-41064285fc31 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:20.470723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-20adbee5-6d2e-4684-ae5e-41064285fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:20.544545 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4371/8770] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:19:20.600221 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:20.601705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:20.660174 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:20.703408 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38994bc1-0b8e-4a2c-a994-c9f2204cac73 service glance] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:20.709501 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:20.710122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:20.710394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:20.710660 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:20.719658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:20.721588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e565c-c9b0-4051-bf14-32679d1a7bc1 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:20.730500 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4400/8771] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:19:29.707607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:29.708136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:29.708250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:29.727312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] MFA Rules not processed for user `42f5b134175446689dc14bbc58323017`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:29.728495 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:29.735181 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4372/8772] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:30.726895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=20 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:32.638979 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:32.639571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:32.639571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:32.670712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:19:32.671928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:32.700437 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4401/8773] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:19:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:19:32.714666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:32.750606 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:32.752512 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bcd66-cfe8-42e9-9fbd-249b682ea0d7 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:32.759732 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:32.760568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:32.761228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:32.761356 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:32.771413 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:32.773113 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:32.781775 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4373/8774] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:19:33.600402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:33.680236 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171911d-89e3-4dfa-9c44-c91ca8cec453 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:33.684750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:33.685911 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:33.686299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:33.686746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:33.689668 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:33.775685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:33.777464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:33.803114 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4402/8775] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:19:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:19:35.008084 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:19:35.009676 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:35.023643 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d189c2d-7a93-44bd-bab3-636f2bfad1c1 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:19:35.027985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:19:35.028670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:19:35.029104 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:19:35.029384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:19:35.031953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:19:35.046231 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:19:35.047665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:19:35.059998 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4374/8776] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:19:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:19:43.799546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=74 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:19:45.054728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:20:11.093829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:20:11.103599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0400-49a7-412c-9779-46abad2e41cb service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:20:11.107382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:20:11.107986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:20:11.108261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:20:11.108530 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:20:11.118018 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:20:11.119496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:20:11.129283 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4403/8777] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:20:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:20:21.124881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:01.289096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:22:01.298463 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6e08d-1a4a-466e-b0c0-6d0b002bc38a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:22:01.302095 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:22:01.302693 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:22:01.302980 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:22:01.303225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:22:01.304920 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:22:01.326869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:22:01.328354 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:22:01.336492 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4375/8778] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:22:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:22:11.332926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:22:55.961343 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:22:55.962768 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:22:56.031687 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec475a-9944-4195-8bb5-fb8515f2b7be service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:22:56.036531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:22:56.037177 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:22:56.037452 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:22:56.037737 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:22:56.039434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:22:56.051479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:22:56.053052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:22:56.062649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4404/8779] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:22:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:22:58.570513 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:22:58.583028 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c63420-9985-42e3-b6c5-35acc290851e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:22:58.587925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:22:58.588518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:22:58.588791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:22:58.589096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:22:58.590989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:22:58.603792 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:22:58.605186 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:22:58.616365 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4376/8780] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:22:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:23:06.058697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:23:08.611680 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:00.079234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:00.080675 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:00.114666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdebaba-6616-4740-9b37-0d017518cfcf service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:00.122110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:00.123465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:00.123782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:00.124180 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:00.126803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:00.142498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:00.144594 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e874-5d63-43d9-a0c6-7fe0cd0f8dc5 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:00.160692 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4405/8781] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:10.155399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:13.653066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:13.665861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93ef9-8b6e-49a1-b702-5813ca7bcc89 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:13.671524 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:13.672135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:13.672409 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:13.672681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:13.675242 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:13.688526 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:13.690157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:13.701568 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4377/8782] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:24:14.968114 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330a166-f03f-4e3e-bca8-28711261271a None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:14.968584 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330a166-f03f-4e3e-bca8-28711261271a None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:14.968692 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330a166-f03f-4e3e-bca8-28711261271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:14.997799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-e330a166-f03f-4e3e-bca8-28711261271a None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:24:14.998980 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-e330a166-f03f-4e3e-bca8-28711261271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:15.006002 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4406/8783] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 17:24:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:24:15.046311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:15.058798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c540a-628b-4abe-bc21-1ed8ba4703ee service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:15.063670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:15.064255 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:15.064528 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:15.064793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:15.073804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:15.075381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:15.083306 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4378/8784] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:24:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:24:15.575191 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:15.575611 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:15.576035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:15.595787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:24:15.597036 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:15.605478 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4407/8785] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:24:15.617535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:15.631543 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7482bc-ab2b-4fbc-9f46-b6822fd501cf service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:15.636603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:15.637228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:15.637508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:15.637790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:15.646370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:15.647947 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df4e39-520a-42ea-ba4b-9bb88c61f876 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:15.656727 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4379/8786] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:24:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:24:24.265803 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:24.279449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d506ce-9293-4b8b-9835-523b85db99f9 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:24.284740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:24.285369 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:24.285642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:24.285906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:24.294391 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:24.295942 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:24.304567 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4408/8787] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:24.373957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:24.374493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:24.374493 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:24.394182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] MFA Rules not processed for user `42f5b134175446689dc14bbc58323017`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:24:24.395408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:24.404349 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4380/8788] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:24:24.667361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:24.676713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ec0bb-ba5d-465d-8f3e-f7ccf1070524 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:24.680870 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:24.681492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:24.681766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:24.682035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:24.683758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:24.693183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:24.694644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ca3af-add7-4871-b549-d9e5485ee774 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:24.702856 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4409/8789] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:25.020521 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:25.022061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:25.037027 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e74a-4f36-4e8c-99cc-47f8cd0f6e01 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:25.042840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:25.043723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:25.044064 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:25.044329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:25.046066 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:25.059640 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:25.061311 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:25.071584 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4381/8790] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:26.365383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:26.366315 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:26.366567 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:26.385845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:24:26.387054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:26.394779 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4410/8791] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:24:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:24:26.409165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:26.421844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb6c23-39ca-4d6d-8835-31606eca0925 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:26.427162 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:26.427756 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:26.428034 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:26.428297 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:26.437018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:26.438571 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:26.447075 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4382/8792] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:24:34.446357 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:34.465863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b55f-6b67-4a12-bbd2-7e829f8027e4 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:34.469494 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:34.470102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:34.470376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:34.470643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:34.488164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:34.489645 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:34.502371 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4411/8793] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:35.691444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:35.701288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b107c8-19da-427d-b07d-86af7188b573 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:35.704904 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:35.705553 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:35.705828 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:35.706093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:35.717146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:35.718565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:35.729534 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4383/8794] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:42.050072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:24:42.056904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=39 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:42.064525 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9495df1-dc14-4977-958c-03bbc86d9982 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:24:42.069472 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:24:42.070155 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:24:42.070503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:24:42.070782 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:24:42.072534 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:24:42.086729 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:24:42.088302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59021a74-4a6c-4e42-bcbd-6627b874bd08 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:24:42.099669 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4412/8795] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:24:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:24:45.724692 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=39 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:24:52.094596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:06.260752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:06.270326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007fe8-24dc-46e0-a944-20e4f576d20b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:06.276329 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:06.277097 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:06.277426 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:06.277933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:06.288913 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:06.290419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:06.299242 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4384/8796] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:12.641973 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:12.642468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:12.642593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:12.662498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:12.663744 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:12.671172 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4413/8797] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 17:27:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:12.712135 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:12.724841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337247c5-28f7-4b93-ab04-b9046c3112b1 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:12.730059 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:12.730696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:12.730973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:12.731241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:12.740486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:12.742079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:12.750502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4385/8798] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:27:13.114481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:13.124143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c980-8fb9-4a3c-9815-2a02d86edb01 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:13.127669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:13.128291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:13.128568 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:13.128838 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:13.200860 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:13.202320 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:13.221248 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4414/8799] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:16.537118 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:16.560474 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642692df-61b6-4e10-8da1-3989475d0c6f service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:16.565554 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:16.566155 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:16.566434 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:16.566706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:16.568483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:16.599790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:16.601466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:16.613243 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4386/8800] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:19.638129 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:19.649498 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d205b-0caf-4cb2-a85d-1570c45ab08c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:19.654431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:19.655067 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:19.655349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:19.655624 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] PATH_INFO: `/v3/users/42f5b134175446689dc14bbc58323017` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:19.656745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f5b134175446689dc14bbc58323017)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:19.658694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:19.706703 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f5b134175446689dc14bbc58323017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:19.714931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f5b134175446689dc14bbc58323017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:19.715553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f5b134175446689dc14bbc58323017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:19.722716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f5b134175446689dc14bbc58323017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:19.724002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f5b134175446689dc14bbc58323017'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:19.742430 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4415/8801] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:27:19 2022] DELETE /identity/v3/users/42f5b134175446689dc14bbc58323017 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:19.927767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:19.941124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e551c61-5b24-4424-a1e9-d6b0bba29cb7 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.002855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.003849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.005902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.006385 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] PATH_INFO: `/v3/projects/1648cc7f75e4409480ce034f375a823c` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.007671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1648cc7f75e4409480ce034f375a823c)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.009527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.058492 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1648cc7f75e4409480ce034f375a823c', 'request_id': 'req-4743800f-43fa-402d-9c9c-68ee4d9b6917'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.065777 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1648cc7f75e4409480ce034f375a823c', 'request_id': 'req-4743800f-43fa-402d-9c9c-68ee4d9b6917'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.072928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1648cc7f75e4409480ce034f375a823c', 'request_id': 'req-4743800f-43fa-402d-9c9c-68ee4d9b6917'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.096158 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] The token cache is being invalidate because project 1648cc7f75e4409480ce034f375a823c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:27:20.096441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.097117 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.098811 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4387/8802] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:27:19 2022] DELETE /identity/v3/projects/1648cc7f75e4409480ce034f375a823c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:20.102643 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.103959 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:20.117242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a81a9-42dc-42d4-9027-904132e82398 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.157080 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:20.174950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.175585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.175866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.176140 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] PATH_INFO: `/v3/users/fd47f6f75c0545ddaa210f80250a63ea` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.177894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd47f6f75c0545ddaa210f80250a63ea)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.179866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.225201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd47f6f75c0545ddaa210f80250a63ea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.232637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd47f6f75c0545ddaa210f80250a63ea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.233386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd47f6f75c0545ddaa210f80250a63ea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.240937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd47f6f75c0545ddaa210f80250a63ea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.241605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a9d49a7f-9ebb-46a6-aae3-c1059e69546a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd47f6f75c0545ddaa210f80250a63ea'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.259257 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4416/8803] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:27:20 2022] DELETE /identity/v3/users/fd47f6f75c0545ddaa210f80250a63ea => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:20.437566 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.440041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:20.458087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743800f-43fa-402d-9c9c-68ee4d9b6917 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.476165 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:20.519576 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.520209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.520490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.520864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] PATH_INFO: `/v3/projects/c24c4e65ba664054a1af32b514cb8c37` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.522013 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24c4e65ba664054a1af32b514cb8c37)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.523929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.572181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24c4e65ba664054a1af32b514cb8c37', 'request_id': 'req-a629acf6-5c9e-42a3-8cae-aa947f20a771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.579040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24c4e65ba664054a1af32b514cb8c37', 'request_id': 'req-a629acf6-5c9e-42a3-8cae-aa947f20a771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.585883 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24c4e65ba664054a1af32b514cb8c37', 'request_id': 'req-a629acf6-5c9e-42a3-8cae-aa947f20a771'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.596277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] The token cache is being invalidate because project c24c4e65ba664054a1af32b514cb8c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:27:20.596565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.597223 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-a629acf6-5c9e-42a3-8cae-aa947f20a771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:27:20.599528 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4388/8804] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:27:20 2022] DELETE /identity/v3/projects/c24c4e65ba664054a1af32b514cb8c37 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:20.604651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.604953 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.605271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.664298 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:20.665467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:20.726199 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4417/8805] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:20.735250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.735564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.735840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.755600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:20.756850 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:20.764795 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4389/8806] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:20.769249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.779967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213686e-28d0-474e-ae11-43ebd32597d1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.784544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.785182 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.785464 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.786649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.787361 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:27:20.787666 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.789386 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.800934 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4418/8807] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:27:20.805394 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.814895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62841-c33d-4536-8932-c9039d6c33b2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.819853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.820476 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.820752 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.821054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.821707 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.823621 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.867919 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4390/8808] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:27:20 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:27:20.872217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.883931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9cbcd-c1a8-4601-892f-2c14a8db3f27 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:20.900074 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:20.953628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:20.954243 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:20.954520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:20.954785 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:20.955445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:20.957410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:20.981415 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4419/8809] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:27:20 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:27:20.985592 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:20.997400 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60544bbe-6f3c-47ef-8c2c-8b57e9944222 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.002252 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.002963 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.003340 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.003731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.004510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.006266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.020445 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4391/8810] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:27:21.021640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.031956 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99712f-762e-476f-92b8-c204f597df1d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.037124 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.037740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.038016 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.038317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.038910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.040499 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874a93-abde-422f-99ca-12df0fba1467 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.051634 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4420/8811] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:27:21.055864 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.065957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc030-81af-45ab-b890-348ee58fc5ed admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.071478 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.072141 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.072417 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.072691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] PATH_INFO: `/v3/projects/b583e593adb54b4da76722c3cb93d92b/users/80e37568aa09403aaf54055f4defba46/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.091239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b583e593adb54b4da76722c3cb93d92b, user_id=80e37568aa09403aaf54055f4defba46, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.093971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.107812 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4392/8812] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:27:21 2022] PUT /identity/v3/projects/b583e593adb54b4da76722c3cb93d92b/users/80e37568aa09403aaf54055f4defba46/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:21.118552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282469-b9f5-4343-adda-1391772fa49e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.118830 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282469-b9f5-4343-adda-1391772fa49e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.119099 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282469-b9f5-4343-adda-1391772fa49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.147239 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-98282469-b9f5-4343-adda-1391772fa49e None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:21.148447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-98282469-b9f5-4343-adda-1391772fa49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:21.213133 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4421/8813] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:21.217698 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.259511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:21.281629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7401-bc14-4ad7-8961-f77636ff729d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.286335 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.287625 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.287898 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.288164 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.288791 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.290718 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.317468 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4393/8814] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:27:21 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:27:21.321507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282469-b9f5-4343-adda-1391772fa49e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.332383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282469-b9f5-4343-adda-1391772fa49e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.388649 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.389300 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.389574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.389843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.390478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.392370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.414655 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4422/8815] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:27:21 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:27:21.418894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.429614 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259168b-ad03-4fbd-ade8-a383b16e3522 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.434174 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.434763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.435042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.435312 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.435954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.437573 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.448452 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4394/8816] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:27:21.452475 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.463522 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea9362-35ca-40f1-8be1-47672d7e466e admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.468259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.468906 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.469235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.469507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] PATH_INFO: `/v3/projects/2f42a80850774609bbee450b8431f45f/users/43bfc9664e2c4b9cbbb792c5e5418115/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.483937 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:21.487345 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f42a80850774609bbee450b8431f45f, user_id=43bfc9664e2c4b9cbbb792c5e5418115, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.490630 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.503854 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4423/8817] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:27:21 2022] PUT /identity/v3/projects/2f42a80850774609bbee450b8431f45f/users/43bfc9664e2c4b9cbbb792c5e5418115/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:21.507841 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.517871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8381a-542f-407f-9be8-b1908f179b61 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.574217 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.574824 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.575100 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.575371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.576006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.577658 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd029cb-5bff-4572-8a15-0bc7e78da705 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.588107 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4395/8818] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:27:21.592402 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.603284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d4f04-aae4-41ee-9184-fb7dc6f491b3 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.607871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.608518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.608794 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.609100 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] PATH_INFO: `/v3/projects/2f42a80850774609bbee450b8431f45f/users/43bfc9664e2c4b9cbbb792c5e5418115/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.610984 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f42a80850774609bbee450b8431f45f, user_id=43bfc9664e2c4b9cbbb792c5e5418115, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.613597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.624528 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4424/8819] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:27:21 2022] PUT /identity/v3/projects/2f42a80850774609bbee450b8431f45f/users/43bfc9664e2c4b9cbbb792c5e5418115/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:27:21.634755 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.635042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.635318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.664416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] MFA Rules not processed for user `43bfc9664e2c4b9cbbb792c5e5418115`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:21.665652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:21.733468 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4396/8820] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:21.749845 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:21.751930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:21.836195 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a0b11-26e3-41bb-af5b-5009a29ff343 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:21.841728 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:21.842322 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:21.842585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:21.842881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:21.898551 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:21.900121 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fcc06-047b-4a80-a7ad-c07ecfcdfcac service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:21.908961 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4425/8821] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:25.605670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:25.607140 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:25.643596 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:25.667531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5c517-696f-4d64-950a-36093cb19dcb None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:25.671136 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:25.671744 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:25.672020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:25.672287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:25.682375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:25.683807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:25.694530 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4397/8822] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:28.762049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:28.762049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:28.762049 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:28.782232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:27:28.783279 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:28.792510 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4426/8823] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:27:29.175909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:29.186031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7061f-7e1a-4b63-80a1-7dbce4d83ddb service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:29.190063 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:29.190763 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:29.191098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:29.191439 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:29.193978 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:29.207724 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:29.212635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:29.223005 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4398/8824] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:29.604756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:29.606200 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:29.674833 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:29.690893 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b60fe-8425-477d-a180-af88e3ad5ef1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:29.697033 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:29.697659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:29.697934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:29.698203 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:29.700143 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:29.712090 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:27:29.713767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:27:29.723675 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4427/8825] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:27:39.218530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=17 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:39.719479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:27:59.950807 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:27:59.971921 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b64e9-59ea-42c0-abae-983af9da1fec service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:27:59.979246 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:27:59.980074 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:27:59.980352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:27:59.980623 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:27:59.982804 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:27:59.997496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:28:00.000857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d815f-9a55-4301-8254-5687a64a2760 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:28:00.016867 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4399/8826] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:27:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:28:03.590932 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:28:03.601456 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c00551-8f87-4b20-8ec2-7ac6fe575c16 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:28:03.606350 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:28:03.606936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:28:03.607209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:28:03.607474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:28:03.609165 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:28:03.620848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:28:03.622430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:28:03.632505 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4428/8827] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:28:10.009798 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:28:13.628035 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:03.717181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:29:03.717734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:29:03.717734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:29:03.739991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:29:03.742047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:29:03.749237 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4400/8828] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:29:07.550241 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:29:07.551962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:29:07.569468 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f073e-f2c7-4602-825e-dcfeb7cfb2c6 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:29:07.575040 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729079-6459-4201-915e-5493b4001025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:29:07.575650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729079-6459-4201-915e-5493b4001025 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:29:07.575929 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729079-6459-4201-915e-5493b4001025 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:29:07.576199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729079-6459-4201-915e-5493b4001025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:29:07.577974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f6729079-6459-4201-915e-5493b4001025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:29:07.592612 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729079-6459-4201-915e-5493b4001025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:29:07.594469 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6729079-6459-4201-915e-5493b4001025 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:29:07.606077 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4429/8829] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:29:13.733445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:29:17.601434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:19.353928 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:30:19.355496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:30:19.405247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d446ce-5d0c-4181-b32d-0a7656a55c31 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:30:19.409219 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:30:19.409637 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:30:19.410700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:30:19.410700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:30:19.411971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:30:19.465840 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:30:19.467585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:30:19.491936 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4401/8830] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:30:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:30:20.763888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729079-6459-4201-915e-5493b4001025 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:30:20.783603 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729079-6459-4201-915e-5493b4001025 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:30:20.787536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:30:20.788135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:30:20.788410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:30:20.788674 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:30:20.791001 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:30:20.805783 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:30:20.807410 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:30:20.819308 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4430/8831] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:30:29.489129 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=32 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:30:30.814440 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:23.385677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:31:23.397442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8adf62-444b-484f-a53b-745a6272a5ca service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:31:23.404281 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:31:23.404909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:31:23.405218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:31:23.405795 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:31:23.407460 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:23.421941 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:31:23.423646 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c76738-9c70-4eb0-9a0f-668dab332e8d service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:31:23.435729 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4402/8832] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:31:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:31:27.846588 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:31:27.848585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:27.862454 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbc960-7cd1-4124-8b1c-fb21acb91ed5 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:31:27.867430 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:31:27.868029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:31:27.868306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:31:27.868575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:31:27.870306 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:27.881859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:31:27.883444 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:31:27.898163 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4431/8833] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:31:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:31:33.430054 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:33.624005 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:31:33.624384 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:31:33.625468 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:31:33.645494 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:31:33.646820 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:33.656054 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4403/8834] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:31:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:31:34.037935 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:31:34.054479 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b752e-3688-45c6-85ba-a8d61c4cb8c0 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:31:34.059587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:31:34.060267 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:31:34.060619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:31:34.060962 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:31:34.062936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:34.080445 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:31:34.081915 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:31:34.101289 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4432/8835] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:31:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:31:42.180225 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:31:42.194519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655db4c-4edb-4282-8434-2a5f698dc8a6 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:31:42.200666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:31:42.201315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:31:42.201594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:31:42.201871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:31:42.203611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:31:42.216784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:31:42.219030 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:31:42.230671 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4404/8836] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:31:44.087144 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:31:52.225427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:11.258341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:11.267593 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca21a-7ae4-4663-ba37-18d14549e73a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:11.271425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:11.272052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:11.272576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:11.272848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:11.274610 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:32:11.299978 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:11.301492 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:11.312131 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4433/8837] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:21.306910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:48.375878 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:48.387130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26701cb4-4aa7-46f7-806f-594acd9ad257 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:48.393558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:48.394146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.394422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.394690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.402511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:48.404677 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4fc4f-6f40-4bfd-91ec-e82184f39b5e service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:48.417587 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4405/8838] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:48.473707 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:48.482252 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781fbf9-9e8c-4480-8d22-dcfb8aa66c6c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:48.485943 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:48.486544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.486824 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.487094 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.494113 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:48.495507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:48.503810 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4434/8839] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:48.640061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e626-7540-490c-a687-ed10395a09c0 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.640440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e626-7540-490c-a687-ed10395a09c0 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.640881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e626-7540-490c-a687-ed10395a09c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.681719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2a51e626-7540-490c-a687-ed10395a09c0 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:32:48.683076 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2a51e626-7540-490c-a687-ed10395a09c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:32:48.690078 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4406/8840] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:32:48.704536 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:48.714810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873299f-b7fa-42ee-8f9e-4a1ad84a4e85 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:48.718460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:48.719766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.720046 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.720317 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.727894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:48.729362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:48.737411 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4435/8841] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:48.816534 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd08d-98a6-44c2-9317-fd511f76d164 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.816815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd08d-98a6-44c2-9317-fd511f76d164 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.817115 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fd08d-98a6-44c2-9317-fd511f76d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.855956 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-706fd08d-98a6-44c2-9317-fd511f76d164 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:32:48.857195 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-706fd08d-98a6-44c2-9317-fd511f76d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:32:48.866012 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4407/8842] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:32:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:32:48.878057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:48.889947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05131539-f4fd-4a74-ab4d-8f4961f79f46 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:48.895755 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:48.896360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:48.896631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:48.896887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:48.905413 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:48.907934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:48.917491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4436/8843] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:49.086815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:49.087098 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:49.087396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:49.125032 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:32:49.127047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:32:49.136891 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4408/8844] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:32:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:32:49.148480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:49.158370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c1a7-ba57-48a3-b5aa-aae7b478f5b9 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:49.161961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:49.162548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:49.162849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:49.163118 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:49.173640 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:49.175053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:49.185838 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4437/8845] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:49.249852 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:32:49.261209 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c3052-1d4b-49da-9135-171fe51025e2 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:32:49.266325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:32:49.266916 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:32:49.267200 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:32:49.267471 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:32:49.269250 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:32:49.281152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:32:49.283381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:32:49.293200 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4409/8846] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:32:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:32:59.181081 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=24 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:32:59.289016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=39 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:33:03.031617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:33:03.040858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704721b3-dbbb-446a-a2a7-408736d7b967 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:33:03.044450 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:33:03.045146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:33:03.045460 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:33:03.045637 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:33:03.047373 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:33:03.057476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:33:03.058887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:33:03.067703 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4438/8847] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:33:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:33:04.960298 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:33:04.970607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469baedc-a64b-450c-9e74-70fd1bc42f1d service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:33:04.976035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:33:04.976700 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:33:04.976981 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:33:04.977277 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:33:04.986395 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:33:04.987976 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:33:04.998539 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4410/8848] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:33:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:33:08.570659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:33:08.582750 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9103a-19e7-4b02-889b-40cf8b3db27f service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:33:08.587677 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:33:08.588272 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:33:08.588548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:33:08.588818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:33:08.597853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:33:08.599471 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:33:08.609268 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4439/8849] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:33:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:33:14.993903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:33:18.605109 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=12 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:07.110325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:34:07.124691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b848-8691-4125-9d9e-48d7c3c8108e service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:34:07.130477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:34:07.131331 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:34:07.131805 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:34:07.132146 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:34:07.142575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:34:07.144300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:34:07.155284 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4411/8850] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:34:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:34:11.805592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:34:11.816510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400bf6-27be-4b40-a407-80faf13782c1 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:34:11.821858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:34:11.822487 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:34:11.822766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:34:11.823037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:34:11.824818 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:34:11.837437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:34:11.839052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14d169-f77e-411f-af6c-50a12798f270 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:34:11.850614 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4440/8851] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:34:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:34:15.162402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:34:15.171844 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28edd9-1c8f-49a6-a2d4-081ca3e208ae service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:34:15.175668 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:34:15.176257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:34:15.176530 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:34:15.176793 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:34:15.185887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:34:15.187241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:34:15.198982 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4412/8852] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:34:15 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:34:18.038986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805792-653f-4312-8941-e972469a2274 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:34:18.039608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805792-653f-4312-8941-e972469a2274 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:34:18.039608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805792-653f-4312-8941-e972469a2274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:34:18.061491 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-b3805792-653f-4312-8941-e972469a2274 None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:34:18.062881 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b3805792-653f-4312-8941-e972469a2274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:34:18.077507 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4441/8853] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:34:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:34:18.842265 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:34:18.856193 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17294-200d-4ad2-9ccb-3310d69ec02b service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:34:18.862901 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:34:18.863458 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:34:18.863736 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:34:18.864024 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:34:18.875124 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:34:18.876796 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:34:18.890437 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4413/8854] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:34:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:34:28.054791 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=9 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:34:28.883404 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=18 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:33.936827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805792-653f-4312-8941-e972469a2274 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:35:33.956404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805792-653f-4312-8941-e972469a2274 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:35:33.959966 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:35:33.960570 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:35:33.960847 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:35:33.961146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:35:33.978895 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:35:33.980308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e7f0d-529f-4f00-8f1b-478a8a557ef4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:35:33.991950 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4442/8855] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:35:35.182263 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:35:35.192563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd410-814e-4f6d-9f90-364687d73f3d service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:35:35.196204 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:35:35.196789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:35:35.197106 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:35:35.197370 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:35:35.207599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:35:35.209020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:35:35.219581 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4414/8856] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:35:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:35:43.986398 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=13 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:35:45.215014 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:36:50.795924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:36:50.796537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:36:50.796537 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:36:50.819172 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] MFA Rules not processed for user `80e37568aa09403aaf54055f4defba46`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:36:50.820970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:36:50.828584 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4443/8857] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:36:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:36:51.186860 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:36:51.202042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27fac-b8a8-4660-b4e7-820db37bdcc8 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:36:51.206317 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:36:51.207176 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:36:51.209408 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:36:51.209706 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:36:51.219719 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:36:51.221485 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:36:51.231151 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4415/8858] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:36:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:37:00.813732 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:01.227016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:01.584518 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:37:01.598876 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494388df-a42e-4cf6-af3a-e12dc5e227d8 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:37:01.605240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:37:01.605856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:37:01.606135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:37:01.606404 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:37:01.615710 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:37:01.617377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:37:01.628577 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4444/8859] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:37:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:37:11.624183 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:37:12.075307 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:37:12.083915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80073f21-3a51-4cfa-b9e3-997569454f36 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:37:12.088350 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:37:12.088940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:37:12.089240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:37:12.089508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:37:12.096712 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:37:12.098153 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:37:12.106192 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4416/8860] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:37:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:37:22.102728 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:07.936912 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:08.012030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a29dc-8cab-45e5-a58d-7da7cdc29e4b service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:08.016926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:08.017552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:08.017829 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:08.018095 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:08.019914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:08.043919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:08.045506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:08.055679 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4445/8861] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:08.373440 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:08.445157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88774c8-6ba3-4daa-946f-2b4e707ceb60 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:08.450531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:08.451139 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:08.451420 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:08.451691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:08.453527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:08.532244 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:08.533881 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:08.552269 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4417/8862] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:10.542011 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:10.552336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265f31f-65fc-4041-a74d-538122d7684e service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:10.558478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:10.559087 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:10.559368 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:10.559669 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:10.561553 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:10.574284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:10.575855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:10.586045 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4446/8863] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:18.551120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=69 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:19.082197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:19.084068 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:19.123569 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de18b-2629-4699-9c31-6400adf95497 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:19.138198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:19.138198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:19.138198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:19.138198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:19.150783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:19.153016 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc427baf-baea-4118-bac2-c6b54c5dc124 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:19.164856 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4418/8864] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:38:20.581698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:23.384695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:23.386383 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:23.495157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7a4b7-a298-4db6-b240-fe5f84265ba7 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:23.499788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:23.500417 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:23.500688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:23.500944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] PATH_INFO: `/v3/users/80e37568aa09403aaf54055f4defba46` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:23.502735 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e37568aa09403aaf54055f4defba46)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:23.504954 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:23.557229 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e37568aa09403aaf54055f4defba46'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:23.585201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e37568aa09403aaf54055f4defba46'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:23.586618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e37568aa09403aaf54055f4defba46'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:23.610967 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e37568aa09403aaf54055f4defba46'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:23.611721 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e37568aa09403aaf54055f4defba46'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:23.631551 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4447/8865] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:38:23 2022] DELETE /identity/v3/users/80e37568aa09403aaf54055f4defba46 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:23.636667 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:23.637260 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:23.637399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:23.672397 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:23.673788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:23.735950 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4419/8866] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:38:23.746470 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:23.747880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:23.807278 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a656-4884-4633-82a0-4949002b2a46 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:23.811237 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:23.811871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:23.812153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:23.812711 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:23.818828 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:23.823601 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:23.825949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:23.844946 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4448/8867] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:24.024415 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:24.025953 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:24.039304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb691f00-8930-496e-ab58-c8f28081921c None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:24.044220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:24.045102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.045582 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.045857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] PATH_INFO: `/v3/projects/b583e593adb54b4da76722c3cb93d92b` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.047053 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b583e593adb54b4da76722c3cb93d92b)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:24.048940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:24.097991 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b583e593adb54b4da76722c3cb93d92b', 'request_id': 'req-05678611-911a-4c77-8577-1f8759381f5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.106406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b583e593adb54b4da76722c3cb93d92b', 'request_id': 'req-05678611-911a-4c77-8577-1f8759381f5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.112651 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b583e593adb54b4da76722c3cb93d92b', 'request_id': 'req-05678611-911a-4c77-8577-1f8759381f5c'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.123812 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] The token cache is being invalidate because project b583e593adb54b4da76722c3cb93d92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:38:24.124096 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.124734 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.126241 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4420/8868] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:38:24 2022] DELETE /identity/v3/projects/b583e593adb54b4da76722c3cb93d92b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:24.130312 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:24.140202 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d37d4-2244-4902-bae7-3f6a7e06f88b service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:24.199321 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:24.199970 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.200254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.200524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] PATH_INFO: `/v3/users/43bfc9664e2c4b9cbbb792c5e5418115` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.214950 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bfc9664e2c4b9cbbb792c5e5418115)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:24.216868 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:24.264407 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bfc9664e2c4b9cbbb792c5e5418115'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.272712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bfc9664e2c4b9cbbb792c5e5418115'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.273495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bfc9664e2c4b9cbbb792c5e5418115'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.281458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bfc9664e2c4b9cbbb792c5e5418115'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.282166 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fa5a607d-e93b-438f-a5f0-bb16fc41290f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bfc9664e2c4b9cbbb792c5e5418115'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.301491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4449/8869] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:38:24 2022] DELETE /identity/v3/users/43bfc9664e2c4b9cbbb792c5e5418115 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:24.579665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:24.581232 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:24.595402 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05678611-911a-4c77-8577-1f8759381f5c admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:24.647275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:24.659152 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:24.659772 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.660046 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.660313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] PATH_INFO: `/v3/projects/2f42a80850774609bbee450b8431f45f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.671466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f42a80850774609bbee450b8431f45f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:24.673399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:24.720224 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f42a80850774609bbee450b8431f45f', 'request_id': 'req-c029c779-70ef-442c-80ec-2c72653ca02a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.729020 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f42a80850774609bbee450b8431f45f', 'request_id': 'req-c029c779-70ef-442c-80ec-2c72653ca02a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.737157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f42a80850774609bbee450b8431f45f', 'request_id': 'req-c029c779-70ef-442c-80ec-2c72653ca02a'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.748735 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] The token cache is being invalidate because project 2f42a80850774609bbee450b8431f45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:38:24.749060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.749739 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-c029c779-70ef-442c-80ec-2c72653ca02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:38:24.751262 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4421/8870] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:38:24 2022] DELETE /identity/v3/projects/2f42a80850774609bbee450b8431f45f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:24.756504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.757164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.757164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.805859 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:24.807047 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:24.840626 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:24.868254 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4450/8871] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:38:24.876685 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.876965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.877262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.896915 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:24.898372 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:24.906357 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4422/8872] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:38:24.910546 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:24.921726 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ad9f6-e796-4ad0-b72a-9e3edbc11f18 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:24.926222 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:24.926813 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.927085 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.927352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] PATH_INFO: `/v3/domains` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.927995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:38:24.928294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:24.930117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:24.941894 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4451/8873] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:38:24.946837 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:24.956148 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff648e-93ed-4383-89e0-90e4af551053 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:24.961486 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:24.962073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:24.962351 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:24.962619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:24.963266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:24.965198 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.005194 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4423/8874] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:38:24 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:38:25.010023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:25.020205 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031070d7-e584-4e36-8866-1fef4998c18b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:25.078245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:25.078856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.079137 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.079412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.080076 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:25.082028 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.103852 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4452/8875] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:38:25 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:38:25.108390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:25.118955 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9291edb-10b3-42a1-8b63-1037aed9bf90 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:25.123496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:25.124087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.124357 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.124622 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.125294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:25.126868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.137387 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4424/8876] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:38:25.141401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:25.152424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffd44c-54fc-4c52-8efe-35e834da0f3d admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:25.157309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:25.157903 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.158173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.158437 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.159072 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:25.160642 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bf0f-4f1f-41cc-92ca-809ef67c99b6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.171448 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4453/8877] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:38:25.175615 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:25.187803 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5714c-6c2b-44d9-aca6-377cf14a2f76 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:25.192462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:25.193220 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.193352 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.193593 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] PATH_INFO: `/v3/projects/dc6222a154d3498ea4bcb82b8ac622df/users/81c0d4489f15472dbc1dd55e0f528f46/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.208789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6222a154d3498ea4bcb82b8ac622df, user_id=81c0d4489f15472dbc1dd55e0f528f46, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:25.211696 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.224915 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4425/8878] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:38:25 2022] PUT /identity/v3/projects/dc6222a154d3498ea4bcb82b8ac622df/users/81c0d4489f15472dbc1dd55e0f528f46/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:25.230185 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958174d0-58be-4bf9-ac2e-816a82185833 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.230473 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958174d0-58be-4bf9-ac2e-816a82185833 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.230748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958174d0-58be-4bf9-ac2e-816a82185833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.250548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-958174d0-58be-4bf9-ac2e-816a82185833 None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:25.251756 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-958174d0-58be-4bf9-ac2e-816a82185833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:25.316043 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4454/8879] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:38:25.328316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:25.330093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:25.392619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed586d3b-9a14-440f-b057-39c77fc201b0 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:25.397536 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:25.397711 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:25.397975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:25.398459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:25.409788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:25.411339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:25.421517 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4426/8880] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:29.669555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:29.670122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:29.670122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:29.708629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] MFA Rules not processed for user `81c0d4489f15472dbc1dd55e0f528f46`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:29.710484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:29.748477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:29.783210 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4455/8881] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:38:29.787823 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:29.794933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:29.799376 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee8268-b6b5-4a19-8a2d-d24bc0bdb8f0 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:29.806327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:29.806959 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:29.807315 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:29.807783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:29.808574 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:29.810938 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:29.840115 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4427/8882] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:38:29 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:38:29.844245 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:29.858483 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f645-a689-46a5-adf9-2abeb6a3fddd None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:29.922449 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:29.923017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:29.923290 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:29.923569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:29.924247 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:29.926393 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:29.957064 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4456/8883] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:38:29 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 17:38:29.958266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:29.972636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7735-f859-4719-a53c-cbcf65c719dd admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:29.983441 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:29.984738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:29.984738 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:29.984966 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:29.986323 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:29.990857 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:30.005810 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4428/8884] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:38:30.015512 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:30.028659 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108605b-59ea-4f45-9b01-69cbc8880cb8 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:30.033358 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:30.034008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:30.034284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:30.034573 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] PATH_INFO: `/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3/users/8bc6c5e840d4473d8125b04617e39c01/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:30.053629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8270fdc13c5d4d14aa305d8deb8f03c3, user_id=8bc6c5e840d4473d8125b04617e39c01, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:30.056412 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:30.071718 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4457/8885] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:38:30 2022] PUT /identity/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3/users/8bc6c5e840d4473d8125b04617e39c01/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:30.075776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:30.087343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575020-5c9d-4e85-af66-2c3bfb7f8807 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:30.152568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:30.153399 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:30.153781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:30.154122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:30.154765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:30.156405 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f3044-332a-4d7f-b9a9-34b3744d399a admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:30.169048 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4429/8886] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:38:30.172435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:30.199810 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e4cd0-641e-47fd-81f5-ae4ed52f9207 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:30.208963 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:30.209647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:30.210048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:30.210846 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] PATH_INFO: `/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3/users/8bc6c5e840d4473d8125b04617e39c01/roles/eb5fc6b45679476182540fe032952925` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:30.212921 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8270fdc13c5d4d14aa305d8deb8f03c3, user_id=8bc6c5e840d4473d8125b04617e39c01, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:30.215880 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:30.229101 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4458/8887] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:38:30 2022] PUT /identity/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3/users/8bc6c5e840d4473d8125b04617e39c01/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:38:35.114849 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6cc6-631a-44f5-924c-1825b0fcf3c5 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:35.115427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6cc6-631a-44f5-924c-1825b0fcf3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:35.115427 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e6cc6-631a-44f5-924c-1825b0fcf3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:35.146185 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-3a9e6cc6-631a-44f5-924c-1825b0fcf3c5 None None] MFA Rules not processed for user `8bc6c5e840d4473d8125b04617e39c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:35.148120 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-3a9e6cc6-631a-44f5-924c-1825b0fcf3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:35.232399 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4430/8888] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:38:35.249863 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:35.251965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:35.332242 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9c974-c3f9-44f6-b63e-aa9b1c9a7eec admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:35.341232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:35.341853 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:35.342135 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:35.342401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:35.368622 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:35.408002 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:35.409619 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:35.418916 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4459/8889] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:36.461444 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:36.461982 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:36.462093 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:36.482765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] MFA Rules not processed for user `81c0d4489f15472dbc1dd55e0f528f46`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:38:36.483973 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:36.492954 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4431/8890] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:38:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:38:45.414558 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=17 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:46.477660 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:38:48.199835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:38:48.201434 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:38:48.263235 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cd6a-a69b-4b11-b68e-4b8e94c091e1 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:38:48.266837 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:38:48.267447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:38:48.267716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:38:48.267981 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:38:48.277896 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:38:48.279318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:38:48.288814 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4460/8891] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:38:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:38:58.284497 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=26 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:15.970254 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:15.971629 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:16.078371 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865b5fc-ab50-41d9-b80e-905b6c2d3e13 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:16.081965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:16.082501 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:16.082776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:16.083041 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:16.084731 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:16.119110 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:16.121202 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476299-46d4-453c-8da8-0c00a4ff790f service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:16.140898 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4432/8892] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:16.335585 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:16.354965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3b7e-b850-47d5-80af-92443a8a3ec8 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:16.358621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:16.359226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:16.359503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:16.359774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:16.361510 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:16.374877 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:16.376289 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:16.387130 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4461/8893] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:26.138332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=61 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:26.382318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:32.514143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:32.514653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:32.514783 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:32.576133 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:41:32.577392 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:32.642330 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4433/8894] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:41:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:41:32.707029 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:32.708439 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:32.799507 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65786f5a-366b-46bc-b22b-9655df54412d service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:32.804476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:32.805102 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:32.805382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:32.805652 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:32.814786 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:32.816349 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd68e0-3f46-45d0-ace1-e9d7d61f8e02 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:32.824859 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4462/8895] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:41:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 17:41:42.639464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=44 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:42.821146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=41 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:45.361214 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:45.371213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2acf-7e6f-4108-964c-0ff0e9ed2e1e None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:45.374962 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:45.375531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.376004 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.376161 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.377900 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:45.388454 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:45.389909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:45.398368 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4434/8896] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:45.515697 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.516310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.516425 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.538352 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] MFA Rules not processed for user `437b718c34ab4dba9fe29716caaf2841`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:41:45.539686 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:45.551160 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4463/8897] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:41:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:41:45.564047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:45.573723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde8ff3-6c49-4837-974f-ddba6b1c4f2e service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:45.577641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:45.578481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.578784 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.579047 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.590585 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:45.593284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:45.606131 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4435/8898] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:45.677326 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:45.687520 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143585c-e47c-44b1-bfb6-392d4e3d841e None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:45.691308 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:45.691926 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.692209 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.692478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.694261 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:45.706631 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:45.708052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:45.717194 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4464/8899] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:45.792926 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:45.802568 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415d2ac-7a6a-4851-88f2-ee0bab5dc5bc service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:45.806288 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:45.806945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.807511 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.807827 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.809588 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:45.824143 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:45.825581 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790be8d-09ee-4b0d-8015-822f14c99392 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:45.837125 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4436/8900] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:45.910193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:45.911595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:45.985433 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe2b33-981b-4c58-8b40-0d780358b9c6 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:45.990685 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:45.991332 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:45.991608 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:45.991878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:45.993650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:46.006424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:46.007992 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:46.019104 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4465/8901] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:41:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:41:47.636406 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:47.636924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:47.637125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:47.657243 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:41:47.658465 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:41:47.665639 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4437/8902] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:41:47.677805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:41:47.689705 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2ad53-d393-4961-b840-1b9bd999fec3 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:41:47.694531 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:41:47.695153 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:41:47.695427 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:41:47.695695 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:41:47.704595 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:41:47.706187 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b32441-0d66-46f5-b900-4f9dbab11bd4 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:41:47.714519 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4466/8903] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:41:57.651765 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=21 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:41:57.710989 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=47 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:42:05.101157 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:42:05.117482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0972ad-3ce6-477c-b502-7e9bc21e0397 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:42:05.123949 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:42:05.126094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:42:05.126094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:42:05.126094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:42:05.126995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:42:05.140626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:42:05.142343 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:42:05.155060 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4438/8904] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:42:06.768465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:42:06.768968 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:42:06.769101 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:42:06.790301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:42:06.791575 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:42:06.799010 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4467/8905] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 17:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:42:06.811191 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:42:06.823422 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff432c1f-70b7-4248-a10c-d34320390e48 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:42:06.828304 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:42:06.828911 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:42:06.829213 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:42:06.829480 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:42:06.837532 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:42:06.839751 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:42:06.847839 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4439/8906] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:42:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:42:16.785474 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:42:16.844565 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=12 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:42:19.084698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:42:19.094541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249ec84-82ec-4c3c-8235-c43055737797 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:42:19.098117 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:42:19.098713 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:42:19.098990 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:42:19.099262 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:42:19.100974 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:42:19.123347 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:42:19.124775 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:42:19.132714 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4468/8907] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:42:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:42:29.129254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=11 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:11.968626 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:43:11.970079 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:11.985499 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04595fb-7bd4-4f3d-8293-d2ce980c697a service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:43:11.990496 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:43:11.991112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:43:11.991387 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:43:11.991655 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:43:11.993414 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:12.005388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:43:12.006944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:43:12.016977 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4440/8908] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:43:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:43:14.532693 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:43:14.546587 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd10b0-f157-45ad-a22b-9a5dc233a5f4 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:43:14.552125 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:43:14.552742 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:43:14.553043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:43:14.553318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:43:14.555027 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:14.567176 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:43:14.568745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:43:14.578861 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4469/8909] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:43:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:43:22.012575 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:24.574385 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:43:44.807105 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:43:44.816607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e3ce5-9cd1-4883-9362-9eb7e1a56fbd service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:43:44.820275 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:43:44.820870 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:43:44.821181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:43:44.821448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:43:44.830506 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:43:44.831923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd5ab-3303-4068-8ded-c3e07b80678c service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:43:44.840948 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4441/8910] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:43:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:43:45.725212 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:43:45.727489 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:45.748168 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f977-90f9-41ed-8d64-be7a6f338d4c service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:43:45.754136 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:43:45.754749 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:43:45.755026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:43:45.755303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:43:45.757105 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:45.773199 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:43:45.776754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:43:45.798397 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4470/8911] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:43:50.680832 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:43:50.681583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:43:50.681583 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:43:50.703504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] MFA Rules not processed for user `81c0d4489f15472dbc1dd55e0f528f46`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:43:50.704800 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:43:50.711771 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4442/8912] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:43:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:43:55.786951 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:00.697801 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=9 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:07.864197 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:44:07.877419 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c7cb-fd17-4aa1-9d5d-c7e7eb925de4 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:44:07.882987 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:44:07.883604 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:44:07.883885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:44:07.884158 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:44:07.885924 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:44:07.899495 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:44:07.901110 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:44:07.913155 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4471/8913] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:44:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:44:17.908886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:44:22.306167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:44:22.316199 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abd93-8271-4a85-a9ac-0e0a631ae8df None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:44:22.319661 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:44:22.320249 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:44:22.320522 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:44:22.320788 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:44:22.329971 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:44:22.331381 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:44:22.340573 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4443/8914] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:44:32.336611 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:19.332866 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:46:19.354948 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a967d3-2a92-447d-ba5c-329196626875 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:46:19.358552 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:46:19.359146 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:46:19.359435 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:46:19.359684 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:46:19.379805 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:46:19.381173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:46:19.392901 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4472/8915] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:46:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:46:20.597442 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:46:20.620503 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e95e9-7130-400c-b796-7a3331f9805a service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:46:20.624090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:46:20.624688 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:46:20.624965 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:46:20.625273 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:46:20.636130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:46:20.637627 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:46:20.649343 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4444/8916] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:46:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:46:29.388133 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=13 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:46:30.643670 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:47:23.109770 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:47:23.118574 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0ed3-849a-4717-bb5f-54b01b21e256 service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:47:23.122902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:47:23.123504 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:47:23.123787 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:47:23.124054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:47:23.131341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:47:23.132760 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:47:23.140605 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4473/8917] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:47:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:47:33.137152 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:14.455690 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:14.465241 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4eeea-5c16-4467-9879-2ce667b5e929 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:14.468937 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:14.469600 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:14.469873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:14.470424 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:14.538094 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:14.539517 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:14.549897 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4445/8918] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:48:16.895894 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:16.919054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2ed2-9933-4997-9552-02fb4890820c service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:16.924149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:16.924754 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:16.925057 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:16.925329 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:16.944716 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:16.947852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:16.964978 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4474/8919] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:17.727653 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:17.739935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51403c-e11e-4941-895f-d778259adebd service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:17.746038 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:17.746871 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:17.747314 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:17.747773 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:17.749954 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:17.779284 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:17.781477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:17.793797 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4446/8920] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:18.489548 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:18.505265 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ca0b4-f7cb-4716-9085-a9fbfebc74da service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:18.511784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:18.512401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:18.512678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:18.512947 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:18.522995 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:18.524618 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:18.547449 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4475/8921] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:20.827968 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:20.847445 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30036-ae9f-4491-800a-badfb0851b3a service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:20.852171 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:20.853579 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:20.853829 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:20.854102 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] PATH_INFO: `/v3/users/81c0d4489f15472dbc1dd55e0f528f46` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:20.855531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c0d4489f15472dbc1dd55e0f528f46)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:20.857935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:20.913924 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c0d4489f15472dbc1dd55e0f528f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:20.914504 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c0d4489f15472dbc1dd55e0f528f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:20.921909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c0d4489f15472dbc1dd55e0f528f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:20.922535 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c0d4489f15472dbc1dd55e0f528f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:20.942967 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c0d4489f15472dbc1dd55e0f528f46'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:20.964935 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4447/8922] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:48:20 2022] DELETE /identity/v3/users/81c0d4489f15472dbc1dd55e0f528f46 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:21.144934 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:21.163481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560cc3-fb5d-4a65-826b-6663cc1d37c3 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:21.225366 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:21.226005 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.226286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.226556 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] PATH_INFO: `/v3/projects/dc6222a154d3498ea4bcb82b8ac622df` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.227698 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6222a154d3498ea4bcb82b8ac622df)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:21.230173 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:21.276302 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6222a154d3498ea4bcb82b8ac622df', 'request_id': 'req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.282804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6222a154d3498ea4bcb82b8ac622df', 'request_id': 'req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.288184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6222a154d3498ea4bcb82b8ac622df', 'request_id': 'req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.300908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] The token cache is being invalidate because project dc6222a154d3498ea4bcb82b8ac622df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:48:21.301184 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.301784 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.303246 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4476/8923] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:48:21 2022] DELETE /identity/v3/projects/dc6222a154d3498ea4bcb82b8ac622df => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:21.307709 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:21.309130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:21.321896 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dea8ec-eafd-4452-9d70-42f7705f757e admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:21.364060 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:21.383518 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:21.385363 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.385641 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.385909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] PATH_INFO: `/v3/users/8bc6c5e840d4473d8125b04617e39c01` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.387061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc6c5e840d4473d8125b04617e39c01)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:21.389037 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:21.435337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc6c5e840d4473d8125b04617e39c01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.436056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc6c5e840d4473d8125b04617e39c01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.443103 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc6c5e840d4473d8125b04617e39c01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.443760 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc6c5e840d4473d8125b04617e39c01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.451935 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-30dab2ed-bffe-474c-8015-f9e796b9ca1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc6c5e840d4473d8125b04617e39c01'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.469422 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4448/8924] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:48:21 2022] DELETE /identity/v3/users/8bc6c5e840d4473d8125b04617e39c01 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:21.645053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:21.646620 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:21.660052 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e835ec1-676a-41d2-9475-b68dbcc0fe2b admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:21.710563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:21.718477 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:21.719286 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.719885 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.720030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] PATH_INFO: `/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.721341 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8270fdc13c5d4d14aa305d8deb8f03c3)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:21.723240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:21.770871 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8270fdc13c5d4d14aa305d8deb8f03c3', 'request_id': 'req-fe2df6c6-735e-4226-892c-3f1eb9550b81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.777465 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8270fdc13c5d4d14aa305d8deb8f03c3', 'request_id': 'req-fe2df6c6-735e-4226-892c-3f1eb9550b81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.783592 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8270fdc13c5d4d14aa305d8deb8f03c3', 'request_id': 'req-fe2df6c6-735e-4226-892c-3f1eb9550b81'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.797348 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] The token cache is being invalidate because project 8270fdc13c5d4d14aa305d8deb8f03c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:48:21.797644 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.798706 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-fe2df6c6-735e-4226-892c-3f1eb9550b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:48:21.800228 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4477/8925] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:48:21 2022] DELETE /identity/v3/projects/8270fdc13c5d4d14aa305d8deb8f03c3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:21.805327 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.805619 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.806482 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.826985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:21.827879 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:21.887836 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4449/8926] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:21.895757 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.896065 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.896335 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.917650 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:21.918849 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:21.926747 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4478/8927] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:21.931264 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:21.941330 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28283119-bf14-49b6-9a98-810a4f6e81ee None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:21.945825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:21.946519 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.946826 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.947318 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.947975 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 17:48:21.948278 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:21.949903 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:21.961372 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4450/8928] 10.222.0.78 () {58 vars in 1153 bytes} [Tue Oct 18 17:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 17:48:21.966544 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:21.975745 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cc868-9dd7-4790-b486-886113719cbe None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:21.980766 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:21.981389 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:21.981667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:21.981938 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:21.982572 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:21.984458 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.012195 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4479/8929] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:48:21 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:48:22.016296 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:22.026477 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa5c51-6293-4e1d-ad16-d8d11341fc67 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:22.072122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:22.085515 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:22.086055 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.086332 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.086601 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.087272 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:22.089459 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.110045 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4451/8930] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:48:22 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:48:22.114381 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:22.125309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0ed1-f68b-46f8-ab25-1a840b05cdd6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:22.129888 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:22.130478 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.130758 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.131026 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.131663 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:22.133284 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.143706 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4480/8931] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:48:22.147594 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:22.158137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542b5b9-4b64-4343-bcf2-5a5fa3eebd6d admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:22.162957 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:22.163552 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.163853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.164138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.164767 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:22.166715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ba513-e653-4a14-b48c-14255b6e00e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.177699 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4452/8932] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 17:48:22.182508 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:22.196356 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64fcca-7621-4ca9-b58d-dbac857d007f admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:22.205271 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:22.206438 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.206936 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.207431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] PATH_INFO: `/v3/projects/f4adb7dd22784511b0603632ab9ee795/users/5ad2dec71f4a4cc3b8b585247b6aae19/roles/45f2445471ee4a6986112b01f7d3fa96` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.228318 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4adb7dd22784511b0603632ab9ee795, user_id=5ad2dec71f4a4cc3b8b585247b6aae19, role_id=45f2445471ee4a6986112b01f7d3fa96)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:22.231037 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.245716 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4481/8933] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:48:22 2022] PUT /identity/v3/projects/f4adb7dd22784511b0603632ab9ee795/users/5ad2dec71f4a4cc3b8b585247b6aae19/roles/45f2445471ee4a6986112b01f7d3fa96 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:22.251035 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d129-6619-4ffc-b34e-4bedde5a873c None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.251325 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d129-6619-4ffc-b34e-4bedde5a873c None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.251603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d129-6619-4ffc-b34e-4bedde5a873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.271006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-43c9d129-6619-4ffc-b34e-4bedde5a873c None None] MFA Rules not processed for user `0ecf0b2053e545058e1b1127d92dea3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:22.272201 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-43c9d129-6619-4ffc-b34e-4bedde5a873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:22.332210 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4453/8934] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:22.342151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:22.343904 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:22.402596 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99b2d-45cb-471f-aa53-e03bd9c37da2 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:22.406563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:22.407163 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:22.407442 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:22.407714 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:22.416799 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:22.418250 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:22.427889 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4482/8935] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:27.023438 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.023958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.024072 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.058167 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] MFA Rules not processed for user `5ad2dec71f4a4cc3b8b585247b6aae19`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:27.059481 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:27.134907 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4454/8936] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:27.139480 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.172020 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220b0ed-d74c-434c-8be1-49b9cbce196a service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.176629 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.177500 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.177774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.178041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.178678 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.180569 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.186887 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:27.238818 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4483/8937] 10.222.0.78 () {60 vars in 1153 bytes} [Tue Oct 18 17:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:48:27.242679 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.255974 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62521c-367a-4062-bc44-4737a05cbb5b None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.311378 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:27.318537 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.319390 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.319671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.319944 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.320590 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.323664 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.344424 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4455/8938] 10.222.0.78 () {60 vars in 1144 bytes} [Tue Oct 18 17:48:27 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 17:48:27.348517 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.358919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22292032-9e55-47c7-be17-759731fa56e6 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.363761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.364370 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.364648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.364918 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.365617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.367234 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.379031 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4484/8939] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:48:27.383817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.395043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ed5d2-9159-42bd-8466-af2d32444c41 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.399815 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.400505 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.400782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.401090 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] PATH_INFO: `/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f/users/8edc7015743246fa840ed9bd7b60d0ff/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.416070 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896b17f2c0cb40ebae9550dfa2bab70f, user_id=8edc7015743246fa840ed9bd7b60d0ff, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.418743 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.432502 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4456/8940] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:48:27 2022] PUT /identity/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f/users/8edc7015743246fa840ed9bd7b60d0ff/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:27.436591 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.447541 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0628-624a-4de3-9ec1-266edd77ebdc admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.505486 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.506097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.506387 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.506647 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.507291 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.508928 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa81d9-471d-43c1-a092-cac48e54d7f2 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.518649 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4485/8941] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Oct 18 17:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 17:48:27.523019 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:27.534087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec41cf-1b22-470f-9f86-32f5252e32b3 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:27.538757 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:27.539466 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:27.539838 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:27.540609 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] PATH_INFO: `/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f/users/8edc7015743246fa840ed9bd7b60d0ff/roles/eb5fc6b45679476182540fe032952925` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:27.543142 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896b17f2c0cb40ebae9550dfa2bab70f, user_id=8edc7015743246fa840ed9bd7b60d0ff, role_id=eb5fc6b45679476182540fe032952925)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:27.545782 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:27.557562 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4457/8942] 10.222.0.78 () {60 vars in 1483 bytes} [Tue Oct 18 17:48:27 2022] PUT /identity/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f/users/8edc7015743246fa840ed9bd7b60d0ff/roles/eb5fc6b45679476182540fe032952925 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:48:32.380377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8755-0d98-44a3-9611-988c961ba8dc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:32.380908 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8755-0d98-44a3-9611-988c961ba8dc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:32.381149 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8755-0d98-44a3-9611-988c961ba8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:32.417232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-293d8755-0d98-44a3-9611-988c961ba8dc None None] MFA Rules not processed for user `8edc7015743246fa840ed9bd7b60d0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:32.418605 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-293d8755-0d98-44a3-9611-988c961ba8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:32.494738 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4486/8943] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:32.510781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:32.513226 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:32.627825 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9731c-4976-4a3d-8213-0db72c6358e4 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:32.635228 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:32.636122 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:32.636398 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:32.636665 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:32.704586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:32.706238 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:32.715769 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4458/8944] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:33.738503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678a2e-4253-4ff2-9c6b-02b70857b567 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:33.739021 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678a2e-4253-4ff2-9c6b-02b70857b567 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:33.739248 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a678a2e-4253-4ff2-9c6b-02b70857b567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:33.760414 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-9a678a2e-4253-4ff2-9c6b-02b70857b567 None None] MFA Rules not processed for user `5ad2dec71f4a4cc3b8b585247b6aae19`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:33.761658 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-9a678a2e-4253-4ff2-9c6b-02b70857b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:33.768823 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4487/8945] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:48:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:48:34.095483 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:34.096939 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:34.137564 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:34.156794 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed4f6-842f-4e6f-b0f9-4db706a8f271 service nova] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:34.160339 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:34.160940 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:34.161313 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:34.161584 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:34.163286 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:34.173251 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:34.174671 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:34.183755 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4459/8946] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:34.518079 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:34.518827 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:34.519299 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:34.600835 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:48:34.604311 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:34.609424 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:34.683086 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4488/8947] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:48:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:48:34.694995 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:34.697591 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:34.712011 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c314-4f7a-4bd3-a703-8bf76b8cac8d service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:34.717247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:34.717853 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:34.718130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:34.718396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:34.727886 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:34.729691 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:34.739909 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4460/8948] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:42.842930 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:42.845164 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:42.864422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bf2f3-a775-42f0-8a95-f86f3f04a5fc None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:42.871902 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:42.872519 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:42.872796 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:42.873093 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:42.890336 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:42.904426 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:42.906788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:42.918491 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4489/8949] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:44.735435 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=16 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:45.450087 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:45.459636 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331233-e6cc-452a-97e5-dcd47aa60555 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:45.463923 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:45.464510 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:45.464789 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:45.465088 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:45.473779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:45.475182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f094-3f7f-4001-a2b0-e21350a4f31f service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:45.485069 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4461/8950] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:47.087858 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:48:47.100054 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e3008-b9be-4bad-b121-5c3b8775765c service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:48:47.107351 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:48:47.107991 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:48:47.108263 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:48:47.108535 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:48:47.110738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:48:47.126781 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:48:47.128431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:48:47.140629 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4490/8951] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:48:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:48:55.480873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:48:57.136008 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=37 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:23.007056 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46543b-a5ec-44ee-b428-fb5cda7bc857 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:23.007652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46543b-a5ec-44ee-b428-fb5cda7bc857 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:23.007652 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46543b-a5ec-44ee-b428-fb5cda7bc857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:23.041326 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-0c46543b-a5ec-44ee-b428-fb5cda7bc857 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:23.042802 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-0c46543b-a5ec-44ee-b428-fb5cda7bc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:23.125783 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4462/8952] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:51:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:23.184211 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:23.185691 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:23.315303 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13aab37-cf08-48c3-a1f0-3af66598d1d4 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:23.320256 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:23.320869 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:23.321181 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:23.321451 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:23.329944 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:23.331571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af33c3e-c405-4f2b-9368-463136869206 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:23.339960 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4491/8953] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:51:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:51:33.122818 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=38 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:33.242985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:33.243268 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:33.243541 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:33.264821 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] MFA Rules not processed for user `5ad2dec71f4a4cc3b8b585247b6aae19`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:33.266123 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:33.273985 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4463/8954] 10.222.0.78 () {58 vars in 958 bytes} [Tue Oct 18 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:33.323738 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32bd2-2024-4d82-999b-c1539e77c46c None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:33.324226 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32bd2-2024-4d82-999b-c1539e77c46c None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:33.324324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32bd2-2024-4d82-999b-c1539e77c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:33.387850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-cdb32bd2-2024-4d82-999b-c1539e77c46c None None] MFA Rules not processed for user `dd3b359a6c724c67853394a3a8481995`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:33.389089 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-cdb32bd2-2024-4d82-999b-c1539e77c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:33.450259 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4492/8955] 10.222.0.78 () {58 vars in 1059 bytes} [Tue Oct 18 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:33.457280 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:33.467337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f6528-8d54-43cd-972b-4f7614e5d665 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:33.471089 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b359a6c724c67853394a3a8481995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:33.471648 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:33.471929 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:33.472197 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:33.473952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:33.488112 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:33.489570 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:33.509981 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4464/8956] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:51:33.809048 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb1e7-87be-45b6-8507-9e724080bb44 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:33.809338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb1e7-87be-45b6-8507-9e724080bb44 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:33.809614 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbb1e7-87be-45b6-8507-9e724080bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:33.828931 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=100 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:33.851019 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-49cbb1e7-87be-45b6-8507-9e724080bb44 None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:33.852323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-49cbb1e7-87be-45b6-8507-9e724080bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:33.859486 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4493/8957] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 17:51:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:33.866262 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:33.875366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49979604-34a8-4aee-a164-b96d4d750b0f service glance] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:33.879538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:33.880125 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:33.880396 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:33.880659 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:33.882419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:33.892240 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:33.893715 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16085-1c3a-4490-8dc9-4c7a2a71c36a service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:33.901635 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4465/8958] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:51:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:51:34.238219 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:34.238761 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:34.239656 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:34.261855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:34.263088 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:34.272088 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4494/8959] 10.222.0.78 () {58 vars in 1018 bytes} [Tue Oct 18 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:51:34.273300 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e094-45e2-4281-8264-06959e121a7d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:34.273790 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e094-45e2-4281-8264-06959e121a7d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:34.273868 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818e094-45e2-4281-8264-06959e121a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:34.283555 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:34.284916 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:34.294452 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-5818e094-45e2-4281-8264-06959e121a7d None None] MFA Rules not processed for user `d8cba31795664092a61c6176852b8481`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:34.295723 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-5818e094-45e2-4281-8264-06959e121a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:34.298382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073d3b2-d7c5-423f-a9a8-236cf7e06f65 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:34.303030 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4466/8960] 10.222.0.78 () {58 vars in 1061 bytes} [Tue Oct 18 17:51:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:34.304855 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:34.305496 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:34.305774 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:34.306043 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:34.309488 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818e094-45e2-4281-8264-06959e121a7d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:34.315856 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:34.318618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818e094-45e2-4281-8264-06959e121a7d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:34.318746 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1226f-3892-4c70-9d0a-5c7a3fade443 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:34.322274 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:34.322873 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:34.323150 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:34.323419 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:34.325383 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:34.328784 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4495/8961] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:51:34.340137 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:34.341618 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:34.353283 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4467/8962] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 17:51:35.671382 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:35.671848 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:35.671941 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:35.723104 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:51:35.724431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:35.741805 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4496/8963] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:51:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:51:35.753933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:35.775290 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d975d-531a-4c84-b3ad-cef707f4df57 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:35.780279 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:35.780961 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:35.781261 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:35.781527 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:35.790366 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:35.791933 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:35.800328 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4468/8964] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:51:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:51:45.738376 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=32 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:45.777193 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:51:45.787467 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dbcb5-8684-43de-8f6f-208a1ff006a0 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:51:45.791342 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:51:45.791971 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:51:45.792249 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:51:45.792528 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:51:45.794615 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:51:45.796910 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=38 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:51:45.806259 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:51:45.807623 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:51:45.816260 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4497/8965] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:51:55.812826 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:52:27.055082 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:52:27.064316 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4ffd-9d37-4254-8970-d9e9aa016680 service swift] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:52:27.067875 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:52:27.068464 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:52:27.068741 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:52:27.069031 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:52:27.071538 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:52:27.095043 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:52:27.096457 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:52:27.104594 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4469/8966] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:52:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:52:37.100831 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=11 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:53:20.941307 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:53:20.953961 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b65db7-e514-4ea0-bfde-f3e4fd5276fe service neutron] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:53:20.958910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:53:20.959636 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:53:20.959905 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:53:20.960388 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:53:20.962157 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:53:20.973476 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:53:20.975648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:53:20.985522 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4498/8967] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:53:26.505083 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:53:26.517874 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f90835-f7c4-44a1-82f3-4c2d787204f7 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:53:26.522861 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:53:26.523446 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:53:26.523775 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:53:26.524042 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:53:26.525771 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:53:26.537181 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:53:26.538722 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:53:26.548576 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4470/8968] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:53:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:53:30.981401 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=6 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:53:36.544469 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:53:57.051139 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:53:57.063724 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5d8e-b22c-4577-ab6d-7f1779c87c3f service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:53:57.069436 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:53:57.070044 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:53:57.070324 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:53:57.070597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:53:57.078613 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:53:57.080161 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b27cf-182c-488f-9dd3-f12a1dc02cc0 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:53:57.089847 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4499/8969] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:53:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:04.616239 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:04.633561 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e242a7b-f613-402a-b474-8322e9f7ccc2 service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:04.640138 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:04.640754 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:04.641061 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:04.641337 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:04.652069 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:04.653710 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002ad58-ed0f-4c14-a432-7e89ad9f3732 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:04.665507 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4471/8970] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:05.387360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:05.387822 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:05.387914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:05.408254 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:54:05.409502 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:05.416820 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4500/8971] 10.222.0.78 () {58 vars in 1009 bytes} [Tue Oct 18 17:54:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:54:05.457222 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e64c2-91df-49cb-b47e-1ce3820cc8e2 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:05.457525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e64c2-91df-49cb-b47e-1ce3820cc8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:05.457797 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e64c2-91df-49cb-b47e-1ce3820cc8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:05.507599 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-8c9e64c2-91df-49cb-b47e-1ce3820cc8e2 None None] MFA Rules not processed for user `8f98d1b53918419bad2040f49ad08092`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:54:05.508810 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-8c9e64c2-91df-49cb-b47e-1ce3820cc8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:05.518647 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4472/8972] 10.222.0.78 () {58 vars in 1040 bytes} [Tue Oct 18 17:54:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:54:05.524852 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:05.537792 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827f120-f5a4-484a-b8b3-a10d6efe8ef1 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:05.542778 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:05.543378 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:05.543651 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:05.543919 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:05.552360 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:05.553940 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:05.562328 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4501/8973] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:54:14.840865 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:14.841451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:14.841451 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:14.861310 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:54:14.862835 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:14.869970 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4473/8974] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:54:14.882323 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:14.893779 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03542789-f4ee-4549-97c1-cc16ff532383 service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:14.898694 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:14.899338 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:14.899617 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:14.899886 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:14.908740 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:14.910379 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:14.918678 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4502/8975] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:54:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:54:16.415631 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:16.435472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f722c6-e2ec-48a9-b6f0-1ba159a0852d None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:16.441448 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:16.442073 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:16.442347 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:16.442776 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:16.453607 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:16.455210 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e430-6e22-4e09-ad02-f767c6884f94 service nova] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:16.469578 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4474/8976] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:18.876217 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:18.891232 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a1c4-b75f-4d4a-8535-083038b45b5a service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:18.896983 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '437b718c34ab4dba9fe29716caaf2841', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:18.897688 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:18.898006 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:18.898301 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:18.900240 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:18.913914 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:18.915490 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:18.927808 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4503/8977] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:20.131429 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:20.131869 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:20.131989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:20.150887 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] MFA Rules not processed for user `7d592ee3501240448ef4ca7badae3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:54:20.152077 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:20.159482 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4475/8978] 10.222.0.78 () {58 vars in 967 bytes} [Tue Oct 18 17:54:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:54:20.172041 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:20.183712 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab19ac9-3df4-49e4-82d0-a43c6b2a60b3 service nova] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:20.188524 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f98d1b53918419bad2040f49ad08092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:20.189086 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:20.189362 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:20.189628 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:20.197606 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:20.199208 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:20.207436 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4504/8979] 10.222.0.78 () {60 vars in 1384 bytes} [Tue Oct 18 17:54:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 17:54:25.267119 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:25.276586 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f1940-80ef-48a3-b8d6-5478b2aedabf None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:25.280635 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8cba31795664092a61c6176852b8481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:25.281508 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:25.281779 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:25.282040 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:25.344945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:25.346410 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:25.356315 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4476/8980] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:28.357151 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:28.363621 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=34 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:28.371878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba66ed-36ec-4ee6-81a9-ec7d7d8e547e service swift] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:28.377309 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:28.378122 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:28.378576 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:28.379015 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:28.381012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:28.393899 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:28.395878 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:28.411794 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4505/8981] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:31.894683 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:31.902952 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=63 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:31.914023 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88008eea-2f30-4901-93f0-51de7c2c6a65 service neutron] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:31.921490 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:31.922472 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:31.922986 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:31.923453 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:31.925525 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:31.956130 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:31.958489 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:31.973686 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4477/8982] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:54:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:54:31.980481 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:31.994429 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c24d72-757b-4274-ac19-4c6f80512116 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:32.000355 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:32.001030 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:32.001310 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:32.001578 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] PATH_INFO: `/v3/users/5ad2dec71f4a4cc3b8b585247b6aae19` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:32.002767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad2dec71f4a4cc3b8b585247b6aae19)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:32.004733 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:32.060910 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad2dec71f4a4cc3b8b585247b6aae19'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.080201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad2dec71f4a4cc3b8b585247b6aae19'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.080850 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad2dec71f4a4cc3b8b585247b6aae19'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.091925 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad2dec71f4a4cc3b8b585247b6aae19'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.093277 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad2dec71f4a4cc3b8b585247b6aae19'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.112709 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4506/8983] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:54:31 2022] DELETE /identity/v3/users/5ad2dec71f4a4cc3b8b585247b6aae19 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:54:32.305563 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:32.317301 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e45a6-9df1-4a14-971e-1c01aa76503c service placement] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:32.378657 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:32.379282 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:32.379558 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:32.379855 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] PATH_INFO: `/v3/projects/f4adb7dd22784511b0603632ab9ee795` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:32.380985 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4adb7dd22784511b0603632ab9ee795)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:32.382895 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:32.431018 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4adb7dd22784511b0603632ab9ee795', 'request_id': 'req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.439294 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4adb7dd22784511b0603632ab9ee795', 'request_id': 'req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.446462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4adb7dd22784511b0603632ab9ee795', 'request_id': 'req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.457247 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] The token cache is being invalidate because project f4adb7dd22784511b0603632ab9ee795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:54:32.457531 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.458182 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.459664 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4478/8984] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:54:32 2022] DELETE /identity/v3/projects/f4adb7dd22784511b0603632ab9ee795 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:54:32.463599 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:32.465506 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:32.478767 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878bc19-c9a0-4eaa-a2ff-d1e98987dd76 admin admin] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:32.547422 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:32.548053 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:32.548327 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:32.548597 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] PATH_INFO: `/v3/users/8edc7015743246fa840ed9bd7b60d0ff` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:32.549748 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edc7015743246fa840ed9bd7b60d0ff)` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:32.551648 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:32.605997 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edc7015743246fa840ed9bd7b60d0ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.615012 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edc7015743246fa840ed9bd7b60d0ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.615708 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edc7015743246fa840ed9bd7b60d0ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.623096 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edc7015743246fa840ed9bd7b60d0ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.623788 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.notifications [None req-a4226215-774d-40c7-81e0-7b7a57da2cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edc7015743246fa840ed9bd7b60d0ff'} {{(pid=81776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.624884 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:32.646106 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4507/8985] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Oct 18 17:54:32 2022] DELETE /identity/v3/users/8edc7015743246fa840ed9bd7b60d0ff => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:54:32.826462 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:54:32.827925 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:54:32.849353 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e86aa6-d899-43c9-9a5a-fb57c3b844e7 admin admin] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:54:32.910989 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ecf0b2053e545058e1b1127d92dea3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c8d96b0623744b2b02923664ec6fcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:54:32.911678 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:54:32.911958 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:54:32.912235 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] PATH_INFO: `/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:54:32.913375 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896b17f2c0cb40ebae9550dfa2bab70f)` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:54:32.915287 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:54:32.944781 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:32.970705 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896b17f2c0cb40ebae9550dfa2bab70f', 'request_id': 'req-587d66d0-3edc-4034-ba0b-2d667cefb936'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.979333 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896b17f2c0cb40ebae9550dfa2bab70f', 'request_id': 'req-587d66d0-3edc-4034-ba0b-2d667cefb936'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.985892 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896b17f2c0cb40ebae9550dfa2bab70f', 'request_id': 'req-587d66d0-3edc-4034-ba0b-2d667cefb936'} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.996909 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] The token cache is being invalidate because project 896b17f2c0cb40ebae9550dfa2bab70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 17:54:32.997257 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.997902 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.notifications [None req-587d66d0-3edc-4034-ba0b-2d667cefb936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 17:54:32.999389 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4479/8986] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Oct 18 17:54:32 2022] DELETE /identity/v3/projects/896b17f2c0cb40ebae9550dfa2bab70f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 17:54:42.641377 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:54:42.993116 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:55:22.911201 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] REQUEST_METHOD: `POST` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:55:22.911804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:55:22.911804 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:55:22.932394 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.auth.core [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:55:22.933625 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.fernet_utils [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:55:22.998980 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4508/8987] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Oct 18 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 17:55:23.011006 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdedae-a356-4b62-baf5-d992d3fb4cb3 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:55:23.011416 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdedae-a356-4b62-baf5-d992d3fb4cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:55:23.011597 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdedae-a356-4b62-baf5-d992d3fb4cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:55:23.031681 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-26fdedae-a356-4b62-baf5-d992d3fb4cb3 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:55:23.032843 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-26fdedae-a356-4b62-baf5-d992d3fb4cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:55:23.042243 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4480/8988] 10.222.0.78 () {58 vars in 1058 bytes} [Tue Oct 18 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:55:23.048549 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:55:23.059571 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797eea3-7fd6-492b-83a4-c76f724d50d5 None None] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:55:23.064484 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:55:23.065108 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:55:23.065488 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:55:23.065762 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:55:23.073949 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:55:23.075509 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:55:23.085324 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4509/8989] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:55:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:55:27.489894 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] REQUEST_METHOD: `POST` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:55:27.490461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:55:27.490461 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:55:27.510008 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.auth.core [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] MFA Rules not processed for user `c0d2b97624d649e3b36fd2fad9f31dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 17:55:27.511189 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.fernet_utils [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 17:55:27.520017 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4481/8990] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Oct 18 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 17:55:27.532563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 17:55:27.543447 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a66504-1fec-4ab4-95a9-d4af090ccb43 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 17:55:27.548399 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 17:55:27.548986 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 17:55:27.549281 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 17:55:27.549554 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 17:55:27.558965 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 17:55:27.560503 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 17:55:27.570384 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4510/8991] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 17:55:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 17:55:37.505218 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=6 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 17:55:37.566023 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=41 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 18:00:28.971603 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] Authenticating user token {{(pid=81775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:00:28.992675 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36face-f84d-4425-9566-c6cab82d5911 None None] Validating token access rules against request {{(pid=81775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:00:28.997666 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:00:28.998266 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] REQUEST_METHOD: `GET` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:00:28.998544 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] SCRIPT_NAME: `/identity` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:00:28.998817 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:00:29.007768 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:00:29.009388 n-d-858383-14 devstack@keystone.service[81775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87557f9-c020-4f4e-be4b-82d07669b33d service placement] RBAC: Authorization granted {{(pid=81775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:00:29.019376 n-d-858383-14 devstack@keystone.service[81775]: [pid: 81775|app: 0|req: 4482/8992] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 18:00:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:00:30.524667 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] Authenticating user token {{(pid=81776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 18:00:30.545538 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6300b0e-aa40-4e47-9f3d-8760a81795d4 service placement] Validating token access rules against request {{(pid=81776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 18:00:30.551431 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d2b97624d649e3b36fd2fad9f31dbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1a7243113d548bcab5edb023b93447e', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 18:00:30.552017 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] REQUEST_METHOD: `GET` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 18:00:30.552294 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] SCRIPT_NAME: `/identity` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 18:00:30.552563 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 18:00:30.560843 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 18:00:30.562457 n-d-858383-14 devstack@keystone.service[81776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d018ec4f-c67b-4c73-98fd-a06ac8b63d8f service placement] RBAC: Authorization granted {{(pid=81776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 18:00:30.573182 n-d-858383-14 devstack@keystone.service[81776]: [pid: 81776|app: 0|req: 4511/8993] 10.222.0.78 () {60 vars in 1365 bytes} [Tue Oct 18 18:00:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 18:00:39.014945 n-d-858383-14 devstack@keystone.service[81775]: DEBUG dbcounter [-] [81775] Writing DB stats keystone:SELECT=10 {{(pid=81775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 18:00:40.569097 n-d-858383-14 devstack@keystone.service[81776]: DEBUG dbcounter [-] [81776] Writing DB stats keystone:SELECT=10 {{(pid=81776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}